Microswimmer reinforcement learning with genetic algorithms
Speakers
- Dr. Andreas Zöttl — University of Vienna
- Henry Shum — University of Waterloo
- Yuan-Nan Young
Abstract
Microswimmers consist of different body parts which enable them to deform their shape periodically to move in viscous fluids at low Reynolds number, realized, for example by waving cilia or flagella, or by deforming their entire cell body. Our aim is to understand how microswimmers can change their deformation and swimming gaits based on sensory input from their environment and from their internal state. When coupled to a physical environment a microswimmer cannot just decide where to go, but needs to deform its shape in order to go somewhere. We model the microswimmer decision-making of the sensory-based deformation using reinforcement learning. Using genetic algorithms of evolving artificial neural networks allows us to extract simple decision-making strategies.
Looking for more in the field?
Explore more events from Journal of Engineering Mathematics Seminar Series and Springer Nature's Engineering.
Follow the Topic
Related Collections
With Collections, you can get published faster and increase your visibility.
Machine Learning Approaches to Locomotion at Low Reynolds Numbers
Locomotion in viscous-dominated environments, where inertial effects are negligible and the Reynolds number is small, is a central topic in engineering mathematics. In this regime, propulsion emerges from geometric and kinematic interactions between deforming bodies and the surrounding Stokes flow. Classical theoretical developments—including kinematic reversibility, reciprocal-theorem formulations, geometric descriptions of swimming strokes, and optimal control of body deformation—have established a rigorous framework for understanding microswimmer propulsion and fluid–structure interactions in highly viscous fluids. These studies have revealed how hydrodynamic forces, elasticity, and internal actuation combine to generate motion through complex yet mathematically tractable mechanisms. Many modern problems in microscale locomotion, however, involve high-dimensional control spaces and strongly coupled physical processes. Systems with flexible filaments, distributed actuation, or chemically active interfaces introduce parameter regimes that are difficult to explore systematically using purely analytical or traditional numerical approaches. Machine learning offers complementary tools for organizing and reducing such complexity. When combined with the physical structure of Stokesian hydrodynamics—such as linear force balance, geometric constraints, and viscous dissipation—data-driven methods can help identify effective propulsion strategies, reduced dynamical descriptions, and efficient computational representations. This collection invites original research and review articles that integrate modern machine learning methodologies with the mathematical principles governing low-Reynolds-number locomotion. Topics of interest include physics-informed neural networks for viscous flow problems, operator learning for Stokes solvers, sparse model discovery for swimmer dynamics, reinforcement learning for stroke optimization and control, and reduced-order representations of fluid–structure interactions. By emphasizing mathematical formulation, physical consistency, and reproducibility, the collection aims to highlight emerging frameworks that connect machine learning with the analytical structure of viscous flows and the mechanics of microscale propulsion.
Publishing Model: Hybrid
Deadline: Mar 31, 2027
Mathematics of Hydrogels
Publishing Model: Hybrid
Deadline: Dec 31, 2026