AUTHOR=Xie Fangfang , Zheng Changdong , Ji Tingwei , Zhang Xinshuai , Bi Ran , Zhou Hongjie , Zheng Yao 

TITLE=Deep Reinforcement Learning: A New Beacon for Intelligent Active Flow Control

JOURNAL=Aerospace Research Communications

VOLUME=1

YEAR=2023

URL=https://www.frontierspartnerships.org/journals/aerospace-research-communications/articles/10.3389/arc.2023.11130

DOI=10.3389/arc.2023.11130

ISSN=2813-6209

ABSTRACT=<p>The ability to manipulate fluids has always been one of the focuses of scientific research and engineering application. The rapid development of machine learning technology provides a new perspective and method for active flow control. This review presents recent progress in combining reinforcement learning with high-dimensional, non-linear, and time-delay physical information. Compared with model-based closed-loop control methods, deep reinforcement learning (DRL) avoids modeling the complex flow system and effectively provides an intelligent end-to-end policy exploration paradigm. At the same time, there is no denying that obstacles still exist on the way to practical application. We have listed some challenges and corresponding advanced solutions. This review is expected to offer a deeper insight into the current state of DRL-based active flow control within fluid mechanics and inspires more non-traditional thinking for engineering.</p>