AUTHOR=Xie Fangfang , Zheng Changdong , Ji Tingwei , Zhang Xinshuai , Bi Ran , Zhou Hongjie , Zheng Yao TITLE=Deep Reinforcement Learning: A New Beacon for Intelligent Active Flow Control JOURNAL=Aerospace Research Communications VOLUME=1 YEAR=2023 URL=https://www.frontierspartnerships.org/journals/aerospace-research-communications/articles/10.3389/arc.2023.11130 DOI=10.3389/arc.2023.11130 ISSN=2813-6209 ABSTRACT=

The ability to manipulate fluids has always been one of the focuses of scientific research and engineering application. The rapid development of machine learning technology provides a new perspective and method for active flow control. This review presents recent progress in combining reinforcement learning with high-dimensional, non-linear, and time-delay physical information. Compared with model-based closed-loop control methods, deep reinforcement learning (DRL) avoids modeling the complex flow system and effectively provides an intelligent end-to-end policy exploration paradigm. At the same time, there is no denying that obstacles still exist on the way to practical application. We have listed some challenges and corresponding advanced solutions. This review is expected to offer a deeper insight into the current state of DRL-based active flow control within fluid mechanics and inspires more non-traditional thinking for engineering.