Automated synthesis of steady-state continuous processes using reinforcement learning

Quirin Göttl , Dominik G. Grimm , Jakob Burger

Front. Chem. Sci. Eng. ›› 2022, Vol. 16 ›› Issue (2) : 288 -302.

PDF (833KB)
Front. Chem. Sci. Eng. ›› 2022, Vol. 16 ›› Issue (2) : 288 -302. DOI: 10.1007/s11705-021-2055-9
RESEARCH ARTICLE
RESEARCH ARTICLE

Automated synthesis of steady-state continuous processes using reinforcement learning

Author information +
History +
PDF (833KB)

Abstract

Automated flowsheet synthesis is an important field in computer-aided process engineering. The present work demonstrates how reinforcement learning can be used for automated flowsheet synthesis without any heuristics or prior knowledge of conceptual design. The environment consists of a steady-state flowsheet simulator that contains all physical knowledge. An agent is trained to take discrete actions and sequentially build up flowsheets that solve a given process problem. A novel method named SynGameZero is developed to ensure good exploration schemes in the complex problem. Therein, flowsheet synthesis is modelled as a game of two competing players. The agent plays this game against itself during training and consists of an artificial neural network and a tree search for forward planning. The method is applied successfully to a reaction-distillation process in a quaternary system.

Graphical abstract

Keywords

automated process synthesis / flowsheet synthesis / artificial intelligence / machine learning / reinforcement learning

Cite this article

Download citation ▾
Quirin Göttl, Dominik G. Grimm, Jakob Burger. Automated synthesis of steady-state continuous processes using reinforcement learning. Front. Chem. Sci. Eng., 2022, 16(2): 288-302 DOI:10.1007/s11705-021-2055-9

登录浏览全文

4963

注册一个新账户 忘记密码

References

RIGHTS & PERMISSIONS

The Author(s) 2021. This article is published with open access at link.springer.com and journal.hep.com.cn

AI Summary AI Mindmap
PDF (833KB)

6731

Accesses

0

Citation

Detail

Sections
Recommended

AI思维导图

/