Data augmentation and transfer learning strategies for reaction prediction in low chemical data regimes

Yun Zhang, Ling Wang, Xinqiao Wang, Chengyun Zhang, Jiamin Ge, Jing Tang, An Su, Hongliang Duan

Research output: Contribution to journalArticlepeer-review

31 Citations (Scopus)

Abstract

Effective and rapid deep learning method to predict chemical reactions contributes to the research and development of organic chemistry and drug discovery. Despite the outstanding capability of deep learning in retrosynthesis and forward synthesis, predictions based on small chemical datasets generally result in a low accuracy due to an insufficiency of reaction examples. Here, we introduce a new state-of-The-Art method, which integrates transfer learning with the transformer model to predict the outcomes of the Baeyer-Villiger reaction which is a representative small dataset reaction. The results demonstrate that introducing a transfer learning strategy markedly improves the top-1 accuracy of the transformer-Transfer learning model (81.8%) over that of the transformer-baseline model (58.4%). Moreover, we further introduce data augmentation to the input reaction SMILES, which allows for a better performance and improves the accuracy of the transformer-Transfer learning model (86.7%). In summary, both transfer learning and data augmentation methods significantly improve the predictive performance of transformer models, which are powerful methods used in the field of chemistry to eliminate the restriction of limited training data.

Original languageEnglish
Pages (from-to)1415-1423
Number of pages9
JournalOrganic Chemistry Frontiers
Volume8
Issue number7
DOIs
Publication statusPublished - 7 Apr 2021
Externally publishedYes

Fingerprint

Dive into the research topics of 'Data augmentation and transfer learning strategies for reaction prediction in low chemical data regimes'. Together they form a unique fingerprint.

Cite this