Advances of machine learning in materials science: Ideas and techniques

Sue Sin Chong, Yi Sheng Ng, Hui-Qiong Wang, Jin-Cheng Zheng

PDF(11699 KB)
PDF(11699 KB)
Front. Phys. ›› 2024, Vol. 19 ›› Issue (1) : 13501. DOI: 10.1007/s11467-023-1325-z
REVIEW ARTICLE

Advances of machine learning in materials science: Ideas and techniques

Author information +
History +

Abstract

In this big data era, the use of large dataset in conjunction with machine learning (ML) has been increasingly popular in both industry and academia. In recent times, the field of materials science is also undergoing a big data revolution, with large database and repositories appearing everywhere. Traditionally, materials science is a trial-and-error field, in both the computational and experimental departments. With the advent of machine learning-based techniques, there has been a paradigm shift: materials can now be screened quickly using ML models and even generated based on materials with similar properties; ML has also quietly infiltrated many sub-disciplinary under materials science. However, ML remains relatively new to the field and is expanding its wing quickly. There are a plethora of readily-available big data architectures and abundance of ML models and software; The call to integrate all these elements in a comprehensive research procedure is becoming an important direction of material science research. In this review, we attempt to provide an introduction and reference of ML to materials scientists, covering as much as possible the commonly used methods and applications, and discussing the future possibilities.

Graphical abstract

Keywords

machine learning / materials science

Cite this article

Download citation ▾
Sue Sin Chong, Yi Sheng Ng, Hui-Qiong Wang, Jin-Cheng Zheng. Advances of machine learning in materials science: Ideas and techniques. Front. Phys., 2024, 19(1): 13501 https://doi.org/10.1007/s11467-023-1325-z

References

[1]
E. Weinan. Machine learning and computational mathematics. Commun. Comput. Phys., 2020, 28: 1639
CrossRef ADS Google scholar
[2]
A. Agrawal, A. Choudhary. Perspective: Materials informatics and big data: Realization of the “fourth paradigm” of science in materials science. APL Mater., 2016, 4(5): 053208
CrossRef ADS Google scholar
[3]
Y. Xu, X. Liu, X. Cao, C. Huang, E. Liu. . Artificial intelligence: A powerful paradigm for scientific research. The Innovation, 2021, 2(4): 100179
CrossRef ADS Google scholar
[4]
G. Carleo, I. Cirac, K. Cranmer, L. Daudet, M. Schuld, N. Tishby, L. Vogt-Maranto, L. Zdeborová. Machine learning and the physical sciences. Rev. Mod. Phys., 2019, 91: 045002
CrossRef ADS Google scholar
[5]
G. R. Schleder, A. C. M. Padilha, C. M. Acosta, M. Costa, A. Fazzio. From DFT to machine learning: Recent approaches to materials science – A review. J. Phys.: Mater., 2019, 2(3): 032001
CrossRef ADS Google scholar
[6]
R. Potyrailo, K. Rajan, K. Stoewe, I. Takeuchi, B. Chisholm, H. Lam. Combinatorial and high-throughput screening of materials libraries: Review of state of the art. ACS Combin. Sci., 2011, 13(6): 579
CrossRef ADS Google scholar
[7]
K. Alberi, M. B. Nardelli, A. Zakutayev, L. Mitas, S. Curtarolo. . The 2019 materials by design roadmap. J. Phys. D, 2018, 52(1): 013001
CrossRef ADS Google scholar
[8]
S. Torquato. Optimal design of heterogeneous materials. Ann. Rev. Mater. Res., 2010, 40: 101
CrossRef ADS Google scholar
[9]
A. A. White. Big data are shaping the future of materials science. MRS Bull., 2013, 38(8): 594
CrossRef ADS Google scholar
[10]
Z. Fan, H. Q. Wang, J. C. Zheng. Searching for the best thermoelectrics through the optimization of transport distribution function. J. Appl. Phys., 2011, 109(7): 073713
CrossRef ADS Google scholar
[11]
J. C. Zheng, Y. Zhu. Searching for a higher superconducting transition temperature in strained MgB2. Phys. Rev. B, 2006, 73: 024509
CrossRef ADS Google scholar
[12]
J. C. Zheng. Asymmetrical transport distribution function: Skewness as a key to enhance thermoelectric performance. Research, 2022, 2022: 9867639
CrossRef ADS Google scholar
[13]
J. C. Zheng. Recent advances on thermoelectric materials. Front. Phys. China, 2008, 3(3): 269
CrossRef ADS Google scholar
[14]
J. C. Zheng, A. I. Frenkel, L. Wu, J. Hanson, W. Ku, E. S. Bozin, S. J. L. Billinge, Y. Zhu. Nanoscale disorder and local electronic properties of CaCu3Ti4O12: An integrated study of electron, neutron, and X-ray diffraction, X-ray absorption fine structure, and first-principles calculations. Phys. Rev. B, 2010, 81(14): 144203
CrossRef ADS Google scholar
[15]
N. Sa, S. S. Chong, H. Q. Wang, J. C. Zheng. Anisotropy engineering of ZnO nanoporous frameworks: A lattice dynamics simulation. Nanomaterials (Basel), 2022, 12(18): 3239
CrossRef ADS Google scholar
[16]
H.ChengJ. C. Zheng, Ab initio study of anisotropic mechanical and electronic properties of strained carbon-nitride nanosheet with interlayer bonding, Front. Phys. 16(4), 43505 (2021)
[17]
Y. Huang, C. Y. Haw, Z. Zheng, J. Kang, J. C. Zheng, H. Q. Wang. Biosynthesis of zinc oxide nanomaterials from plant extracts and future green prospects: A topical review. Adv. Sustain. Syst., 2021, 5(6): 2000266
CrossRef ADS Google scholar
[18]
Z.Q. WangH. ChengT.Y. LüH.Q. WangY.P. Feng J.C. Zheng, A super-stretchable boron nanoribbon network, Phys. Chem. Chem. Phys. 20(24), 16510 (2018)
[19]
Y. Li, H. Q. Wang, T. J. Chu, Y. C. Li, X. Li, X. Liao, X. Wang, H. Zhou, J. Kang, K. C. Chang, T. C. Chang, T. M. Tsai, J. C. Zheng. Tuning the nanostructures and optical properties of undoped and N-doped ZnO by supercritical fluid treatment. AIP Adv., 2018, 8(5): 055310
CrossRef ADS Google scholar
[20]
Y. L. Li, Z. Fan, J. C. Zheng. Enhanced thermoelectric performance in graphitic ZnO (0001) nanofilms. J. Appl. Phys., 2013, 113(8): 083705
CrossRef ADS Google scholar
[21]
J. He, I. D. Blum, H. Q. Wang, S. N. Girard, J. Doak, L. D. Zhao, J. C. Zheng, G. Casillas, C. Wolverton, M. Jose-Yacaman, D. N. Seidman, M. G. Kanatzidis, V. P. Dravid. Morphology control of nanostructures: Na-doped PbTe–PbS system. Nano Lett., 2012, 12(11): 5979
CrossRef ADS Google scholar
[22]
Z. Fan, J. Zheng, H. Q. Wang, J. C. Zheng. Enhanced thermoelectric performance in three-dimensional superlattice of topological insulator thin films. Nanoscale Res. Lett., 2012, 7(1): 570
CrossRef ADS Google scholar
[23]
N. Wei, H. Q. Wang, J. C. Zheng. Nanoparticle manipulation by thermal gradient. Nanoscale Res. Lett., 2012, 7(1): 154
CrossRef ADS Google scholar
[24]
N. Wei, Z. Fan, L. Q. Xu, Y. P. Zheng, H. Q. Wang, J. C. Zheng. Knitted graphene-nanoribbon sheet: A mechanically robust structure. Nanoscale, 2012, 4(3): 785
CrossRef ADS Google scholar
[25]
J. Q. He, J. R. Sootsman, L. Q. Xu, S. N. Girard, J. C. Zheng, M. G. Kanatzidis, V. P. Dravid. Anomalous electronic transport in dual-nanostructured lead telluride. J. Am. Chem. Soc., 2011, 133(23): 8786
CrossRef ADS Google scholar
[26]
N. Wei, L. Xu, H. Q. Wang, J. C. Zheng. Strain engineering of thermal conductivity in graphene sheets and nanoribbons: A demonstration of magic flexibility. Nanotechnology, 2011, 22(10): 105705
CrossRef ADS Google scholar
[27]
J. He, J. R. Sootsman, S. N. Girard, J. C. Zheng, J. Wen, Y. Zhu, M. G. Kanatzidis, V. P. Dravid. On the origin of increased phonon scattering in nanostructured PbTe-based thermoelectric materials. J. Am. Chem. Soc., 2010, 132(25): 8669
CrossRef ADS Google scholar
[28]
Y. Zhu, J. C. Zheng, L. Wu, A. I. Frenkel, J. Hanson, P. Northrup, W. Ku. Nanoscale disorder in CaCu3Ti4O12: A new route to the enhanced dielectric response. Phys. Rev. Lett., 2007, 99(3): 037602
CrossRef ADS Google scholar
[29]
J. C. Zheng, H. Q. Wang, A. T. S. Wee, C. H. A. Huan. Structural and electronic properties of Al nanowires: An ab initio pseudopotential study. Int. J. Nanosci., 2002, 01(02): 159
CrossRef ADS Google scholar
[30]
J. C. Zheng, H. Q. Wang, A. T. S. Wee, C. H. A. Huan. Possible complete miscibility of (BN)x(C2)1−x alloys. Phys. Rev. B, 2002, 66(9): 092104
CrossRef ADS Google scholar
[31]
J. C. Zheng, H. Q. Wang, C. H. A. Huan, A. T. S. Wee. The structural and electronic properties of (AlN)x(C2)1−x and (AlN)x(BN)1−x alloys. J. Phys.: Condens. Matter, 2001, 13(22): 5295
CrossRef ADS Google scholar
[32]
H. Q. Wang, J. C. Zheng, R. Z. Wang, Y. M. Zheng, S. H. Cai. Valence-band offsets of III−V alloy heterojunctions. Surf. Interface Anal., 1999, 28(1): 177
CrossRef ADS Google scholar
[33]
J. C. Zheng, R. Z. Wang, Y. M. Zheng, S. H. Cai. Valence offsets of three series of alloy heterojunctions. Chin. Phys. Lett., 1997, 14(10): 775
CrossRef ADS Google scholar
[34]
J. C. Zheng, Y. Zheng, R. Wang. Valence offsets of ternary alloy heterojunctions InxGa1-xAs/InxAl1-xAs. Chin. Sci. Bull., 1996, 41(24): 2050
[35]
L. Liu, T. Wang, L. Sun, T. Song, H. Yan, C. Li, D. Mu, J. Zheng, Y. Dai. Stable cycling of all‐solid‐state lithium metal batteries enabled by salt engineering of PEO‐based polymer electrolytes. Energy Environ. Mater., 2023, (Feb.): e12580
CrossRef ADS Google scholar
[36]
W. Zhang, F. Y. Du, Y. Dai, J. C. Zheng. Strain engineering of Li+ ion migration in olivine phosphate cathode materials LiMPO4 (M = Mn, Fe, Co) and (LiFePO4)n(LiMnPO4)m superlattices. Phys. Chem. Chem. Phys., 2023, 25(8): 6142
CrossRef ADS Google scholar
[37]
B. Zhang, L. Wu, J. Zheng, P. Yang, X. Yu, J. Ding, S. M. Heald, R. A. Rosenberg, T. V. Venkatesan, J. Chen, C. J. Sun, Y. Zhu, G. M. Chow. Control of magnetic anisotropy by orbital hybridization with charge transfer in (La0.67Sr0.33MnO3)n/(SrTiO3)n superlattice. NPG Asia Mater., 2018, 10(9): 931
CrossRef ADS Google scholar
[38]
L. Zhang, T. Y. Lü, H. Q. Wang, W. X. Zhang, S. W. Yang, J. C. Zheng. First principles studies on the thermoelectric properties of (SrO)m(SrTiO3)n superlattice. RSC Adv., 2016, 6(104): 102172
CrossRef ADS Google scholar
[39]
J. C. Zheng, C. H. A. Huan, A. T. S. Wee, M. A. V. Hove, C. S. Fadley, F. J. Shi, E. Rotenberg, S. R. Barman, J. J. Paggel, K. Horn, P. Ebert, K. Urban. Atomic scale structure of the 5-fold surface of a AlPdMn quasicrystal: A quantitative X-ray photoelectron diffraction analysis. Phys. Rev. B, 2004, 69(13): 134107
CrossRef ADS Google scholar
[40]
H. Q. Wang, J. Xu, X. Lin, Y. Li, J. Kang, J. C. Zheng. Determination of the embedded electronic states at nanoscale interface via surface-sensitive photoemission spectroscopy. Light Sci. Appl., 2021, 10(1): 153
CrossRef ADS Google scholar
[41]
M. A. Van Hove, K. Hermann, P. R. Watson. The NIST surface structure database – SSD version 4. Acta Crystallogr. B, 2002, 58(3): 338
CrossRef ADS Google scholar
[42]
H. Q. Wang, E. Altman, C. Broadbridge, Y. Zhu, V. Henrich. Determination of electronic structure of oxide-oxide interfaces by photoemission spectroscopy. Adv. Mater., 2010, 22: 2950
CrossRef ADS Google scholar
[43]
H. Zhou, L. Wu, H. Q. Wang, J. C. Zheng, L. Zhang, K. Kisslinger, Y. Li, Z. Wang, H. Cheng, S. Ke, Y. Li, J. Kang, Y. Zhu. Interfaces between hexagonal and cubic oxides and their structure alternatives. Nat. Commun., 2017, 8(1): 1474
CrossRef ADS Google scholar
[44]
J. D. Steiner, H. Cheng, J. Walsh, Y. Zhang, B. Zydlewski, L. Mu, Z. Xu, M. M. Rahman, H. Sun, F. M. Michel, C. J. Sun, D. Nordlund, W. Luo, J. C. Zheng, H. L. Xin, F. Lin. Targeted surface doping with reversible local environment improves oxygen stability at the electrochemical interfaces of nickel-rich cathode materials. ACS Appl. Mater. Interfaces, 2019, 11(41): 37885
CrossRef ADS Google scholar
[45]
J. C. Zheng, H. Q. Wang, A. T. S. Wee, C. H. A. Huan. Trends in bonding configuration at SiC/III–V semiconductor interfaces. Appl. Phys. Lett., 2001, 79(11): 1643
CrossRef ADS Google scholar
[46]
H.Q. WangJ. C. ZhengA.T. S. WeeC.H. A. Huan, Study of electronic properties and bonding configuration at the BN/SiC interface, J. Electron Spectrosc. Relat. Phenom. 114–116, 483 (2001)
[47]
S. Lin, B. Zhang, T. Y. Lü, J. C. Zheng, H. Pan, H. Chen, C. Lin, X. Li, J. Zhou. Inorganic lead-free B-γ-CsSnI 3 perovskite solar cells using diverse electron-transporting materials: A simulation study. ACS Omega, 2021, 6(40): 26689
CrossRef ADS Google scholar
[48]
F. Y. Du, W. Zhang, H. Q. Wang, J. C. Zheng. Enhancement of thermal rectification by asymmetry engineering of thermal conductivity and geometric structure for the multi-segment thermal rectifier. Chin. Phys. B, 2023, 32(6): 064402
CrossRef ADS Google scholar
[49]
M. Kulichenko, J. S. Smith, B. Nebgen, Y. W. Li, N. Fedik, A. I. Boldyrev, N. Lubbers, K. Barros, S. Tretiak. The rise of neural networks for materials and chemical dynamics. J. Phys. Chem. Lett., 2021, 12(26): 6227
CrossRef ADS Google scholar
[50]
W. Sha, Y. Guo, Q. Yuan, S. Tang, X. Zhang, S. Lu, X. Guo, Y. C. Cao, S. Cheng. Artificial intelligence to power the future of materials science and engineering. Adv. Intell. Syst., 2020, 2(4): 1900143
CrossRef ADS Google scholar
[51]
S.Leonelli, Scientific research and big data, in: The Stanford Encyclopedia of Philosophy, Summer 2020 Ed., edited by E. N. Zalta, Metaphysics Research Lab, Stanford University, 2020
[52]
J. Westermayr, M. Gastegger, K. T. Schütt, R. J. Maurer. Perspective on integrating machine learning into computational chemistry and materials science. J. Chem. Phys., 2021, 154(23): 230903
CrossRef ADS Google scholar
[53]
D. Morgan, R. Jacobs. Opportunities and challenges for machine learning in materials science. Annu. Rev. Mater. Res., 2020, 50(1): 71
CrossRef ADS Google scholar
[54]
C.ChenY. ZuoW.YeX.LiZ.Deng S.P. Ong, A critical review of machine learning of energy materials, Adv. Energy Mater. 10(8), 1903242 (2020)
[55]
J. Wei, X. Chu, X. Y. Sun, K. Xu, H. X. Deng, J. Chen, Z. Wei, M. Lei. Machine learning in materials science. InfoMat, 2019, 1(3): 338
CrossRef ADS Google scholar
[56]
G. Pilania. Machine learning in materials science: From explainable predictions to autonomous design. Comput. Mater. Sci., 2021, 193: 110360
CrossRef ADS Google scholar
[57]
K. T. Butler, D. W. Davies, H. Cartwright, O. Isayev, A. Walsh. Machine learning for molecular and materials science. Nature, 2018, 559(7715): 547
CrossRef ADS Google scholar
[58]
F. Oviedo, J. L. Ferres, T. Buonassisi, K. T. Butler. Interpretable and explainable machine learning for materials science and chemistry. Acc. Mater. Res., 2022, 3(6): 597
CrossRef ADS Google scholar
[59]
J. F. Rodrigues Jr, M. C. F. Florea, D. de Oliveira, D. Diamond, O. N. Oliveira Jr. Big data and machine learning for materials science. Discover Materials, 2021, 1(1): 12
CrossRef ADS Google scholar
[60]
K. Choudhary, B. DeCost, C. Chen, A. Jain, F. Tavazza, R. Cohn, C. W. Park, A. Choudhary, A. Agrawal, S. J. L. Billinge, E. Holm, S. P. Ong, C. Wolverton. Recent advances and applications of deep learning methods in materials science. npj Comput. Mater., 2022, 8: 59
CrossRef ADS Google scholar
[61]
L. Samuel. Some studies in machine learning using the game of checkers. IBM J. Res. Develop., 1959, 3(3): 210
CrossRef ADS Google scholar
[62]
L.BreimanJ. H. FriedmanR.A. OlshenC.J. Stone, Classification and Regression Trees, 1983
[63]
L.G. Valiant, A theory of the learnable, in: STOC ’84 Proceedings of the Sixteenth Annual ACM Symposium on Theory of Computing, pp 436–445, 1984
[64]
T. Mitchell, Machine Learning, New York, USA: McGrawHill, 1997
[65]
S.RoweisZ. Ghahramani, A unifying review of linear gaussian models, Neural Comput. 11(2), 305 (1999)
[66]
J. C. Zheng, J. Y. Chen, J. W. Shuai, S. H. Cai, R. Z. Wang. Storage capacity of the Hopfield neural network. Physica A, 1997, 246(3): 313
CrossRef ADS Google scholar
[67]
J. W. Shuai, J. C. Zheng, Z. X. Chen, R. T. Liu, B. X. Wu. The three-dimensional rotation neural network. Physica A, 1997, 238): 23
CrossRef ADS Google scholar
[68]
M.MohriA. RostamizadehA.Talwalkar, Foundations of Machine Learning, 2nd Ed. , Adaptive Computation and Machine Learning. Cambridge, MA: MIT Press, 2018
[69]
A.VaswaniN. ShazeerN.ParmarJ.UszkoreitL.Jones A.N. GomezL. KaiserI.Polosukhin, Attention is all you need, arXiv: 1706.03762 (2017)
[70]
A.WangY. PruksachatkunN.NangiaA.SinghJ.Michael F.HillO. LevyS.R. Bowman, SuperGLUE: A stickier benchmark for general-purpose language understanding systems, arXiv: 1905.00537 (2019)
[71]
D. Erhan, Y. Bengio, A. Courville, P. A. Manzagol, P. Vincent, S. Bengio. Why does unsupervised pre-training help deep learning. J. Mach. Learn. Res., 2010, 11: 625
[72]
Z.FengD. GuoD.TangN.DuanX.Feng M.GongL. ShouB.QinT.LiuD.Jiang M.Zhou, CodeBERT: A pre-trained model for programming and natural languages, arXiv: 2002.08155 (2020)
[73]
H.BaoL. DongF.Wei, BEIT: BERT pre-training of image transformers, arXiv: 2106.08254 (2021)
[74]
K.HakhamaneshiM.NassarM.Phielipp P.AbbeelV. Stojanović, Pretraining graph neural networks for few-shot analog circuit modeling and design, arXiv: 2203.15913 (2022)
[75]
J.LiD.Li C.XiongS. Hoi, BLIP: Bootstrapping language-image pre-training for unified vision-language understanding and generation, arXiv: 2201.12086 (2022)
[76]
K.LuA.Grover P.AbbeelI. Mordatch, Pretrained transformers as universal computation engines, arXiv: 2103.05247 (2021)
[77]
M.ReidY. YamadaS.S. Gu, Can Wikipedia help offline reinforcement learning? arXiv: 2201.12122 (2022)
[78]
C.SunX. QiuY.XuX.Huang, How to fine-tune BERT for text classification? arXiv: 1905.05583 (2019)
[79]
H. Liu, D. Tam, M. Muqeeth, J. Mohta, T. Huang, M. Bansal, C. Raffel. Few-shot parameter-efficient fine-tuning is better and cheaper than in-context learning. Advances in Neural Information Processing Systems, 2022, 35: 1950
[80]
J.DevlinM. W. ChangK.LeeK.Toutanova, BERT: Pre-training of deep bidirectional transformers for language understanding, arXiv: 1810.04805 (2018)
[81]
Z.LanM. ChenS.GoodmanK.GimpelP.Sharma R.Soricut, ALBERT: A lite BERT for self-supervised learning of language representations, arXiv: 1909.11942 (2019)
[82]
Y.LiuM. OttN.GoyalJ.DuM.Joshi D.ChenO. LevyM.LewisL.ZettlemoyerV.Stoyanov, ROBERTA: A robustly optimized BERT pretraining approach, arXiv: 1907.11692 (2019)
[83]
J.VigY. Belinkov, Analyzing the structure of attention in a transformer language model, arXiv: 1906.04284 (2019)
[84]
S.ZhangL. Xie, Improving attention mechanism in graph neural networks via cardinality preservation, in: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, International Joint Conferences on Artificial Intelligence Organization, 2020, page 1395
[85]
Y. Tay, V. Q. Tran, M. Dehghani, J. Ni, D. Bahri, H. Mehta, Z. Qin, K. Hui, Z. Zhao, J. Gupta, T. Schuster, W. W. Cohen, D. Metzler. Transformer memory as a differentiable search index. Advances in Neural Information Processing Systems, 2022, 35: 21831
[86]
C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, P. J. Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res., 2020, 21(1): 5485
[87]
T.ShinY. RazeghiR.L. L. IVE.WallaceS.Singh, AutoPrompt: Eliciting knowledge from language models with automatically generated prompts, arXiv: 2010.15980 (2020)
[88]
N.DingS. HuW.ZhaoY.ChenZ.Liu H.-T. ZhengM. Sun, Openprompt: An open-source framework for prompt-learning, arXiv: 2111.01998 (2021)
[89]
S.ZhangS. RollerN.GoyalM.ArtetxeM.Chen S.ChenC. DewanM.DiabX.LiX.V. Lin T.MihaylovM. OttS.ShleiferK.ShusterD.Simig P.S. KouraA. SridharT.WangL.Zettlemoyer, OPT: Open pre-trained transformer language models, arXiv: 2205.01068 (2022)
[90]
O.LieberO. SharirB.LenzY.Shoham, Jurassic-1: Technical Details and Evaluation, AI21 Labs, Tech. Rep., 2021
[91]
T.BrownB. MannN.RyderM.SubbiahJ.D. Kaplan, ., Language models are few-shot learners, in: Advances in Neural Information Processing Systems, edited by H. Larochelle, M. Ranzato, R. Hadsell, M. Balcan, and H. Lin, 33 Curran Associates, Inc., 2020, pp 1877–1901, arXiv: 2005.14165
[92]
A.BapnaI. CaswellJ.KreutzerO.FiratD.van Esch, ., Building machine translation systems for the next thousand languages, arXiv: 2205.03983 (2022)
[93]
T.MikolovK. ChenG.CorradoJ.Dean, Efficient estimation of word representations in vector space, arXiv: 1301.3781 (2013)
[94]
J.PenningtonR.SocherC.Manning, GloVe: Global vectors for word representation, in: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha, Qatar: Association for Computational Linguistics, Oct. 2014, pp 1532–1543
[95]
O.MelamudJ. GoldbergerI.Dagan, Context2vec: Learning generic context embedding with bidirectional LSTM, in: Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning. Berlin, Germany: Association for Computational Linguistics, Aug. 2016, pp 51–61
[96]
H.DaiB. DaiL.Song, Discriminative embeddings of latent variable models for structured data, arXiv: 1603.05629 (2016)
[97]
J.YangR. ZhaoM.ZhuD.HallacJ.Sodnik J.Leskovec, Driver2vec: Driver identification from automotive data, arXiv: 2102.05234 (2021)
[98]
S.SchneiderA. BaevskiR.CollobertM.Auli, Wav2vec: Unsupervised pre-training for speech recognition, arXiv: 1904.05862 (2019)
[99]
H.ZhouS. ZhangJ.PengS.ZhangJ.Li H.XiongW. Zhang, Informer: Beyond efficient transformer for long sequence time-series forecasting, in: Proceedings of the AAAI Conference on Artificial Intelligence 35(12), 11106 (2021), arXiv: 2012.07436
[100]
I.BeltagyM. E. PetersA.Cohan, Longformer: The long-document transformer, arXiv: 2004.05150 (2020)
[101]
K.HanY. WangH.ChenX.ChenJ.Guo Z.LiuY. TangA.XiaoC.XuY.Xu Z.YangY. ZhangD.Tao, A survey on vision transformer, IEEE Trans. Pattern Anal. Mach. Intell. 45(1), 87 (2023)
[102]
J.B. AlayracJ.DonahueP.Luc A.MiechI. Barr, ., Flamingo: A visual language model for few-shot learning, Advances in Neural Information Processing Systems 35, 23716 (2022), arXiv: 2204.14198
[103]
J.YuZ.Wang V.VasudevanL. YeungM.SeyedhosseiniY.Wu, COCA: Contrastive captioners are image-text foundation models, arXiv: 2205.01917 (2022)
[104]
X.LiuC. GongL.WuS.ZhangH.Su Q.Liu, Fusedream: Training-free text-to-image generation with improved CLIP+GAN space optimization, arXiv: 2112.01573 (2021)
[105]
A.RadfordJ. W. KimC.HallacyA.RameshG.Goh S.AgarwalG. SastryA.AskellP.MishkinJ.Clark G.KruegerI. Sutskever, Learning transferable visual models from natural language supervision, arXiv: 2103.00020 (2021)
[106]
L.HeQ.Zhou X.LiL.Niu G.ChengX. LiW.LiuY.TongL.Ma L.Zhang, End-to-end video object detection with spatial-temporal transformers, in: Proceedings of the 29th ACM International Conference on Multimedia, 2021, pp 1507–1516, arXiv: 2105.10920
[107]
X.ZhaiX. WangB.MustafaA.SteinerD.Keysers A.KolesnikovL.Beyer, LIT: Zero-shot transfer with locked-image text tuning, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp 18123–18133, arXiv: 2111.07991
[108]
A.TrockmanJ. Z. Kolter, Patches are all you need? arXiv: 2201.09792 (2022)
[109]
A.RameshM. PavlovG.GohS.GrayC.Voss A.RadfordM. ChenI.Sutskever, Zeroshot text-to-image generation, in: International Conference on Machine Learning, 2021, pp 8821–8831, arXiv: 2102.12092
[110]
A.TewariJ. ThiesB.MildenhallP.SrinivasanE.Tretschk Y.WangC. LassnerV.SitzmannR.Martin-BruallaS. LombardiT.SimonC.TheobaltM.Niessner J.T. BarronG. WetzsteinM.ZollhoeferV.Golyanik, Advances in neural rendering, Computer Graphics Forum 41(2), 703 (2022), arXiv: 2111.05849
[111]
B.MildenhallP.P. SrinivasanM.Tancik J.T. BarronR. RamamoorthiR.Ng, NERF: Representing scenes as neural radiance fields for view synthesis, Communications of the ACM 65(1), 99 (2021), arXiv: 2003.08934
[112]
S.ZhengJ. PanC.LuG.Gupta, Pointnorm: Normalization is all you need for point cloud analysis, arXiv: 2207.06324 (2022)
[113]
H.RanJ. LiuC.Wang, Surface representation for point clouds, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp 18942–18952, arXiv: 2205.05740
[114]
X.MaC.Qin H.YouH. RanY.Fu, Rethinking network design and local geometry in point cloud: A simple residual MLP framework, arXiv: 2202.07123 (2022)
[115]
Y.WangY. SunZ.LiuS.E. SarmaM.M. BronsteinJ.M. Solomon, Dynamic graph CNN for learning on point clouds, arXiv: 1801.07829 (2018)
[116]
D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton, Y. Chen, T. Lillicrap, F. Hui, L. Sifre, G. van den Driessche, T. Graepel, D. Hassabis. Mastering the game of Go without human knowledge. Nature, 2017, 550(7676): 354
CrossRef ADS Google scholar
[117]
E.ZhaoR. YanJ.LiK.LiJ.Xing, Alphaholdem: High-performance artificial intelligence for heads-up no-limit poker via end-to-end reinforcement learning, in: Proceedings of the AAAI Conference on Artificial Intelligence 36(4), 4689 (2022)
[118]
S.ZouT. XuY.Liang, Finite-sample analysis for SARSA with linear function approximation, arXiv: 1902.02234 (2019)
[119]
C.J. C. H. WatkinsP.Dayan, Q-learning, Machine Learning 8(3), 279 (1992)
[120]
P.AbbeelA. Y. Ng, Apprenticeship learning via inverse reinforcement learning, in Proceedings of the Twenty-First International Conference on Machine Learning, Ser. ICML ’04. New York, NY, USA: Association for Computing Machinery, 2004
[121]
C.FinnP. AbbeelS.Levine, Model-agnostic meta-learning for fast adaptation of deep networks, In International conference on machine learning, 2017, pp 1126–1135, arXiv: 1703.03400
[122]
C.FiftyE. AmidZ.ZhaoT.YuR.Anil C.Finn, Efficiently identifying task groupings for multi-task learning, Advances in Neural Information Processing Systems 34, 27503 (2021), arXiv: 2109.04617
[123]
N.AnandD. Precup, Preferential temporal difference learning, arXiv: 2106.06508 (2021)
[124]
K.ChenR. CaoS.JamesY.LiY.H. Liu P.AbbeelQ. Dou, Sim-to-real 6d object pose estimation via iterative self-training for robotic bin-picking, in: Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XXXIX (pp 533−550). Cham: Springer Nature Switzerland, arXiv: 2204.07049
[125]
V.MnihK. KavukcuogluD.SilverA.GravesI.AntonoglouD.WierstraM.Riedmiller, Playing atari with deep reinforcement learning, arXiv: 1312.5602 (2013)
[126]
T.P. LillicrapJ.J. HuntA.Pritzel N.HeessT. ErezY.TassaD.SilverD.Wierstra, Continuous control with deep reinforcement learning, arXiv: 1509.02971 (2015)
[127]
D.YaratsD. BrandfonbrenerH.Liu M.LaskinP. AbbeelA.LazaricL.Pinto, Don’t change the algorithm, change the data: Exploratory data for offline reinforcement learning, arXiv: 2201.13425 (2022)
[128]
M.AhnA. BrohanN.BrownY.ChebotarO.Cortes, ., Do as I can, not as I say: Grounding language in robotic affordances, in: Conference on Robot Learning, 2023, pp 287–318, arXiv: 2204.01691
[129]
S.JamesP. Abbeel, Coarse-to-fine Q-attention with learned path ranking, arXiv: 2204.01571 (2022)
[130]
C.QiP.Abbeel A.Grover, Imitating, fast and slow: Robust learning from demonstrations via decision-time planning, arXiv: 2204.03597 (2022)
[131]
L.WangX. ZhangK.YangL.YuC.Li L.HongS. ZhangZ.LiY.ZhongJ.Zhu, Memory replay with data compression for continual learning, arXiv: 2202.06592 (2022)
[132]
L.ChenK. LuA.RajeswaranK.LeeA.Grover M.LaskinP. AbbeelA.SrinivasI.Mordatch, Decision transformer: Reinforcement learning via sequence modeling, Advances in Neural Information Processing Systems 34, 15084 (2021), arXiv: 2106.01345
[133]
J.Parker-HolderM.JiangM.Dennis M.SamvelyanJ. FoersterE.GrefenstetteT.Rocktäschel, Evolving curricula with regret-based environment design, in: International Conference on Machine Learning, 2022, pp 17473–17498, arXiv: 2203.01302
[134]
R. Wang, J. Lehman, J. Clune, and K. O. Stanley, Paired open-ended trailblazer (POET): Endlessly generating increasingly complex and diverse learning environments and their solutions, arXiv: 1901.01753 (2019)
[135]
Z.LiL.Li Z.MaP.Zhang J.ChenJ. Zhu, Read: Large-scale neural scene rendering for autonomous driving, arXiv: 2205.05509 (2022)
[136]
W.TangC. J. HoY.Liu, Bandit learning with delayed impact of actions, in: Advances in Neural Information Processing Systems, edited by A. Beygelzimer, Y. Dauphin, P. Liang, and J. W. Vaughan, 2021, arXiv: 1904.01763
[137]
Z.GaoY. HanZ.RenZ.Zhou, Batched multi-armed bandits problem, in: Advances in Neural Information Processing Systems, edited by H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett, Curran Associates, Inc., 2019, arXiv: 1904.01763
[138]
Y. Yue, J. Broder, R. Kleinberg, T. Joachims. The k-armed dueling bandits problem. J. Comput. Syst. Sci., 2012, 78(5): 1538
CrossRef ADS Google scholar
[139]
A.CarpentierA.LazaricM.GhavamzadehR.MunosP.AuerA.Antos, Upperconfidence-bound algorithms for active learning in multi-armed bandits, in: Algorithmic Learning Theory: 22nd International Conference, ALT 2011, Espoo, Finland, October 5−7, 2011. Proceedings 22 (pp 189–203), Springer Berlin Heidelberg, arXiv: 1507.04523
[140]
W.YeS.Liu T.KurutachP. AbbeelY.Gao, Mastering Atari games with limited data, Advances in Neural Information Processing Systems 34, 25476 (2021), arXiv: 2111.00210
[141]
M.SamvelyanT. RashidC.Schroeder de WittG.FarquharN.Nardelli T.G. J. RudnerC.M. HungP.H. S. TorrJ.FoersterS.Whiteson, The StarCraft multi-agent challenge, in: Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, 2019, arXiv: 1902.04043
[142]
T.WangT. GuptaA.MahajanB.PengS.Whiteson C.Zhang, Rode: Learning roles to decompose multi-agent tasks, arXiv: 2010.01523 (2020)
[143]
O. Vinyals, I. Babuschkin, W. M. Czarnecki, M. Mathieu, A. Dudzik. . Grandmaster level in StarCraft II using multi-agent reinforcement learning. Nature, 2019, 575(7782): 350
CrossRef ADS Google scholar
[144]
W.DuS.Ding, A survey on multi-agent deep reinforcement learning: From the perspective of challenges and applications, Artif. Intell. Rev. 54(5), 3215 (2021)
[145]
J. Biamonte, P. Wittek, N. Pancotti, P. Rebentrost, N. Wiebe, S. Lloyd. Quantum machine learning. Nature, 2017, 549: 195
CrossRef ADS Google scholar
[146]
Y.LiuS. ArunachalamK.Temme, A rigorous and robust quantum speed-up in supervised machine learning, Nat. Phys. 17(9), 1013 (2021)
[147]
V. Havlíček, A. D. Córcoles, K. Temme, A. W. Harrow, A. Kandala, J. M. Chow, J. M. Gambetta. Supervised learning with quantum-enhanced feature spaces. Nature, 2019, 567(7747): 209
CrossRef ADS Google scholar
[148]
S. Moradi, C. Brandner, C. Spielvogel, D. Krajnc, S. Hillmich, R. Wille, W. Drexler, L. Papp. Clinical data classification with noisy intermediate scale quantum computers. Sci. Rep., 2022, 12(1): 1851
CrossRef ADS Google scholar
[149]
J.ZhengK. HeJ.ZhouY.JinC.M. Li, Combining reinforcement learning with lin-kernighan-helsgaun algorithm for the traveling salesman problem, in: Proceedings of the AAAI Conference on Artificial Intelligence 35(14), 12445 (2021), arXiv: 2012.04461
[150]
Z.LiQ.Chen V.Koltun, Combinatorial optimization with graph convolutional networks and guided tree search, Advances in Neural Information Processing Systems 31, 2018, arXiv: 1810.10659
[151]
M.SundararajanA.TalyQ.Yan, Axiomatic attribution for deep networks, in: International Conference on Machine Learning, 2017, pp 3319–3328, arXiv: 1703.01365
[152]
M.T. RibeiroS.SinghC.Guestrin, Why Should I Trust You? Explaining the predictions of any classifier, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, pp 1135−1144, arXiv: 1602.04938
[153]
S.LundbergS. I. Lee, A unified approach to interpreting model predictions, arXiv: 1705.07874 (2017)
[154]
J.CrabbeZ. QianF.ImrieM.van der Schaar, Explaining latent representations with a corpus of examples, in: Advances in Neural Information Processing Systems, edited by M. Ranzato, A. Beygelzimer, Y. Dauphin, P. Liang, and J. W. Vaughan, Curran Associates, Inc., 2021, pp 12154–12166, arXiv: 2110.15355
[155]
J.T. SpringenbergA.DosovitskiyT.Brox M.Riedmiller, Striving for simplicity: The all convolutional net, arXiv: 1412.6806 (2014)
[156]
R.YingD. BourgeoisJ.YouM.ZitnikJ.Leskovec, Gnnexplainer: Generating explanations for graph neural networks, arXiv: 1903.03894 (2019)
[157]
H.YuanH. YuJ.WangK.LiS.Ji, On explainability of graph neural networks via subgraph explorations, in: International Conference on Machine Learning, 2021, pp 12241–12252, arXiv: 2102.05152
[158]
Q.HuangM. YamadaY.TianD.SinghD.Yin Y.Chang, GraphLIME: Local interpretable model explanations for graph neural networks, IEEE Transactions on Knowledge and Data Engineering, 35(7), 6968 (2023), arXiv: 2001.06216
[159]
H.YuanH. YuS.GuiS.Ji, Explainability in graph neural networks: A taxonomic survey, IEEE Transactions on Pattern Analysis and Machine Intelligence 45(5), 5782 (2023), arXiv: 2012.15445
[160]
G.KatzC. BarrettD.DillK.JulianM.Kochenderfer, ReLUPlex: An efficient smt solver for verifying deep neural networks, in: Computer Aided Verification: 29th International Conference, CAV 2017, Heidelberg, Germany, July 24−28, 2017, Proceedings, Part I 30, pp 97−117. Springer International Publishing, arXiv: 1702.01135
[161]
S.WangH. ZhangK.XuX.LinS.Jana C.J. HsiehJ. Z. Kolter, Beta-CROWN: Efficient bound propagation with per-neuron split constraints for complete and incomplete neural network verification, Advances in Neural Information Processing Systems 34, 2021, arXiv: 2103.06624
[162]
M.P. OwenA. PankenR.MossL.AlvarezC.Leeper, ACAS Xu: Integrated collision avoidance and detect and avoid capability for UAS, in: IEEE/AIAA 38th Digital Avionics Systems Conference (DASC), 2019
[163]
S.MittalS. Vaishay, A survey of techniques for optimizing deep learning on GPUS, J. Systems Archit. 99, 101635 (2019)
[164]
F. Wang, W. Zhang, S. Lai, M. Hao, Z. Wang. Dynamic GPU energy optimization for machine learning training workloads. IEEE Transactions on Parallel and Distributed Systems, 2022, 33(11): 2943
CrossRef ADS Google scholar
[165]
R.DavidJ. DukeA.JainV.Janapa ReddiN.Jeffries J.LiN.Kreeger I.NappierM. NatrajT.WangP.WardenR.Rhodes, Tensorflow lite micro: Embedded machine learning for tinyML systems, in: Proceedings of Machine Learning and Systems, edited by A. Smola, A. Dimakis, and I. Stoica, 2021, pp 800–811, arXiv: 2010.08678
[166]
C.TanasescuV. KesarwaniD.Inkpen, Metaphor detection by deep learning and the place of poetic metaphor in digital humanities, in: The Thirty-First International Flairs Conference, 2018
[167]
H.Surden, Machine learning and law, Wash. L. Rev. 89, 87 (2014)
[168]
J.De SpiegeleerD.B. MadanS.Reyners W.Schoutens, Machine learning for quantitative finance: Fast derivative pricing, hedging and fitting, Quantitative Finance 18(10), 1635–1643, 2018
[169]
W. Solano-Alvarez, M. Peet, E. Pickering, J. Jaiswal, A. Bevan, H. Bhadeshia. Synchrotron and neural network analysis of the influence of composition and heat treatment on the rolling contact fatigue of hypereutectoid pearlitic steels. Materials Science and Engineering A, 2017, 707: 259
CrossRef ADS Google scholar
[170]
J. J. Li, Y. Dai, J. C. Zheng. Strain engineering of ion migration in LiCoO2. Front. Phys., 2022, 17(1): 13503
CrossRef ADS Google scholar
[171]
H. K. D. H. Bhadeshia. Neural networks and information in materials science. Statistical Analysis and Data Mining, 2009, 1: 296
CrossRef ADS Google scholar
[172]
Y. Liu, O. C. Esan, Z. Pan, L. An. Machine learning for advanced energy materials. Energy and AI, 2021, 3: 100049
CrossRef ADS Google scholar
[173]
S. R. Kalidindi. Feature engineering of material structure for AI-based materials knowledge systems. J. Appl. Phys., 2020, 128(4): 041103
CrossRef ADS Google scholar
[174]
Z.XiangM. FanG.Vázquez Tovar W.TrehengekrnB.J. YoonX.Qian R.ArroyaveX. Qian, Physics-constrained automatic feature engineering for predictive modeling in materials science, in: Proceedings of the AAAI Conference on Artificial Intelligence 35(12), pp 10414–10421 (2021)
[175]
Y. Bengio, A. Courville, P. Vincent. Representation learning: A review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell., 2013, 35(8): 1798
CrossRef ADS Google scholar
[176]
P. K. Routh, Y. Liu, N. Marcella, B. Kozinsky, A. I. Frenkel. Latent representation learning for structural characterization of catalyst. J. Phys. Chem. Lett., 2021, 12(8): 2086
CrossRef ADS Google scholar
[177]
A. Franceschetti, A. Zunger. The inverse band-structure problem of finding an atomic configuration with given electronic properties. Nature, 1999, 402(6757): 6757
CrossRef ADS Google scholar
[178]
Z. Liu, D. Zhu, L. Raju, W. Cai. Tackling photonic inverse design with machine learning. Adv. Sci., 2021, 8: 2002923
CrossRef ADS Google scholar
[179]
J. E. Saal, S. Kirklin, M. Aykol, B. Meredig, C. Wolverton. Materials design and discovery with high-throughput density functional theory: The open quantum materials database (OQMD). JOM, 2013, 65(11): 1501
CrossRef ADS Google scholar
[180]
S. Kirklin, J. E. Saal, B. Meredig, A. Thompson, J. W. Doak, M. Aykol, S. Rühl, C. Wolverton. The open quantum materials database (OQMD): Assessing the accuracy of DFT formation energies. npj Comput. Mater., 2015, 1(1): 15010
CrossRef ADS Google scholar
[181]
A.JainS. P. OngG.HautierW.ChenW.D. RichardsS.DacekS.CholiaD.Gunter D.SkinnerG. CederK.Persson, The materials project: A materials genome approach to accelerating materials innovation, APL Mater. 1(1), 011002 (2013)
[182]
K. Choudhary, K. F. Garrity, A. C. E. Reid, B. DeCost, A. J. Biacchi. . The joint automated repository for various integrated simulations (JARVIS) for data-driven materials design. npj Comput. Mater., 2020, 6(1): 173
CrossRef ADS Google scholar
[183]
AFLOW, URL: aflowlib.org
[184]
MatCloud, URL: matcloud.com.cn
[185]
MPDS, Pauling File, URL: mpds.io
[186]
NOMAD, URL: nomad-lab.eu
[187]
C2DB, URL: cmr.fysik.dtu.dk/c2db/c2db.html
[188]
J.ZhouL. ShenM.D. CostaK.A. PerssonS.P. Ong P.HuckY. LuX.MaY.ChenH.Tang Y.P. Feng, 2dmatpedia, an open computational database of two-dimensional materials from top-down and bottom-up approaches, Scientific Data 6, 86, June 2019
[189]
M. Hellenbrandt. The inorganic crystal structure database (ICSD) — Present and future. Crystallography Rev., 2004, 10(1): 17
CrossRef ADS Google scholar
[190]
S. Gražulis, A. Daškevič, A. Merkys, D. Chateigner, L. Lutterotti, M. Quirós, N. R. Serebryanaya, P. Moeck, R. T. Downs, A. Le Bail. Crystallography Open Database (COD): An open-access collection of crystal structures and platform for world-wide collaboration. Nucleic Acids Research, 2011, 40(D1): D420
CrossRef ADS Google scholar
[191]
J. C. Zheng, L. Wu, Y. Zhu. Aspherical electron scattering factors and their parameterizations for elements from H to Xe. Journal of Applied Crystallography, 2009, 42: 1043
CrossRef ADS Google scholar
[192]
J.JumperR. EvansA.PritzelT.GreenM.Figurnov, ., Highly accurate protein structure prediction with alphafold, Nature 596(7873), 583 (2021)
[193]
A.DunnQ. WangA.GanoseD.DoppA.Jain, Benchmarking materials property prediction methods: The matbench test set and automatminer reference algorithm, npj Comput. Mater. 6(1), 138 (2020)
[194]
R. Lin, R. Zhang, C. Wang, X. Q. Yang, H. L. Xin. Temimagenet training library and atomsegnet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images. Sci. Rep., 2021, 11(1): 5386
CrossRef ADS Google scholar
[195]
L. Han, H. Cheng, W. Liu, H. Li, P. Ou, R. Lin, H.-T. Wang, C.-W. Pao, A. R. Head, C.-H. Wang, X. Tong, C.-J. Sun, W.-F. Pong, J. Luo, J.-C. Zheng, H. L. Xin. A single-atom library for guided monometallic and concentration-complex multimetallic designs. Nat. Mater., 2022, 21: 681
CrossRef ADS Google scholar
[196]
D. Mrdjenovich, M. K. Horton, J. H. Montoya, C. M. Legaspi, S. Dwaraknath, V. Tshitoyan, A. Jain, K. A. Persson. Propnet: A knowledge graph for materials science. Matter, 2020, 2(2): 464
CrossRef ADS Google scholar
[197]
T. S. Lin, C. W. Coley, H. Mochigase, H. K. Beech, W. Wang, Z. Wang, E. Woods, S. L. Craig, J. A. Johnson, J. A. Kalow, K. F. Jensen, B. D. Olsen. Bigsmiles: A structurally-based line notation for describing macromolecules. ACS Cent. Sci., 2019, 5(9): 1523
CrossRef ADS Google scholar
[198]
M. Krenn, Q. Ai, S. Barthel, N. Carson, A. Frei. . Selfies and the future of molecular string representations. Patterns, 2022, 3(10): 100588
CrossRef ADS Google scholar
[199]
K. Michel, B. Meredig. Beyond bulk single crystals: A data format for all materials structure–property–processing relationships. MRS Bull., 2016, 41(8): 617
CrossRef ADS Google scholar
[200]
M.WangD. ZhengZ.YeQ.GanM.Li X.SongJ. ZhouC.MaL.YuY.Gai T.XiaoT. HeG.KarypisJ.LiZ.Zhang, Deep graph library: A graph-centric, highly-performant package for graph neural networks, arXiv: 1909.01315 (2019)
[201]
I.BabuschkinK.BaumliA.Bell S.BhupatirajuJ.Bruce, ., The DeepMind JAX Ecosystem, 2020
[202]
F.Chollet, ., Keras, URL: github.com/fchollet/keras (2015)
[203]
A.PaszkeS. GrossS.ChintalaG.ChananE.Yang Z.DeVitoZ. LinA.DesmaisonL.AntigaA.Lerer, Automatic differentiation in PYTORCH, 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 2017
[204]
M.AbadiA. AgarwalP.BarhamE.BrevdoZ.Chen, ., TensorFlow: Large-scale machine learning on heterogeneous systems, 2015, URL: www.tensorflow.org
[205]
T.WolfL. DebutV.SanhJ.ChaumondC.Delangue A.MoiP. CistacT.RaultR.LoufM.FuntowiczJ.DavisonS.Shleifer)vonPlaten C.MaY.Jernite J.PluC. XuT.L. ScaoS.GuggerM.Drame Q.LhoestA. M. Rush, Huggingface’s transformers: State-of-the-art natural language processing, arXiv: 1910.03771 (2019)
[206]
Openrefine: A free, open source, powerful tool for working with messy data, URL: openrefine.org, 2022
[207]
PyG-Team, PYG documentation, URL: pytorch-geometric.readthedocs.io/en/latest/, 2022
[208]
PytorchLightning, URL: www.pytorchlightning.ai
[209]
GitHub - Netflix/vectorflow, URL: github.com/Netflix/vectorflow, 2022
[210]
L. Biewald, Experiment tracking with weights and biases, URL: www.wandb.com, 2020
[211]
L. Himanen, M. O. Jäger, E. V. Morooka, F. F. Canova, Y. S. Ranawat, D. Z. Gao, P. Rinke, A. S. Foster. Dscribe: Library of descriptors for machine learning in materials science. Comput. Phys. Commun., 2020, 247: 106949
CrossRef ADS Google scholar
[212]
W.HuM.Fey M.ZitnikY. DongH.RenB.LiuM.Catasta J.Leskovec, Open graph benchmark: Datasets for machine learning on graphs, Advances in neural information processing systems 33, 22118 (2020), arXiv: 2005.00687
[213]
O. Source, Rdkit: Open-source cheminformatics software, URL: www.rdkit.org, 2022
[214]
D. Grattarola, Spektral, URL: graphneural.network, 2022
[215]
S.LiY.Liu D.ChenY. JiangZ.NieF.Pan, Encoding the atomic structure for machine learning in materials science, Wiley Interdiscip. Rev. Comput. Mol. Sci. 12(1) (2022)
[216]
J. Schmidt, M. R. G. Marques, S. Botti, M. A. L. Marques. Recent advances and applications of machine learning in solid-state materials science. npj Comput. Mater., 2019, 5(1): 83
CrossRef ADS Google scholar
[217]
M. Rupp, A. Tkatchenko, K. R. Müller, O. A. von Lilienfeld. Fast and accurate modeling of molecular atomization energies with machine learning. Phys. Rev. Lett., 2012, 108(5): 058301
CrossRef ADS Google scholar
[218]
J. Schrier. Can one hear the shape of a molecule (from its Coulomb matrix eigenvalues). J. Chem. Inf. Model., 2020, 60(8): 3804
CrossRef ADS Google scholar
[219]
M. McCarthy, K. L. K. Lee. Molecule identification with rotational spectroscopy and probabilistic deep learning. J. Phys. Chem. A, 2020, 124(15): 3002
CrossRef ADS Google scholar
[220]
F. Faber, A. Lindmaa, O. A. von Lilienfeld, R. Armiento. Crystal structure representations for machine learning models of formation energies. Int. J. Quantum Chem., 2015, 115(16): 1094
CrossRef ADS Google scholar
[221]
K. T. Schütt, H. Glawe, F. Brockherde, A. Sanna, K. R. Müller, E. K. U. Gross. How to represent crystal structures for machine learning: Towards fast prediction of electronic properties. Phys. Rev. B, 2014, 89(20): 205118
CrossRef ADS Google scholar
[222]
J. Behler, M. Parrinello. Generalized neural-network representation of high-dimensional potential-energy surfaces. Phys. Rev. Lett., 2007, 98(14): 146401
CrossRef ADS Google scholar
[223]
J. Behler. Atom-centered symmetry functions for constructing high-dimensional neural network potentials. J. Chem. Phys., 2011, 134(7): 074106
CrossRef ADS Google scholar
[224]
A. Seko, A. Takahashi, I. Tanaka. Sparse representation for a potential energy surface. Phys. Rev. B, 2014, 90(2): 024101
CrossRef ADS Google scholar
[225]
M.GasteggerL. SchwiedrzikM.BittermannF.BerzsenyiP.Marquetand, WACSF — Weighted atom-centered symmetry functions as descriptors in machine learning potentials, J. Chem. Phys. 148(24), 241709 (2018)
[226]
A. P. Bartók, R. Kondor, G. Csányi. On representing chemical environments. Phys. Rev. B, 2013, 87(18): 184115
CrossRef ADS Google scholar
[227]
C. W. Rosenbrock, E. R. Homer, G. Csányi, G. L. W. Hart. Discovering the building blocks of atomic systems using machine learning: Application to grain boundaries. npj Comput. Mater., 2017, 3: 29
CrossRef ADS Google scholar
[228]
F. M. Paruzzo, A. Hofstetter, F. Musil, S. De, M. Ceriotti, L. Emsley. Chemical shifts in molecular solids by machine learning. Nat. Commun., 2018, 9(1): 4501
CrossRef ADS Google scholar
[229]
A. S. Rosen, S. M. Iyer, D. Ray, Z. Yao, A. Aspuru-Guzik, L. Gagliardi, J. M. Notestein, R. Q. Snurr. Machine learning the quantum-chemical properties of metal–organic frameworks for accelerated materials discovery. Matter, 2021, 4(5): 1578
CrossRef ADS Google scholar
[230]
Z. Fan, Z. Zeng, C. Zhang, Y. Wang, K. Song, H. Dong, Y. Chen, T. Ala-Nissila. Neuroevolution machine learning potentials: Combining high accuracy and low cost in atomistic simulations and application to heat transport. Phys. Rev. B, 2021, 104(10): 104309
CrossRef ADS Google scholar
[231]
Z.MihalićN.Trinajstić, A graph-theoretical approach to structure-property relationships, J. Chem. Educ. 69(9), 701 (1992)
[232]
O. Isayev, C. Oses, C. Toher, E. Gossett, S. Curtarolo, A. Tropsha. Universal fragment descriptors for predicting properties of inorganic crystals. Nat. Commun., 2017, 8(1): 15679
CrossRef ADS Google scholar
[233]
T. Xie, J. C. Grossman. Crystal graph convolutional neural networks for an accurate and interpretable prediction of material properties. Phys. Rev. Lett., 2018, 120(14): 145301
CrossRef ADS Google scholar
[234]
K. Xia, G. W. Wei. Persistent homology analysis of protein structure, flexibility and folding. Int. J. Numer. Methods Biomed. Eng., 2014, 30(8): 814
CrossRef ADS Google scholar
[235]
Z.CangL. MuK.WuK.OpronK.Xia G.W. Wei, A topological approach for protein classification, Comput. Math. Biophys. 3(1) (2015)
[236]
Y. Jiang, D. Chen, X. Chen, T. Li, G.-W. Wei, F. Pan. Topological representations of crystalline compounds for the machine-learning prediction of materials properties. npj Comput. Mater., 2021, 7: 28
CrossRef ADS Google scholar
[237]
E. Minamitani, T. Shiga, M. Kashiwagi, I. Obayashi. Topological descriptor of thermal conductivity in amorphous Si. J. Chem. Phys., 2022, 156(24): 244502
CrossRef ADS Google scholar
[238]
M. E. Aktas, E. Akbas, A. E. Fatmaoui. Persistence homology of networks: Methods and applications. Appl. Netw. Sci., 2019, 4(1): 1
CrossRef ADS Google scholar
[239]
A. Ziletti, D. Kumar, M. Scheffler, L. M. Ghiringhelli. Insightful classification of crystal structures using deep learning. Nat. Commun., 2018, 9(1): 2775
CrossRef ADS Google scholar
[240]
W. B. Park, J. Chung, J. Jung, K. Sohn, S. P. Singh, M. Pyo, N. Shin, K. S. Sohn. Classification of crystal structure using a convolutional neural network. IUCrJ, 2017, 4(4): 486
CrossRef ADS Google scholar
[241]
Y. Zhang, X. He, Z. Chen, Q. Bai, A. M. Nolan, C. A. Roberts, D. Banerjee, T. Matsunaga, Y. Mo, C. Ling. Unsupervised discovery of solid-state lithium ion conductors. Nat. Commun., 2019, 10(1): 5260
CrossRef ADS Google scholar
[242]
S. C. Sieg, C. Suh, T. Schmidt, M. Stukowski, K. Rajan, W. F. Maier. Principal component analysis of catalytic functions in the composition space of heterogeneous catalysts. QSAR Comb. Sci., 2007, 26(4): 528
CrossRef ADS Google scholar
[243]
R. Tranås, O. M. Løvvik, O. Tomic, K. Berland. Lattice thermal conductivity of half-Heuslers with density functional theory and machine learning: Enhancing predictivity by active sampling with principal component analysis. Comput. Mater. Sci., 2022, 202: 110938
CrossRef ADS Google scholar
[244]
L. M. Ghiringhelli, J. Vybiral, E. Ahmetcik, R. Ouyang, S. V. Levchenko, C. Draxl, M. Scheffler. Learning physical descriptors for materials science by compressed sensing. New J. Phys., 2017, 19(2): 023017
CrossRef ADS Google scholar
[245]
R.OuyangS. CurtaroloE.AhmetcikM.SchefflerL.M. Ghiringhelli, SISSO: A compressed-sensing method for identifying the best low-dimensional descriptor in an immensity of offered candidates, Phys. Rev. Mater. 2, 083802 (2018)
[246]
W. C. Lu, X. B. Ji, M. J. Li, L. Liu, B. H. Yue, L. M. Zhang. Using support vector machine for materials design. Adv. Manuf., 2013, 1(2): 151
CrossRef ADS Google scholar
[247]
Y. Wu, N. Prezhdo, W. Chu. Increasing efficiency of nonadiabatic molecular dynamics by Hamiltonian interpolation with kernel ridge regression. J. Phys. Chem. A, 2021, 125(41): 9191
CrossRef ADS Google scholar
[248]
T.HastieR. TibshiraniJ.H. Friedman, The elements of statistical learning: Data mining, inference, and prediction, 2nd Ed., in: Springer series in statistics, NY: Springer, 2009
[249]
K.HeX.Zhang S.RenJ. Sun, Deep residual learning for image recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp 770–778
[250]
O. T. Unke, S. Chmiela, M. Gastegger, K. T. Schütt, H. E. Sauceda, K.-R. Müller. Spookynet: Learning force fields with electronic degrees of freedom and nonlocal effects. Nat. Commun., 2021, 12: 7273
CrossRef ADS Google scholar
[251]
C. Zheng, C. Chen, Y. Chen, S. P. Ong. Random forest models for accurate identification of coordination environments from X-ray absorption near-edge structure. Patterns, 2020, 1(2): 100013
CrossRef ADS Google scholar
[252]
J. J. Kranz, M. Kubillus, R. Ramakrishnan, O. A. von Lilienfeld, M. Elstner. Generalized density-functional tight-binding repulsive potentials from unsupervised machine learning. J. Chem. Theory Comput., 2018, 14(5): 2341
CrossRef ADS Google scholar
[253]
S. Kim, J. Noh, G. H. Gu, A. Aspuru-Guzik, Y. Jung. Generative adversarial networks for crystal structure prediction. ACS Cent. Sci., 2020, 6(8): 1412
CrossRef ADS Google scholar
[254]
J. Noh, J. Kim, H. S. Stein, B. Sanchez-Lengeling, J. M. Gregoire, A. Aspuru-Guzik, Y. Jung. Inverse design of solid-state materials via a continuous representation. Matter, 2019, 1(5): 1370
CrossRef ADS Google scholar
[255]
M.L. HutchinsonE.AntonoB.M. GibbonsS.ParadisoJ.LingB.Meredig, Overcoming data scarcity with transfer learning, arXiv: 1711.05099 (2017)
[256]
R. Chang, Y.-X. Wang, E. Ertekin. Towards overcoming data scarcity in materials science: Unifying models and datasets with a mixture of experts framework. npj Comput. Mater., 2022, 8: 242
CrossRef ADS Google scholar
[257]
M.A. Nielsen, Neural Networks and Deep Learning, Determination Press, 2015
[258]
A. Akbari, L. Ng, B. Solnik. Drivers of economic and financial integration: A machine learning approach. J. Empir. Finance, 2021, 61: 82
CrossRef ADS Google scholar
[259]
L. Weng, Flow-based deep generative models, URL: lilianweng.github.io, 2018
[260]
P. Raccuglia, K. C. Elbert, P. D. F. Adler, C. Falk, M. B. Wenny, A. Mollo, M. Zeller, S. A. Friedler, J. Schrier, A. J. Norquist. Machine-learning-assisted materials discovery using failed experiments. Nature, 2016, 533(7601): 73
CrossRef ADS Google scholar
[261]
A. O. Oliynyk, L. A. Adutwum, J. J. Harynuk, A. Mar. Classifying crystal structures of binary compounds AB through cluster resolution feature selection and support vector machine analysis. Chem. Mater., 2016, 28(18): 6672
CrossRef ADS Google scholar
[262]
J.TangQ. CaiY.Liu, Prediction of material mechanical properties with support vector machine, in: 2010 International Conference on Machine Vision and Human-machine Interface, Aprl 2010, pp 592–595
[263]
D. C. Elton, Z. Boukouvalas, M. S. Butrico, M. D. Fuge, P. W. Chung. Applying machine learning techniques to predict the properties of energetic materials. Sci. Rep., 2018, 8(1): 9059
CrossRef ADS Google scholar
[264]
D. Hu, Y. Xie, X. Li, L. Li, Z. Lan. Inclusion of machine learning kernel ridge regression potential energy surfaces in on-the-fly nonadiabatic molecular dynamics simulation. J. Phys. Chem. Lett., 2018, 9(11): 2725
CrossRef ADS Google scholar
[265]
K. T. Schütt, F. Arbabzadah, S. Chmiela, K. R. Müller, A. Tkatchenko. Quantum-chemical insights from deep tensor neural networks. Nat. Commun., 2017, 8(1): 13890
CrossRef ADS Google scholar
[266]
D. Jha, L. Ward, A. Paul, W.-K. Liao, A. Choudhary, C. Wolverton, A. Agrawal. Elemnet: Deep learning the chemistry of materials from only elemental composition. Sci. Rep., 2018, 8: 17593
CrossRef ADS Google scholar
[267]
D.JhaL. WardZ.YangC.WolvertonI.Foster W.K. LiaoA. ChoudharyA.Agrawal, IRNet: A general purpose deep residual regression framework for materials discovery, in: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp 2385–2393, 2019
[268]
O. T. Unke, M. Meuwly. Physnet: A neural network for predicting energies, forces, dipole moments, and partial charges. J. Chem. Theo. Comput., 2019, 15(6): 3678
CrossRef ADS Google scholar
[269]
Z. Liu, L. Lin, Q. Jia, Z. Cheng, Y. Jiang, Y. Guo, J. Ma. Transferable multilevel attention neural network for accurate prediction of quantum chemistry properties via multitask learning. J. Chem. Inform. Model., 2021, 61(3): 1066
CrossRef ADS Google scholar
[270]
A. M. Krajewski, J. W. Siegel, J. Xu, Z. K. Liu. Extensible structure-informed prediction of formation energy with improved accuracy and usability employing neural networks. Comput. Mater. Sci., 2022, 208: 111254
CrossRef ADS Google scholar
[271]
K.T. SchüttP.J. KindermansH.E. SaucedaS.ChmielaA.TkatchenkoK.R. Müller, SchNet: A continuous-filter convolutional neural network for modeling quantum interactions, in Proceedings of the 31st International Conference on Neural Information Processing Systems, in NIPS’17. Red Hook, NY, USA: Curran Associates Inc., Dec. 2017, pp 992–1002
[272]
J. Jung. . Super-resolving material microstructure image via deep learning for microstructure characterization and mechanical behavior analysis. npj Comput. Mater., 2021, 7: 96
CrossRef ADS Google scholar
[273]
A. A. K. Farizhandi, O. Betancourt, M. Mamivand. Deep learning approach for chemistry and processing history prediction from materials microstructure. Sci. Rep., 2022, 12(1): 4552
CrossRef ADS Google scholar
[274]
T. Xie, J. C. Grossman. Crystal graph convolutional neural networks for an accurate and interpretable prediction of material properties. Phys. Rev. Lett., 2018, 120(14): 145301
CrossRef ADS Google scholar
[275]
C. Chen, W. Ye, Y. Zuo, C. Zheng, S. P. Ong. Graph networks as a universal machine learning framework for molecules and crystals. Chem. Mater., 2019, 31(9): 3564
CrossRef ADS Google scholar
[276]
S. Y. Louis, Y. Zhao, A. Nasiri, X. Wang, Y. Song, F. Liu, J. Hu. Graph convolutional neural networks with global attention for improved materials property prediction. Phys. Chem. Chem. Phys., 2020, 22(32): 18141
CrossRef ADS Google scholar
[277]
Z. Qiao, M. Welborn, A. Anandkumar, F. R. Manby, T. F. Miller. OrbNet: Deep learning for quantum chemistry using symmetry-adapted atomic-orbital features. J. Chem. Phys., 2020, 153(12): 124111
CrossRef ADS Google scholar
[278]
J.GasteigerJ. GroßS.Günnemann, Directional message passing for molecular graphs, arXiv: 2003.03123 (2020)
[279]
K. Choudhary, B. DeCost. Atomistic line graph neural network for improved materials property predictions. npj Comput. Mater., 2021, 7(1): 185
CrossRef ADS Google scholar
[280]
S.ZhangY. LiuL.Xie, Molecular mechanics-driven graph neural network with multiplex graph for molecular structures, arXiv: 2011.07457 (2020)
[281]
M. Ghorbani, S. Prasad, J. B. Klauda, B. R. Brooks. GraphVAMPNet, using graph neural networks and variational approach to Markov processes for dynamical modeling of biomolecules. J. Chem. Phys., 2022, 156(18): 184103
CrossRef ADS Google scholar
[282]
T. Xie, A. France-Lanord, Y. Wang, Y. Shao-Horn, J. C. Grossman. Graph dynamical networks for unsupervised learning of atomic scale dynamics in materials. Nat. Commun., 2019, 10(1): 2667
CrossRef ADS Google scholar
[283]
S.BatznerA. MusaelianL.SunM.GeigerJ.P. MailoaM.KornbluthN.MolinariT.E. Smidt B.Kozinsky, E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials, Nat. Commun. 13, 2453 (2022)
[284]
K.T. SchüttO.T. UnkeM.Gastegger, Equivariant message passing for the prediction of tensorial properties and molecular spectra, in: International Conference on Machine Learning, pp 9377–9388, 2021
[285]
Y. Jiang, Z. Yang, J. Guo, H. Li, Y. Liu, Y. Guo, M. Li, X. Pu. Coupling complementary strategy to flexible graph neural network for quick discovery of coformer in diverse co-crystal materials. Nat. Commun., 2021, 12(1): 5950
CrossRef ADS Google scholar
[286]
C. W. Park, C. Wolverton. Developing an improved crystal graph convolutional neural network framework for accelerated materials discovery. Phys. Rev. Mater., 2020, 4(6): 063801
CrossRef ADS Google scholar
[287]
G. P. Ren, Y. J. Yin, K. J. Wu, Y. He. Force field-inspired molecular representation learning for property prediction. J. Cheminform., 2023, 15(1): 17
CrossRef ADS Google scholar
[288]
C. Chen, S. P. Ong. AtomSets as a hierarchical transfer learning framework for small and large materials datasets. npj Comput. Mater., 2021, 7: 173
CrossRef ADS Google scholar
[289]
H. Yamada, C. Liu, S. Wu, Y. Koyama, S. Ju, J. Shiomi, J. Morikawa, R. Yoshida. Predicting materials properties with little data using shotgun transfer learning. ACS Cent. Sci., 2019, 5(10): 1717
CrossRef ADS Google scholar
[290]
S.FengH. FuH.ZhouY.WuZ.Lu H.Dong, A general and transferable deep learning framework for predicting phase formation in materials, npj Comput. Mater. 7(1), 10 (2021)
[291]
V. Gupta, K. Choudhary, F. Tavazza, C. Campbell, W. K. Liao, A. Choudhary, A. Agrawal. Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data. Nat. Commun., 2021, 12: 6595
CrossRef ADS Google scholar
[292]
V. Stanev, C. Oses, A. G. Kusne, E. Rodriguez, J. Paglione, S. Curtarolo, I. Takeuchi. Machine learning modeling of superconducting critical temperature. npj Comput. Mater., 2018, 4(1): 29
CrossRef ADS Google scholar
[293]
D. S. Palmer, N. M. O’Boyle, R. C. Glen, J. B. O. Mitchell. Random forest models to predict aqueous solubility. J. Chem. Inform. Model., 2007, 47(1): 150
CrossRef ADS Google scholar
[294]
P. Banerjee, R. Preissner. Bittersweetforest: A random forest based binary classifier to predict bitterness and sweetness of chemical compounds. Front. Chem., 2018, 6: 93
CrossRef ADS Google scholar
[295]
P. Raccuglia, K. C. Elbert, P. D. F. Adler, C. Falk, M. B. Wenny, A. Mollo, M. Zeller, S. A. Friedler, J. Schrier, A. J. Norquist. Machine-learning-assisted materials discovery using failed experiments. Nature, 2016, 533(7601): 7601
CrossRef ADS Google scholar
[296]
L. Chen, B. Xu, J. Chen, K. Bi, C. Li, S. Lu, G. Hu, Y. Lin. Ensemble-machine-learning-based correlation analysis of internal and band characteristics of thermoelectric materials. J. Mater. Chem. C, 2020, 8(37): 13079
CrossRef ADS Google scholar
[297]
J. Venderley, K. Mallayya, M. Matty, M. Krogstad, J. Ruff, G. Pleiss, V. Kishore, D. Mandrus, D. Phelan, L. Poudel, A. G. Wilson, K. Weinberger, P. Upreti, M. Norman, S. Rosenkranz, R. Osborn, E. A. Kim. Harnessing interpretable and unsupervised machine learning to address big data from modern X-ray diffraction. Proc. Natl. Acad. Sci. USA, 2022, 119(24): e2109665119
CrossRef ADS Google scholar
[298]
R. Cohn, E. Holm. Unsupervised machine learning via transfer learning and k-means clustering to classify materials image data. Integr. Mater. Manuf. Innov., 2021, 10(2): 231
CrossRef ADS Google scholar
[299]
R. E. A. Goodall, A. A. Lee. Predicting materials properties without crystal structure: Deep representation learning from stoichiometry. Nat. Commun., 2020, 11(1): 6280
CrossRef ADS Google scholar
[300]
K. Muraoka, Y. Sada, D. Miyazaki, W. Chaikittisilp, T. Okubo. Linking synthesis and structure descriptors from a large collection of synthetic records of zeolite materials. Nat. Commun., 2019, 10(1): 4459
CrossRef ADS Google scholar
[301]
D. Jha, K. Choudhary, F. Tavazza, W. Liao, A. Choudhary, C. Campbell, A. Agrawal. Enhancing materials property prediction by leveraging computational and experimental data using deep transfer learning. Nat. Commun., 2019, 10(1): 5316
CrossRef ADS Google scholar
[302]
X. Zhong, B. Gallagher, S. Liu, B. Kailkhura, A. Hiszpanski, T. Y.-J. Han. Explainable machine learning in materials science. npj Comput. Mater., 2022, 8: 204
CrossRef ADS Google scholar
[303]
P. Linardatos, V. Papastefanopoulos, S. Kotsiantis. Explainable AI: A review of machine learning interpretability methods. Entropy (Basel), 2020, 23(1): 18
CrossRef ADS Google scholar
[304]
W. J. Murdoch, C. Singh, K. Kumbier, R. Abbasi-Asl, B. Yu. Definitions, methods, and applications in interpretable machine learning. Proc. Natl. Acad. Sci. USA, 2019, 116(44): 22071
CrossRef ADS Google scholar
[305]
R. Kondo, S. Yamakawa, Y. Masuoka, S. Tajima, R. Asahi. Microstructure recognition using convolutional neural networks for prediction of ionic conductivity in ceramics. Acta Mater., 2017, 141: 29
CrossRef ADS Google scholar
[306]
K. Das, B. Samanta, P. Goyal, S.-C. Lee, S. Bhattacharjee, N. Ganguly. CrysXPP: An explainable property predictor for crystalline materials. npj Comput. Mater., 2022, 8: 43
CrossRef ADS Google scholar
[307]
A. Y. T. Wang, S. K. Kauwe, R. J. Murdock, T. D. Sparks. Compositionally restricted attention-based network for materials property predictions. npj Comput. Mater., 2021, 7(1): 77
CrossRef ADS Google scholar
[308]
A. Y. T. Wang, M. S. Mahmoud, M. Czasny, A. Gurlo. CrabNet for explainable deep learning in materials science: bridging the gap between academia and industry. Integr. Mater. Manuf. Innov., 2022, 11(1): 41
CrossRef ADS Google scholar
[309]
A.ParnamiM. Lee, Learning from few examples: A summary of approaches to few-shot learning, arXiv: 2203.04291 (2023)
[310]
Y. Wang, Q. Yao, J. T. Kwok, L. M. Ni. Generalizing from a few examples: A survey on few-shot learning. ACM Comput. Surv., 2020, 53(3): 63
CrossRef ADS Google scholar
[311]
Y.WangA. AbuduweiliQ.YaoD.Dou, Property-aware relation networks for few-shot molecular property prediction, arXiv: 2107.07994 (2021)
[312]
Z.Guo, ., Few-shot graph learning for molecular property prediction, in: Proceedings of the Web Conference 2021, in: WWW ’21. New York, USA: Association for Computing Machinery, June 2021, pp 2559–2567
[313]
K. Kaufmann, H. Lane, X. Liu, K. S. Vecchio. Efficient few-shot machine learning for classification of EBSD patterns. Sci. Rep., 2021, 11(1): 8172
CrossRef ADS Google scholar
[314]
S. Akers. . Rapid and flexible segmentation of electron microscopy data using few-shot machine learning. npj Comput. Mater., 2021, 7: 187
CrossRef ADS Google scholar
[315]
J. P. Perdew, K. Schmidt. Jacob’s ladder of density functional approximations for the exchange-correlation energy. AIP Conf. Proc., 2001, 577: 1
CrossRef ADS Google scholar
[316]
S. Dick, M. Fernandez-Serra. Machine learning accurate exchange and correlation functionals of the electronic density. Nat. Commun., 2020, 11(1): 3509
CrossRef ADS Google scholar
[317]
R. Nagai, R. Akashi, O. Sugino. Completing density functional theory by machine learning hidden messages from molecules. npj Comput. Mater., 2020, 6(1): 43
CrossRef ADS Google scholar
[318]
J. Kirkpatrick, B. McMorrow, D. H. P. Turban, A. L. Gaunt, J. S. Spencer, A. G. D. G. Matthews, A. Obika, L. Thiry, M. Fortunato, D. Pfau, L. R. Castellanos, S. Petersen, A. W. R. Nelson, P. Kohli, P. Mori-Sánchez, D. Hassabis, A. J. Cohen. Pushing the frontiers of density functionals by solving the fractional electron problem. Science, 2021, 374(6573): 1385
CrossRef ADS Google scholar
[319]
J. C. Snyder, M. Rupp, K. Hansen, K. R. Müller, K. Burke. Finding density functionals with machine learning. Phys. Rev. Lett., 2012, 108(25): 253002
CrossRef ADS Google scholar
[320]
X. Lei, A. J. Medford. Design and analysis of machine learning exchange-correlation functionals via rotationally invariant convolutional descriptors. Phys. Rev. Mater., 2019, 3(6): 063801
CrossRef ADS Google scholar
[321]
Z.FanY. WangP.YingK.SongJ.Wang Y.WangZ. ZengK.XuE.LindgrenJ.M. Rahm A.J. GabourieJ.LiuH.Dong J.WuY.Chen Z.ZhongJ. SunP.ErhartY.SuT.Ala-Nissila, GPUMD: A package for constructing accurate machine-learned potentials and performing highly efficient atomistic simulations, J. Chem. Phys. 157(11), 114801 (2022)
[322]
H. Wang, L. Zhang, J. Han, W. E. DeePMD-kit: A deep learning package for many-body potential energy representation and molecular dynamics. Comput. Phys. Commun., 2018, 228: 178
CrossRef ADS Google scholar
[323]
Y.ZhangH. WangW.ChenJ.ZengL.Zhang H.WangW. E, DP-GEN: A concurrent learning platform for the generation of reliable deep learning based potential energy models, Comput. Phys. Commun. 253, 107206 (2020)
[324]
P. Pattnaik, S. Raghunathan, T. Kalluri, P. Bhimalapuram, C. V. Jawahar, U. D. Priyakumar. Machine learning for accurate force calculations in molecular dynamics simulations. J. Phys. Chem. A, 2020, 124(34): 6954
CrossRef ADS Google scholar
[325]
J. Westermayr, P. Marquetand. Machine learning and excited-state molecular dynamics. Mach. Learn.: Sci. Technol., 2020, 1(4): 043001
CrossRef ADS Google scholar
[326]
G. Fan, A. McSloy, B. Aradi, C. Y. Yam, T. Frauenheim. Obtaining electronic properties of molecules through combining density functional tight binding with machine learning. J. Phys. Chem. Lett., 2022, 13(43): 10132
CrossRef ADS Google scholar
[327]
Z. Ahmad, T. Xie, C. Maheshwari, J. C. Grossman, V. Viswanathan. Machine learning enabled computational screening of inorganic solid electrolytes for suppression of dendrite formation in lithium metal anodes. ACS Cent. Sci., 2018, 4(8): 996
CrossRef ADS Google scholar
[328]
S. Gong, S. Wang, T. Zhu, X. Chen, Z. Yang, M. J. Buehler, Y. Shao-Horn, J. C. Grossman. Screening and understanding Li adsorption on two-dimensional metallic materials by learning physics and physics-simplified learning. JACS Au, 2021, 1(11): 1904
CrossRef ADS Google scholar
[329]
T. Xie, A. France-Lanord, Y. Wang, J. Lopez, M. A. Stolberg, M. Hill, G. M. Leverick, R. Gomez-Bombarelli, J. A. Johnson, Y. Shao-Horn, J. C. Grossman. Accelerating amorphous polymer electrolyte screening by learning to reduce errors in molecular dynamics simulated properties. Nat. Commun., 2022, 13(1): 3415
CrossRef ADS Google scholar
[330]
K. Gubaev, E. V. Podryabinkin, G. L. Hart, A. V. Shapeev. Accelerating high-throughput searches for new alloys with active learning of interatomic potentials. Comput. Mater. Sci., 2019, 156: 148
CrossRef ADS Google scholar
[331]
T.XieX. FuO.E. GaneaR.BarzilayT.Jaakkola, Crystal diffusion variational autoencoder for periodic material generation, arXiv: 2110.06197 (2021)
[332]
Y. Dong, D. Li, C. Zhang, C. Wu, H. Wang, M. Xin, J. Cheng, J. Lin. Inverse design of two-dimensional graphene/h-BN hybrids by a regressional and conditional GAN. Carbon, 2020, 169: 9
CrossRef ADS Google scholar
[333]
Y. Pathak, K. S. Juneja, G. Varma, M. Ehara, U. D. Priyakumar. Deep learning enabled inorganic material generator. Phys. Chem. Chem. Phys., 2020, 22(46): 26935
CrossRef ADS Google scholar
[334]
Y. Suzuki, H. Hino, T. Hawai, K. Saito, M. Kotsugi, K. Ono. Symmetry prediction and knowledge discovery from X-ray diffraction patterns using an interpretable machine learning approach. Sci. Rep., 2020, 10(1): 21790
CrossRef ADS Google scholar
[335]
A. A. Enders, N. M. North, C. M. Fensore, J. Velez-Alvarez, H. C. Allen. Functional group identification for FTIR spectra using image-based machine learning models. Anal. Chem., 2021, 93(28): 9711
CrossRef ADS Google scholar
[336]
B. Huang, Z. Li, J. Li. An artificial intelligence atomic force microscope enabled by machine learning. Nanoscale, 2018, 10(45): 21320
CrossRef ADS Google scholar
[337]
A. Chandrashekar, P. Belardinelli, M. A. Bessa, U. Staufer, F. Alijani. Quantifying nanoscale forces using machine learning in dynamic atomic force microscopy. Nanoscale Adv., 2022, 4(9): 2134
CrossRef ADS Google scholar
[338]
S. V. Kalinin, C. Ophus, P. M. Voyles, R. Erni, D. Kepaptsoglou, V. Grillo, A. R. Lupini, M. P. Oxley, E. Schwenker, M. K. Y. Chan, J. Etheridge, X. Li, G. G. D. Han, M. Ziatdinov, N. Shibata, S. J. Pennycook. Machine learning in scanning transmission electron microscopy. Nat. Rev. Methods Primers, 2022, 2(1): 11
CrossRef ADS Google scholar
[339]
J. Jung. . Super-resolving material microstructure image via deep learning for microstructure characterization and mechanical behavior analysis. npj Comput. Mater., 2021, 7: 96
CrossRef ADS Google scholar
[340]
L.FloridiM. Chiriatti, GPT-3: Its nature, scope, limits, and consequences, Minds Mach. 30(4), 681 (2020)
[341]
OpenAI, GPT-4 Technical Report, arXiv: 2303.08774 (2023)
[342]
D.M. KatzM. J. BommaritoS.GaoP.Arredondo, GPT-4 passes the bar exam, Rochester, NY, Mar. 15, 2023
[343]
V. Tshitoyan, J. Dagdelen, L. Weston, A. Dunn, Z. Rong, O. Kononova, K. A. Persson, G. Ceder, A. Jain. Unsupervised word embeddings capture latent knowledge from materials science literature. Nature, 2019, 571(7763): 95
CrossRef ADS Google scholar
[344]
E. A. Olivetti, J. M. Cole, E. Kim, O. Kononova, G. Ceder, T. Y.-J. Han, A. M. Hiszpanski. Data-driven materials research enabled by natural language processing and information extraction. Appl. Phys. Rev., 2020, 7(4): 041317
CrossRef ADS Google scholar
[345]
P. Shetty, R. Ramprasad. Automated knowledge extraction from polymer literature using natural language processing. iScience, 2021, 24(1): 101922
CrossRef ADS Google scholar
[346]
A. Davies, P. Veličković, L. Buesing, S. Blackwell, D. Zheng, N. Tomašev, R. Tanburn, P. Battaglia, C. Blundell, A. Juhász, M. Lackenby, G. Williamson, D. Hassabis, P. Kohli. Advancing mathematics by guiding human intuition with AI. Nature, 2021, 600(7887): 70
CrossRef ADS Google scholar
[347]
G. E. Karniadakis, I. G. Kevrekidis, L. Lu, P. Perdikaris, S. Wang, L. Yang. Physics informed machine learning. Nat. Rev. Phys., 2021, 3(6): 422
CrossRef ADS Google scholar
[348]
A.GoyalY. Bengio, Inductive biases for deep learning of higher-level cognition, Proc. R. Soc. A 478(2266), 20210068 (2022)
[349]
B.BakerI. AkkayaP.ZhokhovJ.HuizingaJ.Tang A.EcoffetB.HoughtonR.Sampedro J.Clune, Video pretraining (VPT): Learning to act by watching unlabeled online videos, Advances in Neural Information Processing Systems 35, 24639 (2022)
[350]
J.LehmanJ. GordonS.JainK.NdousseC.Yeh K.O. Stanley, Evolution through large models, arXiv: 2206.08896 (2022)
[351]
M.S. Anis, ., Qiskit: An open-source framework for quantum computing, 2021
[352]
C. Wu, F. Wu, L. Lyu, Y. Huang, X. Xie. Communication-efficient federated learning via knowledge distillation. Nat. Commun., 2022, 13: 2032
CrossRef ADS Google scholar
[353]
H. G. Yu. Neural network iterative diagonalization method to solve eigenvalue problems in quantum mechanics. Phys. Chem. Chem. Phys., 2015, 17(21): 14071
CrossRef ADS Google scholar
[354]
S. K. Ghosh, D. Ghosh. Machine learning matrix product state Ansatz for strongly correlated systems. J. Chem. Phys., 2023, 158(6): 064108
CrossRef ADS Google scholar
[355]
P. C. H. Nguyen, J. B. Choi, H. S. Udaykumar, S. Baek. Challenges and opportunities for machine learning in multiscale computational modeling. J. Comput. Inf. Sci. Eng., 2023, 23(6): 060808
CrossRef ADS Google scholar
[356]
H. Wahab, V. Jain, A. S. Tyrrell, M. A. Seas, L. Kotthoff, P. A. Johnson. Machine-learning-assisted fabrication: Bayesian optimization of laser-induced graphene patterning using in-situ Raman analysis. Carbon, 2020, 167: 609
CrossRef ADS Google scholar
[357]
A. Tayyebi, A. S. Alshami, X. Yu, E. Kolodka. Can machine learning methods guide gas separation membranes fabrication. J. Membrane Sci. Lett., 2022, 2(2): 100033
CrossRef ADS Google scholar
[358]
Y. T. Chen, M. Duquesnoy, D. H. S. Tan, J. M. Doux, H. Yang, G. Deysher, P. Ridley, A. A. Franco, Y. S. Meng, Z. Chen. Fabrication of high-quality thin solid-state electrolyte films assisted by machine learning. ACS Energy Lett., 2021, 6(4): 1639
CrossRef ADS Google scholar
[359]
W. Li, L. Liang, S. Zhao, S. Zhang, J. Xue. Fabrication of nanopores in a graphene sheet with heavy ions: A molecular dynamics study. J. Appl. Phys., 2013, 114(23): 234304
CrossRef ADS Google scholar
[360]
L. L. Safina, J. A. Baimova. Molecular dynamics simulation of fabrication of Ni-graphene composite: Temperature effect. Micro & Nano Lett., 2020, 15(3): 176
CrossRef ADS Google scholar
[361]
B. Zhao, C. Shen, H. Yan, J. Xie, X. Liu, Y. Dai, J. Zhang, J. Zheng, L. Wu, Y. Zhu, Y. Jiang. Constructing uniform oxygen defect engineering on primary particle level for high-stability lithium-rich cathode materials. Chem. Eng. J., 2023, 465: 142928
CrossRef ADS Google scholar
[362]
X. X. Liao, H. Q. Wang, J. C. Zheng. Tuning the structural, electronic, and magnetic properties of strontium titanate through atomic design: A comparison between oxygen vacancies and nitrogen doping. J. Am. Ceram. Soc., 2013, 96(2): 538
CrossRef ADS Google scholar
[363]
H. Xing, H. Q. Wang, T. Song, C. Li, Y. Dai, G. Fu, J. Kang, J. C. Zheng. Electronic and thermal properties of Ag-doped single crystal zinc oxide via laser-induced technique. Chin. Phys. B, 2023, 32(6): 066107
CrossRef ADS Google scholar
[364]
L. Wu, J. C. Zheng, J. Zhou, Q. Li, J. Yang, Y. Zhu. Nanostructures and defects in thermoelectric AgPb18SbTe20 single crystal. J. Appl. Phys., 2009, 105(9): 094317
CrossRef ADS Google scholar
[365]
H. Zeng, M. Wu, H. Q. Wang, J. C. Zheng, J. Kang. Tuning the magnetic and electronic properties of strontium titanate by carbon doping. Front. Phys., 2021, 16(4): 43501
CrossRef ADS Google scholar
[366]
D. Li, H. Q. Wang, H. Zhou, Y. P. Li, Z. Huang, J. C. Zheng, J. O. Wang, H. Qian, K. Ibrahim, X. Chen, H. Zhan, Y. Zhou, J. Kang. Influence of nitrogen and magnesium doping on the properties of ZnO films. Chin. Phys. B, 2016, 25(7): 076105
CrossRef ADS Google scholar
[367]
R. Wang, J. C. Zheng. Promising transition metal decorated borophene catalyst for water splitting. RSC Advances, 2023, 13(14): 9678
CrossRef ADS Google scholar
[368]
J. He, L. D. Zhao, J. C. Zheng, J. W. Doak, H. Wu, H. Q. Wang, Y. Lee, C. Wolverton, M. G. Kanatzidis, V. P. Dravid. Role of sodium doping in lead chalcogenide thermoelectrics. J. Am. Chem. Soc., 2013, 135(12): 4624
CrossRef ADS Google scholar
[369]
L. D. Cooley, A. J. Zambano, A. R. Moodenbaugh, R. F. Klie, J. C. Zheng, Y. Zhu, Inversion of two-band superconductivity at the critical electron doping of (Mg. Al)B2. Phys. Rev. Lett., 2005, 95(26): 267002
CrossRef ADS Google scholar
[370]
H. Yan, T. Wang, L. Liu, T. Song, C. Li, L. Sun, L. Wu, J. C. Zheng, Y. Dai. High voltage stable cycling of all-solid-state lithium metal batteries enabled by top-down direct fluorinated poly (ethylene oxide)-based electrolytes. J. Power Sources, 2023, 557: 232559
CrossRef ADS Google scholar
[371]
J. C. Zheng, C. H. A. Huan, A. T. S. Wee, R. Z. Wang, Y. M. Zheng. Ground-state properties of cubic C-BN solid solutions. J. Phys.: Condens. Matter, 1999, 11(3): 927
CrossRef ADS Google scholar
[372]
Z. Huang, T. Y. Lü, H. Q. Wang, S. W. Yang, J. C. Zheng, Electronic properties of the group-III nitrides (BN. AlN and GaN) atomic sheets under biaxial strains. Comput. Mater. Sci., 2017, 130: 232
CrossRef ADS Google scholar
[373]
T. Y. Lü, X. X. Liao, H. Q. Wang, J. C. Zheng, Tuning the indirect–direct band gap transition of SiC. GeC and SnC monolayer in a graphene-like honeycomb structure by strain engineering: A quasiparticle GW study. J. Mater. Chem., 2012, 22(19): 10062
CrossRef ADS Google scholar
[374]
J. C. Zheng, J. W. Davenport. Ferromagnetism and stability of half-metallic MnSb and MnBi in the strained zinc-blende structure: Predictions from full potential and pseudopotential calculations. Phys. Rev. B, 2004, 69(14): 144415
CrossRef ADS Google scholar
[375]
L. Xu, H. Q. Wang, J. C. Zheng, Thermoelectric properties of PbTe. SnTe, and GeTe at high pressure: An ab initio study. J. Electron. Mater., 2011, 40(5): 641
CrossRef ADS Google scholar
[376]
L. Xu, Y. Zheng, J. C. Zheng. Thermoelectric transport properties of PbTe under pressure. Phys. Rev. B, 2010, 82(19): 195102
CrossRef ADS Google scholar
[377]
J. C. Zheng, Superhard hexagonal transition metal, its carbide. OsC, and OsN. Phys. Rev. B, 2005, 72(5): 052105
CrossRef ADS Google scholar
[378]
T. Sun, K. Umemoto, Z. Wu, J. C. Zheng, R. M. Wentzcovitch. Lattice dynamics and thermal equation of state of platinum. Phys. Rev. B, 2008, 78(2): 024304
CrossRef ADS Google scholar
[379]
Z. Wu, R. M. Wentzcovitch, K. Umemoto, B. Li, K. Hirose, J. C. Zheng. Pressure-volume-temperature relations in MgO: An ultrahigh pressure-temperature scale for planetary sciences applications. J. Geophys. Res., 2008, 113(B6): B06204
CrossRef ADS Google scholar
[380]
S. Deng, L. Wu, H. Cheng, J. C. Zheng, S. Cheng, J. Li, W. Wang, J. Shen, J. Tao, J. Zhu, Y. Zhu. Charge-lattice coupling in hole-doped LuFe2O4+δ: The origin of second-order modulation. Phys. Rev. Lett., 2019, 122(12): 126401
CrossRef ADS Google scholar
[381]
J. C. Zheng, L. Wu, Y. Zhu, J. W. Davenport. On the sensitivity of electron and X-ray scattering factors to valence charge distribution. J. Appl. Crystall., 2005, 38: 648
CrossRef ADS Google scholar
[382]
J. C. Zheng, H. Q. Wang. Principles and applications of a comprehensive characterization method combining synchrotron radiation technology, transmission electron microscopy, and density functional theory. Sci. Sin. - Phys. Mech. & Astron., 2021, 51(3): 030007
CrossRef ADS Google scholar

Declarations

The authors declare that they have no competing interests and there are no conflicts.

Acknowledgements

This research was supported by the Ministry of Higher Education Malaysia through the Fundamental Research Grant Scheme (No. FRGS/1/2021/STG05/XMU/01/1).

RIGHTS & PERMISSIONS

2023 The Authors
AI Summary AI Mindmap
PDF(11699 KB)

Accesses

Citations

Detail

Sections
Recommended

/