A Raising 2D Piezo-Ferro-Opto-Electronic Semiconductor for Brain-Inspired Multimodal Perception and Computation

Abstract

Multimodal perception, pivotal for artificial intelligence (AI) systems demanding real-time decision-making and environmental adaptability, might be significantly improved through two-dimensional (2D) piezo-ferro-opto-electronic (PFOE) semiconductors, like, NbOX₂ (X = Cl, Br, I). Such improvement may enable in-sensor fusion of sense organ signals (e.g., vision, audition, gustation, and olfaction) within a single functional component, overcoming limitations of conventional discrete sensor architectures. Such function cohesion, combined with their recently uncovered properties, not only provides a robust foundation for expanding sensory modalities and developing novel mechanisms to establish an all-in-one multimodal perception platform, but also paves the way for multisensory-integrated artificial systems beyond human sensory systems. This single-component system employing such PFOE semiconductors substantially mitigates intermodule communication latency while boosting integration density of information, thereby circumventing persistent inefficiencies in AI hardware architectures for real-time applications, such as embodied robotics and immersive human-machine interfaces. This fusion of multimodal perception and computation, enabled by multiphysics coupling of 2D NbOX₂, drives AI systems toward biological-grade efficiency while maintaining environmental adaptability, representing a critical leap toward autonomous intelligence operating in dynamic real-world settings.

Keywords

2D materials / multimodal perception / multisensory integration / NbOX₂ / neuromorphic computing / piezo-ferro-opto-electronics

References

[1] K. Roy, A. Jaiswal, and P. Panda, “Towards Spike-Based Machine Intelligence With Neuromorphic Computing,” Nature 575 (2019): 607-617.

[2] D. H. Hubel, Eye, Brain, and Vision (Scientific American Library, 1995).

[3] S. Sundaram, “How to Improve Robotic Touch,” Science 370 (2020): 768-769.

[4] J. Yu, X. Yang, G. Gao, et al., “Bioinspired Mechano-Photonic Artificial Synapse Based on Graphene/MoS₂ Heterostructure,” Science Advances 7 (2021): eabd9117.

[5] J. He, R. Wei, S. Ge, et al., “Artificial Visual-Tactile Perception Array for Enhanced Memory and Neuromorphic Computations,” InfoMat 6 (2024): e12493.

[6] J. Guo, F. Guo, H. Zhao, et al., “In-Sensor Computing With Visual-Tactile Perception Enabled by Mechano-Optical Artificial Synapse,” Advanced Materials 37 (2025): 2419405.

[7] Y. Jia, M. Zhao, G. Gou, X. C. Zeng, and J. Li, “Niobium Oxide Dihalides NbOX₂: A New Family of Two-Dimensional van der Waals Layered Materials With Intrinsic Ferroelectricity and Antiferroelectricity,” Nanoscale Horizons 4 (2019): 1113-1123.

[8] Y. Fang, F. Wang, R. Wang, T. Zhai, and F. Huang, “2D NbOI₂: A Chiral Semiconductor With Highly In-Plane Anisotropic Electrical and Optical Properties,” Advanced Materials 33 (2021): 2101505.

[9] Z. Chen, Y. Hu, L. Zhang, J. Jiang, R. Hawks, and J. Shi, “Photoactive Electrically Switchable van der Waals Semiconductor NbOI₂,” Applied Physics Letters 119 (2021): 033103.

[10] I. Abdelwahab, B. Tilmann, Y. Wu, et al., “Giant Second-Harmonic Generation in Ferroelectric NbOI₂,” Nature Photonics 16 (2022): 644-650.

[11] C. Liu, X. Zhang, X. Wang, et al., “Ferroelectricity in Niobium Oxide Dihalides NbOX₂ (X = Cl, I): A Macroscopic- to Microscopic-Scale Study,” ACS Nano 17 (2023): 7170-7179.

[12] Z. Li, S. Wang, C. Wang, et al., “Peierls Distortion Induced Giant Linear Dichroism, Second-Harmonic Generation, and In-Plane Ferroelectricity in NbOBr₂,” Small 21 (2025): 2407729.

[13] Y. Wu, I. Abdelwahab, K. C. Kwon, et al., “Data-Driven Discovery of High Performance Layered van der Waals Piezoelectric NbOI₂,” Nature Communications 13 (2022): 1884.

[14] Y. H. Jung, J. An, D. Y. Hyeon, et al., “Theoretical Basis of Biomimetic Flexible Piezoelectric Acoustic Sensors for Future Customized Auditory Systems,” Advanced Functional Materials 34 (2024): 2309316.

[15] M. Wang, D. Ouyang, Y. Dai, et al., “2D Piezo-Ferro-Opto-Electronic Artificial Synapse for Bio-Inspired Multimodal Sensory Integration,” Advanced Materials 37 (2025): 2500049.

[16] Q. Guo, X. Z. Qi, L. Zhang, et al., “Ultrathin Quantum Light Source With van der Waals NbOCl₂ Crystal,” Nature 613 (2023): 53-59.

[17] T. Handa, C. Y. Huang, Y. Li, et al., “Terahertz Emission From Giant Optical Rectification in a van der Waals Material,” Nature Materials 24 (2025): 1203-1208.

[18] Z. Zhang, X. Di, C. Paillard, L. Bellaiche, and Z. Jiang, “Giant Electro-Optic and Elasto-Optic Effects in Ferroelectric NbOI₂,” Physical Review B 110 (2024): L100101.

[19] Y. Guan, Y. Ding, Y. Fang, et al., “Far-Field Femtosecond Laser-Driven λ/73 Super-Resolution Fabrication of 2D van der Waals NbOI₂ Nanostructures in Ambient Air,” Nature Communications 16 (2025): 4149.

[20] Z. Sun, J. Liu, N. Zhang, et al., “Enhanced In-Plane Polarization in Two-Dimensional Gains₃ via Strain Engineering for Self-Powered Photodetector,” Transactions of Materials Research 1 (2025): 100009.

[21] D. Ouyang, M. Wang, N. Zhang, et al., “2D Time-Stretching Anisotropic Synapse Realizing In-Sensor Intensity-Spanning Visual Feature Fusion,” Advanced Materials 37 (2025): 2507168.

RIGHTS & PERMISSIONS

2025 The Authors. Interdisciplinary Materials published by Wuhan University of Technology and John Wiley & Sons Australia, Ltd.