AIDCT: An AI service development and composition tool for constructing trustworthy intelligent systems

Abstract

The growing prevalence of AI services on cloud platforms is driving the demand for technologies and tools which enable the integration of multiple AI services to handle intricate tasks. Traditional methods of evaluating intelligent systems focus mainly on the performance of AI components, without providing comprehensive metrics for the system as a whole. Additionally, as these AI components are often sourced from third-party providers, users may face challenges due to inconsistent quality assurance and limitations in further developing AI models, and dealing with third-party service providers’ limitations. These limitations often involve quality assurance and a lack of capability for secondary development and training of services. To address these issues, we have developed a tool based on our previous work. It can autonomously build Intelligent systems from AI services while tackling the issues mentioned above. This tool not only creates service composition solutions that align with user-defined functional requirements and performance metrics but also executes these solutions to verify if the metrics meet user requirements. We have demonstrated the effectiveness of this tool in constructing trustworthy intelligent systems through a series of case studies.

Keywords

AI service / Trustworthy intelligent system / Practical applications

Declaration of competing interest

The authors declare that they have no known competing finan-cial interests or personal relationships that could have appeared to influence the work reported in this paper.

References

[1] Han Liu, Kaixuan Li, Yixiang Chen, Survey on trustworthiness measurement for artificial intelligence systems, J. Softw. 33 (2022) 1-19.

[2] Gongyuan Li, Bohan liu, Yuhao Yang, Dong Shao, Quality attributes and practices of trustworthy artificial intelligence systems: A systematic literature review based on relevant secondary studies, J. Softw. 34 (9) (2023).

[3] Wei Jiang, Charles Zhang, Zhenqiu Huang, Mingwen Chen, Songlin Hu, Zhiyong Liu, Qsynth: A tool for qos-aware automatic service composition, in: 2010 IEEE International Conference on Web Services,IEEE, 2010, pp. 42-49.

[4] Bev Littlewood, Software reliability model for modular program structure, IEEE Trans. Reliab. 28 (3) (1979) 241-246.

[5] Zhiguo Li, Qin Li, ASC4AI: a novel automatic service composition framework for AI systems (S), in: The 35th International Conference on Software Engineering and Knowledge Engineering, SEKE 2023, KSIR Virtual Conference Center, USA, July 1-10, 2023, KSI Research Inc., 2023, pp. 197-202.

[6] Wei Jiang, Songlin Hu, Zhiyong Liu, Top k query for QoS-aware automatic service composition, IEEE Trans. Serv. Comput. 7 (4) (2013) 681-695.

[7] Amina Bekkouche, Sidi Mohammed Benslimane, Marianne Huchard, Chouki Tibermacine, Fethallah Hadjila, Mohammed Merzoug, QoS-aware optimal and automated semantic web service composition with user’s constraints, Serv. Orient. Comput. Appl. 11 (2017) 183-201.

[8] Maha Driss, Safa Ben Atitallah, Amal Albalawi, Wadii Boulila, Req-WSComposer: a novel platform for requirements-driven composition of semantic web services, J. Ambient Intell. Humaniz. Comput. (2022) 1-17.

[9] Thanh-Trung Pham, Xavier Défago, Reliability prediction for component-based systems: Incorporating error propagation analysis and different execution models, in: 2012 12th International Conference on Quality Software,IEEE, 2012, pp. 106-115.

[10] Zibin Zheng, Tom Chao Zhou, Michael R. Lyu, Irwin King, Component ranking for fault-tolerant cloud applications, IEEE Trans. Serv. Comput. 5 (4) (2011) 540-550.

[11] Michael C. Jaeger, Gregor Rojec-Goldmann, Gero Muhl, Qos aggregation in web service compositions, in: 2005 IEEE International Conference on E-Technology, E-Commerce and E-Service, IEEE, 2005, pp. 181-185.

[12] Keita Fujii, Tatsuya Suda, Semantics-based dynamic service composition, IEEE J. Sel. Areas Commun. 23 (12) (2005) 2361-2372.

[13] Yue Chen, Xuefeng Yan, Arif Ali Khan, A novel reliability assessment method based on the effects of components, in: 2019 IEEE 19th International Conference on Software Quality,Reliability and Security, QRS, IEEE, 2019, pp. 69-76.

[14] Jiaming Han, Jian Ding, Nan Xue, Gui-Song Xia, Redet: A rotation-equivariant detector for aerial object detection,in:Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 2786-2795.

[15] L. Yao, X. Zhang, Y. Lyu, W. Sun, M. Li, FGSC-23: A large-scale dataset of high-resolution optical remote sensing image for deep learning-based fine-grained ship recognition,J. Image Graph 26 (2021) 2337-2345.

[16] Sheng Fang, Kaiyu Li, Zhe Li, Changer: Feature interaction is what you need for change detection, IEEE Trans. Geosci. Remote Sens. (2023).

[17] Dongdong Zhang, Chunping Wang, Qiang Fu, Ship target detection in SAR image based on feature-enhanced network, Syst. Eng. Electron. 45 (4) (2023) 1032-1039.

[18] Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, Piotr Dollár, Focal loss for dense object detection, in:Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 2980-2988.

[19] Shu Liu, Lu Qi, Haifang Qin, Jianping Shi, Jiaya Jia, Path aggregation network for instance segmentation, in:Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 8759-8768.

[20] Claudine Badue, Ranik Guidolini, et al.,Raphael Vivacqua Carneiro, Pedro Azevedo, Vinicius B Cardoso, Avelino Forechi, Luan Jesus, Rodrigo Berriel, Thiago M Paixao, Filipe Mutz, Self-driving cars: A survey, Expert Syst. Appl. 165 (2021) 113816.

[21] Morten Bornø Jensen, Mark Philip Philipsen, Andreas Møgelmose, Thomas Baltzer Moeslund, Mohan Manubhai Trivedi, Vision for looking at traffic lights: Issues, survey, and perspectives, IEEE Trans. Intell. Transp. Syst. 17 (7) (2016) 1800-1815.

[22] Karsten Behrendt, Libor Novak, Rami Botros, A deep learning approach to traffic lights: Detection, tracking, and classification, in: 2017 IEEE International Conference on Robotics and Automation,ICRA, IEEE, 2017, pp. 1370-1377.