Efficient Vanilla Split Learning for Privacy-Preserving Collaboration in Resource-Constrained Cyber-Physical Systems

Nabila Azeri, Ouided Hioual, Ouassila Hioual

Abstract


In the realm of Cyber-Physical Systems (CPS), the integration of Federated Machine Learning (FML) algorithms has become indispensable for enhancing adaptability, data privacy, and security. However, FML falls short when deployed in resource-constrained CPS environments due to its inherent demands on client resources. To address this limitation, this paper introduces a novel Split Machine Learning (SML) architecture tailored specifically for resource-constrained CPS deployments. Unlike FML, SML strategically splits the model between devices and a central server, enabling collaborative learning while preserving data privacy. Adopting a distributed learning paradigm, SML facilitates real-time system adaptation based on local sensor data, mitigating communication overhead and ensuring privacy. Experimental evaluation demonstrates that the proposed SML-based architecture achieves an accuracy rate of 97.56% with a processing time reduction of approximately 41% compared to FML methods. These results highlight the potential of our approach to improve collaboration in resource-constrained environments while maintaining high levels of privacy and performance.

Full Text:

PDF

References


Rania Salih Ahmed, Elmustafa Sayed Ali Ahmed, and Rashid A Saeed. Machine learning in cyber-physical systems in industry 4.0. In Artificial intelligence paradigms for smart cyber-physical systems, pages 20–41.IGI global, 2021.

Odey Alshboul, Rabia Emhamed Al Mamlook, Ali Shehadeh, and Tahir Munir. Empirical exploration of predictive maintenance in concrete manufacturing: Harnessing machine learning for enhanced equipment reliability in construction project management. Computers & Industrial Engineering, page 110046, 2024. doi:10.1016/j.cie.2024.110046.

Nabila Azeri, Ouassila Hioual, and Ouided Hioual. Towards an approach for modeling and architecting of self-adaptive cyberphysical systems. In 2022 4th International Conference on Pattern Analysis and Intelligent Systems (PAIS), pages 1–7. IEEE, 2022. doi: 10.1109/pais56586.2022.9946921.

Nabila Azeri, Ouided Hioual, and Ouassila Hioual. Enhancing self-adaptive cyberphysical systems using federated machine learning. In TACC 2023 : 3rd TunisianAlgerian Joint Conference on Applied Computing, pages 108–119. ceur-ws.org, 2023.

Nabila Azeri, Zeinb Zouikri, Meriem Rezgui, Ouided Hioual, and Ouassila Hioual. Fault prediction using supervised and unsupervised learning algorithms in cyber physical systems. In 2022 2nd International Conference on New Technologies of Information and Communication (NTIC), pages 1–6. IEEE, 2022. doi:10.1109/ntic55069.2022.10100404.

Multi framework deep learning API. Keras: The high-level api for tensorflow, 2023. https://www.tensorflow.org/guide/keras.

Zhiwei Guo, Keping Yu, Zhihan Lv, KimKwang Raymond Choo, Peng Shi, and Joel JPC Rodrigues. Deep federated learning enhanced secure poi microservices for cyberphysical systems. IEEE Wireless Communications, 29(2):22–29, 2022. doi:10.1109/mwc.002.2100272.

Xianting Huang, Jing Liu, Yingxu Lai, Beifeng Mao, and Hongshuo Lyu. Eefed: Personalized federated learning of execution&evaluation dual network for cps intrusion detection. IEEE Transactions on Information Forensics and Security, 18:41–56, 2022. doi:10.1109/tifs.2022.3214723.

Sangjun Kim and Kyung-Joon Park. A survey on machine-learning based security design for cyber-physical systems. Applied Sciences, 11(12):5458, 2021. . doi:10.3390/app11125458.

Beibei Li, Yuhao Wu, Jiarui Song, Rongxing Lu, Tao Li, and Liang Zhao. Deepfed: Federated deep learning for intrusion detection in industrial cyber–physical systems. IEEE Transactions on Industrial Informatics, 17(8):5615–5624, 2020. doi:10.1109/tii.2020.3023430.

Stephan Matzka. Explainable artificial intelligence for predictive maintenance applications. In 2020 third international conference on artificial intelligence for industries (ai4i), pages 69–74. IEEE, 2020. doi:10.1109/ai4i49448.2020.00023.

Hossein Mohammadi Rouzbahani, Hadis Karimipour, Abolfazl Rahimnejad, Ali Dehghantanha, and Gautam Srivastava. Anomaly detection in cyber-physical systems using machine learning. Handbook of big data privacy, pages 219–235, 2020. doi:10.1007/978-3-030-38557-6_10.

Felix O Olowononi, Danda B Rawat, and Chunmei Liu. Resilient machine learning for networked cyber physical systems: A survey for machine learning security to securing machine learning for cps. IEEE Communications Surveys & Tutorials, 23(1):524–552, 2020. doi:10.1109/comst.2020.3036778.

Mutaz Ryalat, Hisham ElMoaqet, andMarwa AlFaouri. Design of a smart factory based on cyber-physical systems and internet of things towards industry 4.0. Applied Sciences, 13(4):2156, 2023. . doi: 10.3390/app13042156.

Arman Sargolzaei, Carl D Crane, Alireza Abbaspour, and Shirin Noei. A machine learning approach for fault detection in vehicular

cyber-physical systems. In 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA), pages 636–640. IEEE, 2016. doi:10.1109/icmla.2016.0112.

Zakir Ahmad Sheikh, Yashwant Singh, Pradeep Kumar Singh, and Kayhan Zrar Ghafoor. Intelligent and secure framework for critical infrastructure (cps): Current trends, challenges, and future scope. Computer Communications, 193:302–331, 2022. doi: 10.1016/j.comcom.2022.07.007.

Rama Mercy Sam Sigamani. Adoption of machine learning with adaptive approach for securing cps. In Handbook of Research on Machine and Deep Learning Applications for Cyber Security, pages 388–415. IGI Global, 2020. doi:10.4018/978-1-6684-6291-1.ch061.

Theocharis Theocharides, Muhammad Shafique, Jungwook Choi, and Onur Mutlu. Guest editorial: Robust resource-constrained systems for machine learning. IEEE Design & Test, 37(2):5–7, 2020. doi:10.1109/mdat.2020.2971201.

Praneeth Vepakomma, Otkrist Gupta, Tristan Swedish, and Ramesh Raskar. Split learning for health: Distributed deep learning without sharing raw patient data. arXiv preprint arXiv:1812.00564, 2018.

Chathurika S Wickramasinghe, Kasun Amarasinghe, Daniel L Marino, Craig Rieger, and Milos Manic. Explainable unsupervised machine learning for cyber-physical systems. IEEE Access, 9:131824–131843, 2021. doi:10.1109/access.2021.3112397.

Kok-Seng Wong, Manh Nguyen-Duc, Khiem Le-Huy, Long Ho-Tuan, Cuong Do-Danh, and Danh Le-Phuoc. An empirical study of federated learning on iot-edge devices: Resource allocation and heterogeneity. arXiv preprint arXiv:2305.19831, 2023.

Minrui Xu, Jialiang Peng, Brij B Gupta, Jiawen Kang, Zehui Xiong, Zhenni Li, and Ahmed A Abd El-Latif. Multiagent federated reinforcement learning for secure incentive mechanism in intelligent cyber–physical systems. IEEE Internet of Things Journal, 9(22):22095–22108, 2021. doi:10.1109/jiot.2021.3081626.

Chong Zhang, Xiao Liu, Xi Zheng, Rui Li, and Huai Liu. Fenghuolun: A federated learning based edge computing platform for cyber-physical systems. In 2020 IEEE international conference on pervasive computing and communications workshops (PerCom Workshops), pages 1–4. IEEE, 2020. doi:10.1109/percomworkshops48775.2020.9156259.




DOI: https://doi.org/10.31449/inf.v48i11.6186

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.