Scalable AI Frameworks for Real-Time Distributed Monitoring and Decision-Making in Smart Automation
Keywords:
Scalable AI Monitoring Systems, Distributed Real-Time Analytics, Federated Artificial Intelligence, Privacy-Preserving Machine Learning, Federated Adaptive Neurons, Large-Scale Sensor Networks, Anomaly Detection in Water Networks, Smart Automation Architectures, High-Performance Distributed Computing, Data Governance and Sovereignty, Real-Time Stream Processing, Smart City Monitoring Systems, Aquatic Environment Surveillance, Confidentiality-Preserving Data Analytics, Horizontal and Vertical Scalability.Abstract
Scalable AI-based systems are outlined that support distributed, real-time monitoring and decision-making in the context of smart automation systems. The architectural principles presented are driven by the following requirements: Distributed sensing and data ingestion; AI methods that support real-time monitoring of large-scale sensor networks; Scalability and performance enhancement; Support for privacy; Governance and data management regulation; Federated capabilities and privacy support preserving data confidentiality. Within this framework, federated adaptive neurons are proposed. These AI nano-scopes provide local information about distributed streams, support anomaly detection and declaration in large sensor networks such as water networks, and can operate in a privacy-preserving environment. Additionally, horizontal and vertical scalability with distributed or high-performance computing is exposed. The proposed principles are supported by experimental cases that illustrate a distributed real-time monitoring capability.
Monitoring of the water quality and surveillance of an aquatic environment is investigated as an application area. A Smart City use case within a European initiative is also proposed. Finally, recent advances regarding governance, security, and privacy of data, especially on personal nature, are examined. These aspects are worthy of special consideration, since data governance regulation is evolving rapidly. The analytics to monitor data that may cross data sovereignty boundaries, such as those originating from users, need to respect end-user privacy preferences.
References
1. Nguyen, D. C., Ding, M., Pathirana, P. N., Seneviratne, A., Li, J., & Poor, H. V. (2021). Federated learning for Internet of Things: A comprehensive survey. IEEE Communications Surveys & Tutorials, 23(3), 1622–1658.
2. Kherbache, M., Maimour, M., & Rondeau, E. (2021). When digital twin meets network softwarization in the Industrial IoT: Real-time requirements case study. Sensors, 21(24), 8194.
3. Kolla, S. K., & Mangalampalli, B. M. (2024). Edge-Based Deep Learning Systems for Point-of-Care Diagnostic Intelligence. Journal of Neonatal Surgery, 13(1), 2387-2399.
4. Ray, P. P. (2022). A review on TinyML: State-of-the-art and prospects. Journal of King Saud University—Computer and Information Sciences, 34(4), 1595–1623.
5. Jiang, Z., Guo, Y., & Wang, Z. (2021). Digital twin to improve the virtual-real integration of industrial IoT. Journal of Industrial Information Integration, 22, 100196.
6. Radanliev, P., De Roure, D., Nicolescu, R., Huth, M., Santos, O., & Montalvo, R. M. (2022). Digital twins: Artificial intelligence and the IoT cyber-physical systems in Industry 4.0. International Journal of Intelligent Robotics and Applications, 6, 171–185.
7. Inala, R., & Somu, B. (2024). Agentic ai in retail banking: Redefining customer service and financial decision-making. Journal of Artificial Intelligence and Big Data Disciplines, 1(1), 1-19.
8. Khan, L. U., Pandey, S. R., Tran, N. H., Saad, W., Han, Z., & Hong, C. S. (2021). Federated learning for edge networks: Resource optimization and incentive mechanism. IEEE Communications Magazine, 59(11), 88–93.
9. Abreha, H. G., Hayajneh, M., & Serhani, M. A. (2022). Federated learning in edge computing: A systematic survey. Sensors, 22(2), 450.
10. Gottimukkala, V. R. R. (2024). Federated Learning Approaches for Fraud Detection in International Payment Systems. https://www. jisem-journal. com/download/118_JISEM. pdf.
11. Duan, Q., Hu, S., Deng, R., & Lu, Z. (2022). Combined federated and split learning in edge computing for ubiquitous intelligence in Internet of Things: State-of-the-art and future directions. Sensors, 22(16), 5983.
12. Schizas, N., Karras, A., Karras, C., & Sioutas, S. (2022). TinyML for ultra-low power AI and large scale IoT deployments: A systematic review. Future Internet, 14(12), 363.
13. Singh, R., & Gill, S. S. (2023). Edge AI: A survey. Internet of Things and Cyber-Physical Systems, 3, 71–92.
14. Inala, R. (2023). AI-powered investment decision support systems: Building smart data products with embedded governance controls. Journal for ReAttach Therapy and Developmental Diversities, 6(10), 2251-2266.
15. Bourechak, A., Zedadra, O., Kouahla, M. N., Guerrieri, A., Seridi, H., & Fortino, G. (2023). At the confluence of artificial intelligence and edge computing in IoT-based applications: A review and new perspectives. Sensors, 23(3), 1639.
16. Silva, L. G. F. da, Sadok, D. F. H., & Endo, P. T. (2023). Resource optimizing federated learning for use with IoT: A systematic review. Journal of Parallel and Distributed Computing, 175, 92–108.
17. Kolla, T. (2024). Graph Neural Networks for HCC Risk Adjustment and Interoperability. International Journal of Science, Research and Technology, 7(6), 13244-13255.
18. Campolo, C., Genovese, G., Singh, G., & Molinaro, A. (2023). Scalable and interoperable edge-based federated learning in IoT contexts. Computer Networks, 223, 109576.
19. Ahmad, S., Shakeel, I., Mehfuz, S., & Ahmad, J. (2023). Deep learning models for cloud, edge, fog, and IoT computing paradigms: Survey, recent advances, and future directions. Computer Science Review, 49, 100568.
20. Singh, R., & Gill, S. S. (2023). Edge AI: A survey. Internet of Things and Cyber-Physical Systems, 3, 71–92.
21. Davuluri, P. S. L. (2023). AI-Augmented Sanctions Screening: Enhancing Accuracy and Latency in Real Time Compliance Systems. AI-Augmented Sanctions Screening: Enhancing Accuracy and Latency in Real Time Compliance Systems (December 15, 2023).
22. Li, H., Ge, L., & Tian, L. (2024). Survey: Federated learning data security and privacy-preserving in edge-Internet of Things. Artificial Intelligence Review, 57, 130.
23. Savaglio, C., Mazzei, P., & Fortino, G. (2024). Edge intelligence for Industrial IoT: Opportunities and limitations. Procedia Computer Science, 232, 397–405.
24. Ning, Z., Tolba, A., & Kong, X. (2022). Edge intelligence for 6G-enabled Industrial Internet of Things. Wireless Communications and Mobile Computing, 2022.
25. Sharma, A., Kosasih, E., Zhang, J., Brintrup, A., & Calinescu, A. (2022). Digital twins: State of the art theory and practice, challenges, and open research questions. Journal of Industrial Information Integration, 30, 100383.
26. Inala, R. Designing Scalable Technology Architectures for Customer Data in Group Insurance and Investment Platforms.
27. Ning, Z., Dong, P., Wang, X., Hu, X., Lv, J., Guo, Y., & Wang, J. (2022). When deep reinforcement learning meets 5G-enabled edge computing. IEEE Network, 36(2), 46–52.
28. Zhao, Y., Zhao, J., Jiang, L., Wang, R., & Tan, H. (2022). Federated learning for edge intelligence in Internet of Things: A survey. IEEE Internet of Things Journal, 9(18), 17195–17214.
29. Zaidi, S. A. R., Hayajneh, A. M., Hafeez, M., et al. (2022). Unlocking edge intelligence through tiny machine learning (TinyML). IEEE Access, 10, 100867–100882.
30. Ray, P. P. (2022). A review on TinyML: State-of-the-art and prospects. Journal of King Saud University—Computer and Information Sciences, 34(4), 1595–1623.
31. Singh, R., Gill, S. S., & others. (2023). AI-based fog and edge computing: A systematic review, taxonomy and future directions. Internet of Things, 21, 100674.
32. Han, C., Li, T., Chen, Q., Wu, Y., & Qin, J. (2024). Distributed and collaborative lightweight edge federated learning for IoT zombie devices detection. ACM Transactions on Sensor Networks.
33. Campolo, C., Genovese, G., Singh, G., & Molinaro, A. (2023). Scalable and interoperable edge-based federated learning in IoT contexts. Computer Networks, 223, 109576.
34. Savaglio, C., Mazzei, P., & Fortino, G. (2024). Edge intelligence for Industrial IoT: Opportunities and limitations. Procedia Computer Science, 232, 397–405.
35. Kolla, S. K., & Reddy, V. A. R. (2024). Evaluating Cloud-Native vs. Hybrid Architectures for Health Benefit Administration Systems. International Journal of Medical Toxicology and Legal Medicine, 27(5), 1042-1053.
36. Ahmad, S., Shakeel, I., Mehfuz, S., & Ahmad, J. (2023). Deep learning models for cloud, edge, fog, and IoT computing paradigms: Survey, recent advances, and future directions. Computer Science Review, 49, 100568.
37. Bourechak, A., Zedadra, O., Kouahla, M. N., Guerrieri, A., Seridi, H., & Fortino, G. (2023). At the confluence of artificial intelligence and edge computing in IoT-based applications: A review and new perspectives. Sensors, 23(3), 1639.
38. Jiang, Z., Guo, Y., & Wang, Z. (2021). Digital twin to improve the virtual-real integration of industrial IoT. Journal of Industrial Information Integration, 22, 100196.
