Cloud-Native ML Pipelines for AI-Powered Payment Risk Scoring
Keywords:
Payment Risk Scoring Systems, Cloud-Native Big Data Architecture, Real-Time Risk Evaluation, Payment Service Providers, Financial Transaction Analytics, Machine Learning–Based Risk Metrics, Near-Native Response Time, Data Generation And Ingestion, Event-Driven Processing, Batch Data Processing, Cloud-Native IoT Systems, Risk Scoring Services, Lifelong Machine Learning, CI/CD Pipelines For ML, Data Governance And Privacy, Zero-Trust Security Architecture, Observability And Monitoring, Scalable Financial Platforms, Payment Analytics Data Lakes, Intelligent Financial Risk Management.Abstract
The growing volumes of payment transactions have placed significant burden on payment service providers or financial institutions to evaluate the risk profiles of customers swiftly. Various risk-related metrics of customers can be obtained from the data related to their payment transactions, and the recent development of machine learning-based modeling approaches allows these metrics to be modeled as a risk score. However, the shoe has on the other foot as providing such services has become a competitive game between players leading to the demand for near-native response time in serving customer requests. The services, therefore, require a cloud-native big data architecture where the data generation, ingestion, processing and modeling operations can be carried out at huge scales and low response and lead times while integrating the required principles of data governance and privacy. Cloud-native IoT systems collect vast volumes of data daily that forms the data lake for processing. Data processing includes both batch and event-driven processing. Batch processing is used for generating risk-related metrics where as event-driven processing is used for carrying out risk scoring. The ML models behind risk metrics are provided as services and lifelong learning is done by using CI/CD pipelines. Firewall and observability adopt a zero-trust policy to promote not just security but also privacy and governance compliance. Robust architecture has enormous readability and scalability features for tackling such diverse services. The entire architecture is illustrated with an example in the domain of payment service providers using a risk scoring system proposed in the previous work.
References
1. Benchaji, I., Douzi, S., El Ouahidi, B., & Jaafari, J. (2021). Enhanced credit card fraud detection based on attention mechanism and LSTM deep model. Journal of Big Data, 8, Article 151.
2. Barrak, A., Petrillo, F., & Jaafar, F. (2022). Serverless on machine learning: A systematic mapping study. IEEE Access, 10, 99337–99352.
3. Chang, V., Doan, L. M. T., Di Stefano, A., Sun, Z., & Fortino, G. (2022). Digital payment fraud detection methods in digital ages and Industry 4.0. Computers & Electrical Engineering, 100, Article 107734.
4. Mangalampalli, B. M. (2024). Transparent Intelligence Explainability Frameworks for AI-Driven Clinical Decision Support in Healthcare Business Intelligence. International Journal of Research Publications in Engineering, Technology and Management (IJRPETM), 7(3), 10566-10579.
5. Cherif, A., Badhib, A., Ammar, H., Alshehri, S., Kalkatawi, M., & Imine, A. (2023). Credit card fraud detection in the era of disruptive technologies: A systematic review. Journal of King Saud University—Computer and Information Sciences, 35(1), 145–174.
6. Dastidar, K. G., Caelen, O., & Granitzer, M. (2024). Machine learning methods for credit card fraud detection: A survey. IEEE Access, 12, 158939–158965.
7. Diaz-de-Arcaya, J., Torre-Bastida, A. I., Zárate, G., Miñón, R., & Almeida, A. (2024). A joint study of the challenges, opportunities, and roadmap of MLOps and AIOps: A systematic survey. ACM Computing Surveys, 56(4), Article 84.
8. Femila Roseline, J., Naidu, G. B. S. R., Samuthira Pandi, V., Alamelu alias Rajasree, S., & Mageswari, N. (2022). Autonomous credit card fraud detection using machine learning approach. Computers & Electrical Engineering, 102, Article 108132.
9. Bandi, V. D. V. K. (2024). Intelligent Data Platforms For Personalized Retail Analytics At Scale. Metallurgical and Materials Engineering, 30 (4), 1011–1027.
10. Ghaleb, F. A., Saeed, F., Al-Sarem, M., Qasem, S. N., & Al-Hadhrami, T. (2023). Ensemble synthesized minority oversampling-based generative adversarial networks and random forest algorithm for credit card fraud detection. IEEE Access, 11, 89694–89710.
11. Hernandez Aros, L., Bustamante Molano, L. X., Gutierrez-Portela, F., Moreno Hernandez, J. J., & Rodríguez Barrero, M. S. (2024). Financial fraud detection through the application of machine learning techniques: A literature review. Humanities and Social Sciences Communications, 11, Article 1130.
12. Ileberi, E., Sun, Y., & Wang, Z. (2022). A machine learning based credit card fraud detection using the GA algorithm for feature selection. Journal of Big Data, 9, Article 24.
13. Kennedy, R. K. L., Villanustre, F., Khoshgoftaar, T. M., & Salekshahrezaee, Z. (2024). Synthesizing class labels for highly imbalanced credit card fraud detection data. Journal of Big Data, 11, Article 38.
14. Kolla, S. H. (2024). Retrieval-Augmented Enterprise Intelligence: Enhancing Accuracy, Trust, and Operational Decision-Making. International Journal of Future Innovative Science and Technology (IJFIST), 7(2), 12425.
15. Kreuzberger, D., Kühl, N., & Hirschl, S. (2023). Machine learning operations (MLOps): Overview, definition, and architecture. IEEE Access, 11, 31866–31879.
16. Leevy, J. L., Hancock, J., Khoshgoftaar, T. M., & Abdollah Zadeh, A. (2023). Investigating the effectiveness of one-class and binary classification for fraud detection. Journal of Big Data, 10, Article 157.
17. Mienye, I. D., & Sun, Y. (2023). A machine learning method with hybrid feature selection for improved credit card fraud detection. Applied Sciences, 13(12), Article 7254.
18. Mienye, I. D., & Jere, N. R. (2024). Deep learning for credit card fraud detection: A review of algorithms, challenges, and solutions. IEEE Access, 12, 96893–96910.
19. Salam, M. A., Fouad, K. M., Elbably, D. L., & Elsayed, S. M. (2024). Federated learning model for credit card fraud detection with data balancing techniques. Neural Computing and Applications, 36, 6231–6256.
20. Kolla, S. K. (2024). Clinical Knowledge Intelligence through Deep Learning and Natural Language Understanding in Healthcare Platforms. International Journal of Advanced Engineering Science and Information Technology (IJAESIT), 7(3), 14088.
21. Shankar, S., Garcia, R., Hellerstein, J. M., & Parameswaran, A. G. (2024). “We have no idea how models will behave in production until production”: How engineers operationalize machine learning. Proceedings of the ACM on Human-Computer Interaction, 8(CSCW1), Article 206.
22. Sulaiman, R. B., Schetinin, V., & Sant, P. (2022). Review of machine learning approach on credit card fraud detection. Human-Centric Intelligent Systems, 2, 55–68.
23. Tang, Y., & Liang, Y. (2024). Credit card fraud detection based on federated graph learning. Expert Systems with Applications, 256, Article 124979.
24. Yandamuri, U. S. (2023). An Intelligent Analytics Framework Combining Big Data and Machine Learning for Business Forecasting. Zenodo.
25. Talukder, M. A., Khalid, M., & Uddin, M. A. (2024). An integrated multistage ensemble machine learning model for fraudulent transaction detection. Journal of Big Data, 11, Article 168.
26. Testi, M., Ballabio, M., Frontoni, E., Iannello, G., Moccia, S., Soda, P., & Vessio, G. (2022). MLOps: A taxonomy and a methodology. IEEE Access, 10, 63606–63618.
27. Zhou, Y., Li, H., Xiao, Z., & Qiu, J. (2023). A user-centered explainable artificial intelligence approach for financial fraud detection. Finance Research Letters, 58, Article 104309.
28. DAVULURI, P. N. (2022). Cloud-Native Data Platform Modernization for Regulatory Compliance in Global Banking. Kurdish Studies.
29. Breskuvienė, D., & Dzemyda, G. (2024). Enhancing credit card fraud detection: Highly imbalanced data case. Journal of Big Data, 11, Article 182.
30. Chhabra, R., Goswami, S., & Ranjan, R. K. (2024). A voting ensemble machine learning based credit card fraud detection using highly imbalance data. Multimedia Tools and Applications, 83(18), 54729–54752.
31. Almubark, I. (2024). Advanced credit card fraud detection: An ensemble learning using random under sampling and two-stage thresholding. IEEE Access, 12, 192079–192089.