Real-Time Risk Analytics with Data Engineering Pipelines
DOI:
https://doi.org/10.15662/IJARCST.2025.0803013Keywords:
real-time analysis, data risk, data thing, data pipe stream data.Abstract
Risk analysis in real-time is now a staple in the contemporary organization with focus being observed in the financial sector, health sector, and the manufacturing unit. Because of the latest tools in data engineering, large data sets can be analyzed and quickly red flagged in case of risks. This approach entails the ability to take stock of data and then blend, integrate and make sense of it through the use of rapidly advancing technology tools including stream processing, cloud computing, and machine learning, among others. Through these pipelines, risks are prevented in advance, losses are reduced and optimum performance is created by organizations. Based on the analysis of the real-time applications, problems, and perspectives of risk analytics, this paper elaborates real-time risk analytics with detail information.
References
1. Atri, P. (2018). Design and Implementation of High-Throughput Data Streams using Apache Kafka for Real-Time Data Pipelines. International Journal of Science and Research (IJSR), 7(11), 1988-1991. https://www.researchgate.net/profile/Preyaa-Atri/publication/381600574_Design_and_Implementation_of_High-Throughput_Data_Streams_using_Apache_Kafka_for_Real-Time_Data_Pipelines/links/6675c32c1846ca33b842efda/Design-and-Implementation-of-High-Throughput-Data-Streams-using-Apache-Kafka-for-Real-Time-Data-Pipelines.pdf
2. Brynjolfsson, E., & McAfee, A. (2014). The second machine age: Work, progress, and prosperity in a time of brilliant technologies. WW Norton & company. https://books.google.com/books?hl=en&lr=&id=WiKwAgAAQBAJ&oi=fnd&pg=PA1&dq=Brynjolfsson,+E.,+%26+McAfee,+A.+(2014).+The+second+machine+age:+Work,+progress,+and+prosperity+in+a+time+of+brilliant+technologies.+W.+W.+Norton+%26+Company.&ots=4-WrZiYvec&sig=TbqWcGTMjbkkPiw_HLfQNeKtdB0
3. Costa, C., & Santos, M. Y. (2017). Big Data: State-of-the-art Concepts, Techniques, Technologies, Modeling Approaches, and Research Challenges. IAENG International Journal of Computer Science, 44(3). http://www.iaeng.org/IJCS/issues_v44/issue_3/IJCS_44_3_04.pdf
4. Kolajo, T., Daramola, O., & Adebiyi, A. (2019). Big data stream analysis: a systematic literature review. Journal of Big Data, 6(1), 47. https://link.springer.com/article/10.1186/s40537-019-0210-7
5. Kumar, S., Tiwari, P., & Zymbler, M. (2019). Internet of Things is a revolutionary approach for future technology enhancement: a review. Journal of Big Data, 6(1), 1-21. https://link.springer.com/article/10.1186/s40537-019-0268-2%23article-info
6. Maitrey, S., & Jha, C. K. (2015). MapReduce: simplified data analysis of big data. Procedia Computer Science, 57, 563-571. https://www.sciencedirect.com/science/article/pii/S1877050915019213
7. Malek, Y. N., Kharbouch, A., El Khoukhi, H., Bakhouya, M., De Florio, V., El Ouadghiri, D., ... & Blondia, C. (2017). On the use of IoT and big data technologies for real-time monitoring and data processing. Procedia computer science, 113, 429-434. https://www.sciencedirect.com/science/article/pii/S1877050917316903
8. Stonebraker, M., & Çetintemel, U. (2018). "One size fits all"—an" idea whose time has come and gone. In Making databases work: the pragmatic wisdom of Michael Stonebraker (pp. 441-462). https://dl.acm.org/doi/abs/10.1145/3226595.3226636


