Accomplishments

Harnessing Insights from Streams: Unlocking Real-Time Data Flow with Docker and Cassandra in the Apache Ecosystem


  • Details
  • Share
Category
Conference
Authors
Jay Oza, Abhijit Patil & Chirag Maniyath
Conference Name
IEEE Recent Advances in Intelligent Computational Systems (RAICS)
Conference From
14-May-2024
Conference To
16-May-2024
Conference Venue
Kothamangalam, Kerala, India
  • Abstract

Real-time data streaming pipelines are immensely valuable in today's data-driven world since they enable continuous data processing and analytics. This research paper provides a comprehensive exploration of the architecture, development, and deployment of an advanced real-time data streaming pipeline. It utilizes Docker for containerization, Apache Kafka for distributed streaming, Apache Spark for dynamic data transformation, and Cassandra for efficient NoSQL storage. The study outlines the intricacies of integrating these technologies, examining the pipeline's components, functionalities, performance metrics, and potential applications. Through this case study, the paper show-cases the efficacy of open-source tools in constructing highly scalable and resilient data streaming pipelines.

© Somaiya 2025 / All rights reserved.
Get in Touch