Scalable ETL Processes with Change Data Capture (CDC) and Monitoring Using Apache Superset

Trajkovska, Aneta and Manevska, Violeta and Veljanovska, Kostandina (2025) Scalable ETL Processes with Change Data Capture (CDC) and Monitoring Using Apache Superset. In: 15th International Conference on Applied Internet and Information Technologies (AIIT2025), November 7, 2025, Bitola, Macedonia.

[thumbnail of AIIT2025_P35_f .pdf] Text
AIIT2025_P35_f .pdf

Download (786kB)

Abstract

In an increasingly data-driven world, the ability to monitor and respond to real-time changes is critical across various domains, including marketing, transportation, and other dynamic sectors. Timely access to up-to-date information enables organizations to make informed decisions and adapt quickly to changing conditions. This paper presents a study on the implementation of a real-time data monitoring solution that leverages Change Data Capture (CDC) techniques for capturing updates across data sources. Furthermore, it explores the integration of real-time visualization tools, such as Apache Superset, to provide immediate insights and improve situational awareness. The proposed approach facilitates continuous tracking of data changes and supports decision-making processes through intuitive and dynamic dashboards. The research highlights the architectural components, key technologies, and practical benefits of deploying such systems in modern data environments.

Item Type: Conference or Workshop Item (Paper)
Subjects: Scientific Fields (Frascati) > Engineering and Technology > Electrical engineering, electronic engineering,information engineering
Divisions: Faculty of Information and Communication Technologies
Depositing User: Prof. d-r. Kostandina Veljanovska
Date Deposited: 09 Mar 2026 01:24
Last Modified: 09 Mar 2026 01:24
URI: https://eprints.uklo.edu.mk/id/eprint/11415

Actions (login required)

View Item View Item