Development of data pipeline for processing of streaming data on a cloud platform

dc.contributor.advisorCherkasov, Dmytroen_US
dc.contributor.authorMaterynskyi, Volodymyr en_US
dc.date.accessioned2026-08-07T12:02:41Z
dc.date.available2026-08-07T12:02:41Z
dc.date.issued2026
dc.description.abstractAir quality monitoring is an important part of public health infrastructure worldwide, and in Ukraine it has become particularly important due to the combined impact of wartime fires and industrial emissions. Existing notification systems for Ukrainian cities operate on hourly readings with limited geographic coverage. This thesis presents the design, implementation, and evaluation of a streaming data pipeline that continuously ingests satellite readings from major Ukrainian cities, detects pollution events and visualises conditions on a live dashboard. The pipeline is organised as five loosely coupled stages spanning data ingestion, stream processing, aggregate storage, real-time visualisation, and email alerting. Load testing demonstrated sustained throughput of 414,000 records per minute with sub-minute latency, and an effective ceiling of approximately 1.79 million records per minute. The work contributes a reproducible reference implementation of streaming infrastructure for environmental monitoring, addressing the coverage and latency limitations of existing Ukrainian systems.en_US
dc.identifier.urihttps://ekmair.ukma.edu.ua/handle/123456789/40736
dc.language.isoen_USen_US
dc.statusfirst publisheden_US
dc.subjectstreaming data pipelineen_US
dc.subjectreal-time visualizationen_US
dc.subjectstream processingen_US
dc.subjectenvironmental monitoringen_US
dc.subjectscalable architectureen_US
dc.subjectbachelor`s thesisen_US
dc.titleDevelopment of data pipeline for processing of streaming data on a cloud platformen_US
dc.typeOtheren_US
Files
Original bundle
Now showing 1 - 2 of 2
Loading...
Thumbnail Image
Name:
Materynskyi_Bakalavrska_robota.pdf
Size:
480.33 KB
Format:
Adobe Portable Document Format
Loading...
Thumbnail Image
Name:
Materynskyi_Bakalavrska_robota_1.pdf
Size:
633.18 KB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description: