Big Data processing chain for real-time air-traffic analysis. Data from the OpenAIP API is ingested and processed continuously, then surfaced on a map-based dashboard.
FIG. 01Real-time Big Data architectureEnd-to-end overview: continuous ingestion from the OpenAIP API, a Kafka message bus, distributed Spark processing and PostgreSQL storage.
FIG. 02Air-traffic monitoring dashboardMap-based view of the tracked flights in near real time.
FIG. 03Apache NiFi ingestion pipelineThe NiFi flow orchestrates collection and routing of the data into Kafka.
