EduFlow
International education analytics platform
- 01
Kafka
Streams student events in
- 02
S3
Events land in object storage
- 03
Airflow + PySpark
DAGs orchestrate and process the data
- 04
PostgreSQL
Staging layer for cleaned data
- 05
dbt star schema
Warehouse for enrollment, visa and program analytics
- 06
FastAPI
Chart.js dashboard of pipeline metrics
An end-to-end, event-driven platform simulating a university's international student data pipeline, from streaming ingestion to an analytics dashboard.
- ▸Ingests events via Kafka into S3 object storage, orchestrated with Airflow DAGs and processed with PySpark into a PostgreSQL staging layer
- ▸dbt star schema warehouse for analytics on student enrollment, visa compliance and program performance
- ▸FastAPI + Chart.js dashboard surfacing pipeline metrics and analytics, containerized with Docker
- ▸CI with GitHub Actions; Kubernetes manifests and Terraform for deployment
