Real-time observability for data pipelines — catches bad data and failed runs before anyone downstream notices.
- Built on a bronze → silver → gold medallion architecture with FastAPI, PostgreSQL, Airflow, and dbt, handling 10,000+ events per day at sub-200ms latency.
- Automated data-quality checks intercept bad records before they propagate; a live Next.js dashboard streams pipeline health over WebSockets and flags anomalies as they happen.
- Containerized with Docker and shipped through Kubernetes with GitHub Actions CI/CD, cutting failure detection from hours to under 10 seconds.
