A structured overview of data engineering projects I did in enterprise environment
ETL PIPELINE
Architected a fault-tolerant ingestion pipeline processing 50TB+ daily transaction data into Snowflake using Airflow and Spark.
REAL-TIME ANALYTICS
Designed a low-latency Kafka architecture for real-time sensor data analysis, enabling sub-second alerting for predictive maintenance.
CLOUD MIGRATION
Led the end-to-end migration of a decade-old SQL Server warehouse to Azure Synapse, reducing query times by 40%.
REAL-TIME ANALYTICS
Designed a low-latency Kafka architecture for real-time sensor data analysis, enabling sub-second alerting for predictive maintenance.
CLOUD MIGRATION
Led the end-to-end migration of a decade-old SQL Server warehouse to Azure Synapse, reducing query times by 40%.
ETL PIPELINE
Architected a fault-tolerant ingestion pipeline processing 50TB+ daily transaction data into Snowflake using Airflow and Spark.
REAL-TIME ANALYTICS
Designed a low-latency Kafka architecture for real-time sensor data analysis, enabling sub-second alerting for predictive maintenance.