Designed and migrated 30+ scalable ETL/ELT pipelines using Python, SQL, PySpark, and Databricks, integrating data from OLTP systems into OLAP platforms such as Snowflake, Delta Lake, and Google BigQuery for enterprise analytics. Contributed to data modernization initiatives by implementing the Medallion Architecture (Bronze, Silver, Gold), improving data quality, governance, and reliability while delivering business-ready datasets for reporting and analytics in the US Mortgage Originations business. Implemented data quality checks, monitoring logic, and performance optimizations using Splunk and ETL audit frameworks to ensure reliable, high-volume data processing across distributed systems. Designed and developed Snowpark-based Snowflake stored procedures for scalable data transformation, validation, and curation, enabling analytics-ready data models for the MSP business. Built a custom Python REST API framework on Databricks using PySpark and Kafka to ingest Dynamics CRM data via the Fetch API, replacing ADF and SSIS pipelines and achieving approximately $2,000 per month in cost savings. Automated the CI/CD deployment of 500+ Databricks ETL jobs using Databricks REST APIs and Azure DevOps, eliminating manual deployment efforts, improving release reliability, and accelerating delivery. Supported cloud migration and platform consolidation by migrating 250+ ETL jobs from ADF, SSIS, and IBM DataStage to GCP Databricks, enhancing scalability and reducing infrastructure costs through the use of job clusters. Collaborated with cross-functional teams, including business, analytics, and data architecture, to translate reporting requirements into scalable enterprise data solutions, delivering more than $100K in measurable business value.
Developed an app from scratch using Android Studio and acquired expertise in Python's Flask framework to build a server for API calls. Gained valuable experience in startup dynamics and collaborated on creating a REST API for web and mobile applications, ensuring seamless communication with MongoDB and implementing robust error handling and logging across endpoints. Successfully delivered a comprehensive web (Staff Admin Portal) and mobile (Students Exam App) application designed specifically for visually impaired students, featuring innovative Text-to-Speech and Speech-to-Text functionalities to enhance exam attendance.
B. TECH IT
(2018 - 2022)
Office Bearer - General Secretary of IoT and General Secretary of Alumni Club
XII - Computer Science
(2017 - 2018)
Achieved - 2nd Place for Zero Power Computing(National Level), Best Monitor Award in 12th Standard
3C Q3 Champion Award 2023 (Mr. Cooper) – Awarded as Champion in 3rd Quarter 2023 across the Organization.
Azure Databricks Data Engineer Associate (Microsoft) – (July 2026 – July 2027)
Azure Administrator (Microsoft) – (May 2026 – May 2027)
Azure Solution Architect Expert (Microsoft) – (May 2026 – May 2027)
SnowPro Associate Platform Certification (Snowflake) – (Nov 2025 – Nov 2027)
SnowPro Core Certification (Snowflake) – (Sept 2025 – Sept 2027)
Databricks Certified Data Engineer Professional (Databricks) – (July 2025 – July 2027)
Databricks Fundamentals (Databricks) – (July 2025 – July 2026)
Contributed to Open Source JAMS PowerShell Project (JAMS Git Repo) – (June 2025)
Azure AI Fundamentals - AI 900 (Microsoft) – (April 2025)
Azure Data Engineer Associate - DP 203 (Microsoft) – (Feb 2025 – Feb 2026)
1 Credit Course on Visual Analytics - Conducted a session for Juniors on Visual Analytics (Apr 2024)
Languages - Python, T-SQL, Bash
ETL Tools - Databricks, Azure Data Factory (ADF), SQL Server Integration Service (SSIS)
Databases - MS SQL Server, MongoDB, Snowflake, Google BigQuery, Databricks Unity Catalog
Tools - Github Copilot, Azure DevOps, VS Code, SSMS, Kubernetes, Apache Airflow, Confluent Kafka, Fortra Jams
Cloud - Microsoft Azure, Google Cloud