Built and automated over 30+ ELT data pipelines to transfer data from OLTP databases (SQL Server, MySQL, and Postgres) to OLAP systems (Snowflake and Google BigQuery), utilizing a medallion architecture to incrementally cleanse, enrich, and aggregate data for business-ready SQL views that ensure accuracy and reliability in reporting. Collaborated closely with business users to align data outputs with analytics needs and developed Snowpark-based Snowflake stored procedures for data transformation across layers. Designed a Python custom module for performing CRUD operations using the Microsoft Web REST API Client to automate Dynamics CRM ETL jobs on GCP Databricks, replacing KingswaySoft SSIS components hosted on Azure Data Factory and achieving $2,000 per month in cost savings. Automated CI/CD deployment of Databricks IPython notebooks via REST APIs, eliminating manual effort in deploying 500+ ETL jobs through Azure DevOps, and created a JAMS scheduling workflow framework for triggering Snowflake stored procedures. Additionally, played a pivotal role in modernizing the enterprise data platform by migrating over 250+ ADF, SSIS, and IBM DataStage ETL jobs to GCP Databricks using reusable Python utility modules to streamline data movement across SQL Server, ADLS, GCS, Snowflake, and MongoDB—delivering $100K+ in cost benefits.
Developed an app from scratch using Android Studio and acquired expertise in Python's Flask framework to build a server for API calls. Gained valuable experience in startup dynamics and collaborated on creating a REST API for web and mobile applications, ensuring seamless communication with MongoDB and implementing robust error handling and logging across endpoints. Successfully delivered a comprehensive web (Staff Admin Portal) and mobile (Students Exam App) application designed specifically for visually impaired students, featuring innovative Text-to-Speech and Speech-to-Text functionalities to enhance exam attendance.
B. TECH IT
(2018 - 2022)
Office Bearer - General Secretary of IoT and General Secretary of Alumni Club
XII - Computer Science
(2017 - 2018)
Achieved - 2nd Place for Zero Power Computing(National Level), Best Monitor Award in 12th Standard
3C Q3 Champion Award 2023 (Mr. Cooper) – Awarded as Champion in 3rd Quarter 2023 across the Organization.
Snowflake SnowPro Core Certification (Snowflake) – (Sept 2025 – Sept 2027)
Databricks Certified Data Engineer Professional (Databricks) – (July 2025 – July 2027)
Databricks Fundamentals (Databricks) – (July 2025 – July 2026)
Contributed to Open Source Jams PowerShell Project (JAMS Git Repo) – (June 2025)
Azure AI Fundamentals - AI 900 (Microsoft) – (April 2025)
Azure Data Engineer Associate - DP 203 (Microsoft) – (Feb 2025 – Feb 2026)
1 Credit Course on Visual Analytics - Conducted a session for Juniors on Visual Analytics (Apr 2024)
Developed & Hosted a website for posting English Journal using MERN stack – http://www.iomjelm.in/
Languages - Python, T-SQL, Bash, JavaScript, React JS, Node JS
ETL Tools - Databricks, Azure Data Factory (ADF), SQL Server Integration Service (SSIS)
Databases - MS SQL Server, MongoDB, Snowflake, Google BigQuery, Databricks Unity Catalog
Tools - GIT, Azure DevOps, VS Code, SSMS, Kubernetes, Apache Airflow, Confluent Kafka, Fortra Jams
Cloud - Microsoft Azure, Google Cloud