Data Engineering Technical Lead having 15 years of experience with a proven track record of designing, implementing, and managing enterprise-scale data solutions.
Expert in SQL and Python with hands-on experience in Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Composer, and Dataproc to build and optimize scalable data pipelines.
Skilled in end-to-end ETL development, data warehousing, and integrating tools like Ab Initio to enable seamless data processing and analytics.
Experienced in leading cross-functional teams, driving project execution, and mentoring engineers to deliver high-impact solutions aligned with business objectives. Adept at solving complex technical challenges, ensuring best practices, and fostering innovation to enable data-driven decision-making across organizations.
Overview
16
16
years of professional experience
Work History
Sr. Tech Lead
Onix Datametica
Pune
03.2022 - Current
Lead the end-to-end migration of on-premise data warehouses to the Google Cloud Platform.
Define and enforce best practices for data architecture, ETL/ELT processes, and cloud infrastructure.
Provide technical guidance to a cross-functional team of data engineers, analysts, and cloud architects.
Design serverless architectures, leveraging Cloud Functions for event-driven computing.
Utilize Cloud Pub/Sub to develop real-time messaging and event streaming solutions.
Write, review, and optimize complex BigQuery SQL queries for data transformation and analysis
Develop custom data processing scripts using Python for automation and advanced data manipulation.
Develop and implement data pipelines using Dataflow and orchestrate workflows with Composer.
Design and develop intuitive dashboards and reports using Looker, enabling data-driven decision-making.
Conduct code reviews and enforce quality standards across the team.
Coordinate with project managers, DevOps teams, and business stakeholders to ensure timely delivery.
Tech Lead
Persistent System Ltd
Pune
12.2018 - 02.2022
Oversee the design and development of ETL processes using Ab Initio to ensure efficient data integration, transformation, and loading.
Manage data modeling, database design, and optimization for Oracle and Teradata environments.
Develop automation scripts and workflows using Python to streamline data processing and monitoring
Act as the primary point of contact between technical teams and business stakeholders.
Implement robust data governance practices to ensure data quality, security, and compliance.
Sr. Consultant
TransUnion
Chicago
11.2017 - 10.2018
Worked closely with clients and internal stakeholders to understand business needs and translate them into technical requirements.
Provided strategic guidance on data warehousing and ETL best practices to optimize data management and analytics.
Designed and implemented scalable, high-performance data warehouse architectures.
Developed, tested, and deployed ETL workflows using Ab Initio to extract, transform, and load data efficiently.
Collaborated on database design, data modeling, and schema optimization to support analytical needs.
System Analyst
Bitwise INC
Chicago
05.2011 - 09.2017
Design, build, and optimize ETL workflows and applications using the Ab Initio suite of tools, including Graphical Development Environment (GDE), Co>Operating System, and Enterprise Meta>Environment (EME).
Develop and maintain data pipelines to extract, transform, and load data across various systems and platforms.
Integrate data from multiple sources and ensure accuracy, consistency, and quality throughout the process.
Trainee Engineer
KPIT
Pune
07.2008 - 02.2011
Write, test, and optimize SQL queries to extract, manipulate, and analyze data.
Assist in creating and maintaining database objects, such as tables, views, stored procedures, and indexes in Oracle databases.
Perform basic database troubleshooting to identify and resolve issues.