Yash Dubey
Data Engineer
Noida,UP
Summary
Results-focused data professional equipped for impactful contributions. Expertise in designing, building, and optimizing complex data pipelines and ETL processes. Strong in SQL, Python, and cloud platforms, ensuring seamless data integration and robust data solutions. Known for excelling in collaborative environments, adapting swiftly to evolving needs, and driving team success.
Overview
1
1
Certificate
9
9
years of professional experience
Work History
Software Development Engineer 4
IQVIA
08.2021 - Current
- Implementation Lead for Incentive Compensation (IC) process, managing resource allocation, planning, and forecasting across global projects to ensure on-time, high-quality delivery.
- Established and led an automation team under VP leadership, driving initiatives that reduced manual activities by 25–30%, improving efficiency, and enabling scale.
- Implemented scalable data architectures for multiple incentive compensation projects in the MedTech space, building reporting dashboards on star schema models for accurate and efficient insights.
- Automated ETL operations reduce manual effort, save significant processing hours, and ensure pipeline stability and data integrity across tenants.
- Designed reusable, generic data frameworks that supported multi-tenant deployments, improving scalability, and reducing future implementation effort.
- Collaborated with cross-functional teams (system architects, analysts, business teams, and QA teams) to gather requirements, define solutions, and deliver robust data pipelines that meet functionality, scalability, and performance needs.
- Designed and optimized large-scale ETL pipelines using Databricks and PySpark, transforming complex datasets, and integrating them into Snowflake for scalable reporting, analytics, and downstream business intelligence use cases.
- Conducted in-depth data analysis, identifying anomalies, trends, and risks to strengthen internal controls, and support better decision-making.
- Created and maintained data standards, documentation, and analytics protocols, ensuring data governance and compliance across projects.
- Led project design and delivery, managing multiple projects simultaneously, with strong organizational and time management skills.
- Developed database architectural strategies at modeling, design, and implementation stages to address business or industry requirements.
Consultant
A&H Infotech
03.2021 - 07.2021
- Designed integration tools to combine data from multiple, varied data sources such as Redshift, files and big data installations.
- Worked independently to design, develop and test code for Sony Music using Pyspark.
- Learned and implemented Pyspark along with AWS in order to get
better understanding of project - Worked with Big Data Analytical problem , applied ETL using spark framework .
- Designed and created ETL code installations, aiding in transitions from one data warehouse to another.
- Interpreted data models for conversion into ETL diagrams and code.
- Verified performance and reliability of development database transformation solutions via extensive simulation testing.
- Collaborated with business intelligence staff at customer facilities to produce customized ETL solutions for specific goals.
- Documented and communicated database schemas using accepted notations.
Senior Data Analyst
Infosys(EY Transition)
08.2019 - 03.2021
- Analyzed large amounts of data to identify trends and find patterns, signals and hidden stories within data.
- Used business objects, business intelligence and other reporting tools to extract data from data solutions and data warehouses.
- Performed root-cause analysis on data-related system problems to recommend or execute corrective action.
- Developed database objects, including tables, views using SQL
- Analyzed SAP transactions to build logical business intelligence model.
- Identified and documented detailed business rules and use cases based on requirements analysis.
- Developed database objects, including tables, views using SQL. Produced monthly reports using advanced Excel spreadsheet functions.
- Documented business workflows for stakeholder review
- Collaborated with stakeholders to identify business needs and data sources.
- Used SQL ,ETL ,OLAP concept with Power BI and Power Query to create reports and recommended courses of action to upper management.
Advanced Analyst
Ernst and Young
04.2018 - 07.2019
- Collected data and developed detailed spreadsheets to identify trends and create revenue, profitability, and expense forecasts.
- Reviewed financial reports and streamlined operations to increase productivity.
- Synthesized current business intelligence data to produce reports and polished presentations, highlighted findings and recommended changes.
- Developed database objects, including tables, views using SQL.
- Produced monthly reports using advanced Excel spreadsheet
functions. - Designed and developed schema data models.
- Documented business workflows for stakeholder review.
- Identified and documented detailed business rules and use cases
based on requirements analysis. - Participated in requirements meetings and data mapping sessions to understand business needs.
- Updated organizational and process of subsystems to improve and
streamline data collection. - Analyzed SAP transactions to build logical business intelligence model for real-time reporting needs.
- Used SQL ,ETL ,OLAP concept with Power BI and Power Query to create reports and recommended courses of action to upper management.
Software Engineer
Capegemini
03.2017 - 04.2018
- Performed duties in accordance with all applicable standards, policies and regulatory guidelines to promote safe working environment.
- Worked on Informatica Power Centre tool- Source Analyzer, Data-warehousing designer, Mapping and Mapplet designer
- Responsible for extraction of data from different sources system to Staging area and loaded data to target database by ETL process
- Worked on various transformation like filter for flat files to identify source and target bottlenecks
- Developed and maintained ETL (Data Extraction, Transformation and Loading) mappings using Informatica Designer
- Responsible for fixing problem- Defect solving, testing existing mappings and workflow
- Coordination with users, workflow, individual modules
- Carried out day-day-day duties accurately and efficiently.
- Maintained energy and enthusiasm in fast-paced environment.
- Designed data models for analysis needs.
Education
Bachelor of Technology - Information Technology
BBD NIIT
Lucknow08.2016
Senior Secondary - Maths, Computers
St. Joseph Montessori School
Lucknow06.2011
Higher Secondary - Science, Computer Applications
St. Joseph Montessori School
Lucknow06.2009
Skills
Team Leadership & Development
ETL development
Snowflake,Oracle,Amazon Redshift
Data pipeline design,Data modeling
Data warehousing, Data Governance
Pyspark,Python
Big data processing, Databricks
Project Management, People Management
DSA(basic to intermediate)
Work Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Certification
Certified Oracle SQL Expert
Quote
The mind is everything. What you think, you become.
Gautama Buddha
Timeline
Software Development Engineer 4
IQVIA
08.2021 - Current
Consultant
A&H Infotech
03.2021 - 07.2021
Senior Data Analyst
Infosys(EY Transition)
08.2019 - 03.2021
Advanced Analyst
Ernst and Young
04.2018 - 07.2019
Software Engineer
Capegemini
03.2017 - 04.2018
Bachelor of Technology - Information Technology
BBD NIIT
Senior Secondary - Maths, Computers
St. Joseph Montessori School
Higher Secondary - Science, Computer Applications
St. Joseph Montessori School