Summary
Overview
Work History
Education
Skills
Websites
Accomplishments
Professional Accomplishments
Affiliations
Languages
Certification
Timeline
Generic
Jagdeep Chauhan

Jagdeep Chauhan

Bangalore

Summary

Data Engineering Manager with 11 years of extensive experience in building data-intensive applications and leading ETL activities within enterprise organizations. Proficient in managing and mentoring cross-functional teams, translating complex business requirements into efficient data solutions, and developing customized data transformation processes. Demonstrates exceptional organizational, communication, and relationship-building skills. Adept at strategic planning, resource allocation, and project management to ensure the delivery of high-quality data solutions that meet business needs and drive data-driven decision-making.

Overview

11
11
years of professional experience
1
1
Certification

Work History

Data Engineering Manager

Koch IT Solutions
Bangalore
01.2022 - Current
  • Team Leadership: Led a team of 10+ data engineers in developing and maintaining data pipelines and ETL processes, ensuring high data quality and integrity.
  • Strategic Planning: Developed and implemented data engineering strategies aligned with business objectives, resulting in a 20% increase in data processing efficiency.
  • Process Optimization: Streamlined data workflows and ETL processes, reducing processing time by 30% and improving overall system performance.
  • Data Solutions: Designed and delivered data solutions to support business intelligence and analytics initiatives, enabling data-driven decision-making.
  • Cross-Functional Collaboration: Worked closely with data scientists, analysts, and business stakeholders to gather requirements, develop data models, and provide actionable insights.
  • Mentorship: Provided mentorship and professional development opportunities for team members, enhancing their technical skills and career growth.
  • Project Management: Managed multiple projects simultaneously, ensuring timely delivery of data solutions and adherence to project timelines and budgets.
  • Cloud Integration: Led the integration of cloud technologies (AWS, Azure) into the data infrastructure, improving scalability and flexibility.
  • Security and Compliance: Ensured data security and compliance with industry standards and regulations, implementing best practices for data governance.
  • Results-Oriented: Drive results and outcomes that have a measurable impact on the organization's data capabilities and business objectives.
  • Vendor Management: Evaluate and select external vendors, consultants, and service providers for data engineering projects, negotiating contracts and ensuring deliverables meet quality standards.
  • Stakeholder Engagement: Build and maintain strong relationships with key stakeholders, including executives, department heads, and external partners, to ensure alignment of data initiatives with business objectives.
  • Disaster Recovery Planning: Develop and implement disaster recovery and business continuity plans to minimize data loss and downtime in the event of system failures or disruptions.
  • Conflict Resolution: Address conflicts and disagreements within the data engineering team or with stakeholders, fostering a positive and collaborative work environment conducive to high performance and innovation.
  • Customer Focus: Collaborate with internal and external customers to understand their data needs and requirements, delivering solutions that add value and drive business outcomes.
  • Training and Development: Organize training programs, workshops, and knowledge-sharing sessions to enhance the technical skills and domain expertise of the data engineering team.
  • Data Architecture: Design and maintain data architecture frameworks, models, and standards to support scalability, flexibility, and interoperability of data systems.
  • Budget Management: Manage departmental budgets, including resource allocation, procurement of tools and technologies, and cost control measures.

Software Development Engineer

Intel India Corporation
Bangalore
01.2015 - 01.2022
  • ETL Processes: Designed, developed, and maintained ETL processes using Informatica to ensure efficient data integration and management.
  • AutoSys Job Scheduling: Automated data extraction, transformation, and loading processes by scheduling AutoSys jobs, enhancing data workflow efficiency.
  • Web Services Development: Developed and implemented web services in Java to facilitate data publishing to downstream applications.
  • Data Quality Management: Ensured data accuracy and integrity through robust validation and quality checks during data migration and transformation processes.
  • Complex SQL Queries: Developed complex SQL queries for data extraction and analysis, supporting business intelligence and reporting needs.
  • Database Management: Managed MS SQL Server databases, including performance tuning, indexing, and schema design.
  • Data Pipeline Automation: Implemented automated data pipelines to streamline data processing and reduce manual intervention.
  • Performance Optimization: Optimized data processing performance through efficient ETL design and implementation.
  • Data Integration: Integrated data from multiple sources to create unified and comprehensive datasets for analysis.
  • Data Security: Implemented data security measures to protect sensitive information during extraction, transformation, and loading processes.
  • Data Warehousing: Designed and maintained data warehouses to store and organize large volumes of data for business intelligence purposes.
  • Data Transformation: Utilized data transformation tools and techniques to convert raw data into structured formats suitable for analysis.
  • API Integration: Integrated external APIs to enrich datasets with additional information from third-party services.
  • Data Governance: Implemented data governance frameworks to ensure data consistency, quality, and compliance with regulatory standards.
  • Metadata Management: Developed and maintained metadata repositories to track data lineage and support data discovery.
  • Real-time Data Processing: Implemented real-time data processing solutions to enable timely and accurate data updates.
  • Data Profiling: Conducted data profiling to understand data characteristics and identify data quality issues.
  • Monitoring and Logging: Set up monitoring and logging systems to track data processing workflows and quickly identify and resolve issues.
  • Documentation: Created comprehensive documentation for data engineering processes, ETL workflows, and data models to facilitate knowledge sharing and maintenance.
  • Version Control: Used version control systems like Git to manage code changes and collaborate with other team members on data engineering projects.

Intern

Intel
Bangalore
07.2013 - 12.2014
  • ETL Assistance: Assisted in developing and testing ETL processes and data integration solutions, gaining hands-on experience with SQL Server, Informatica, and data analysis techniques.
  • Data Analysis: Supported data analysis tasks by preparing datasets, running queries, and generating reports to assist senior engineers.
  • Software Development: Contributed to the development of small-scale software modules in C# and Java, gaining practical experience in coding and debugging.
  • Project Support: Assisted in various project tasks including documentation, testing, and data validation, providing valuable support to the project teams.

Education

M. Tech (Work Integrated) in Data Science -

Birla Institute of Technology And Science, Pilani
01.2021

B. Tech in Computer Science -

Punjab Technical University, Punjab
01.2015

3 years Diploma in Computer Science -

PSBTE, Punjab
01.2011

Skills

  • Building High Performing Teams
  • People Coaching and Development
  • Workforce Management
  • Resource Allocation
  • Cross-Functional Leadership
  • Mentorship and Professional Development
  • Communication and Collaboration
  • Strategic Planning
  • Performance Management
  • Conflict Resolution
  • Change Management
  • Decision Making
  • Data Security and Compliance
  • Data-Driven Decision Making
  • Technical Leadership
  • Stakeholder Relationship Management
  • Data Virtualization
  • Data Catalog
  • Data Quality
  • Data Governance
  • Advanced SQL
  • Relational Databases
  • Data Warehousing
  • Informatica
  • ETL Processes
  • Data Analysis
  • Data Integration
  • Data Integration
  • Root Cause Analysis
  • Custom Solutions Development

Websites

Accomplishments

  • Received Division Recognition Awards at Intel for exceptional performance and team collaboration.
  • Recognized by stakeholders and peers for delivering high-quality data solutions.
  • Successfully led the migration of legacy data systems to modern cloud platforms, significantly enhancing scalability and reducing costs.

Professional Accomplishments

  • Worked on the Master data project for Non-Latin transformation of organizational data using Informatica/SQL/Custom Processing techniques which helped Intel to align more than 70% of its data with Industry/US standards, used DNB (DUNS & BRADSTREET) rules for some of the data mastering. Reduced 50% data processing/refining cost.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Informatica.
  • DQ: Continuously working on data quality and cleanup activities to keep the system flexible enough to handle more data effectively and to keep the record count within limit and compliant with DNB.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Affiliations

  • Social Activities: Actively participates in community service and social initiatives, contributing to local and global causes.
  • Team Activities: Organizes and leads team-building activities to foster collaboration and camaraderie within the team.

Languages

Punjabi
First Language
Hindi
Proficient (C2)
C2
English
Proficient (C2)
C2

Certification

  • SAFe® 4 Practitioner
  • IBM Data Science Professional
  • Azure Data Fundamentals
  • Azure Data Engineer Associate
  • Data Science & Machine Learning - Coursera

Timeline

Data Engineering Manager

Koch IT Solutions
01.2022 - Current

Software Development Engineer

Intel India Corporation
01.2015 - 01.2022

Intern

Intel
07.2013 - 12.2014

M. Tech (Work Integrated) in Data Science -

Birla Institute of Technology And Science, Pilani

B. Tech in Computer Science -

Punjab Technical University, Punjab

3 years Diploma in Computer Science -

PSBTE, Punjab

Similar Profiles

CREATE PROFILE
Jagdeep Chauhan