Ankit Kumar Jaiswal
Bengaluru
Summary
Senior Data engineer and Python developer with over 7.5 plus years of experience in designing and optimizing scalable ETL workflows and data platforms. Expertise in Python application development, data integration, and large-scale data processing. Proven track record in integrating data from APIs, logs, and third-party platforms into data warehouses and cloud environments such as Azure and AWS. Proficient in building time-series data products, data validation frameworks, and CI/CD pipelines using Jenkins and Git to deliver high-performance data solutions.
Overview
5
5
years of professional experience
1
1
Certification
Work History
Assistant Manager - Data Engineer
KPMG
02.2022 - Current
- Delivered data engineering solutions for global clients including bp(British Petroleum) and Goldman Sachs, building scalable and reliable cloud-based data platforms.
- Built and optimized scalable data pipelines to ingest data from multiple sources into centralized data warehouses and cloud storage platforms (Azure ADLS, AWS S3).
- Designed, implemented, and maintained high-performance databases and data lake architectures to securely store and process large volumes of structured and unstructured data.
- Designed and implemented an AWS-based data pipeline to extract data from multiple sources, store raw datasets in Amazon S3, perform transformations using AWS Lambda, load processed data into curated S3 layers, and enable analytics through Amazon Athena, integrating the results with Power BI for business reporting and visualization.
- Integrated and processed data from multiple sources including APIs, application logs, and third-party platforms such as Refinitiv and Asset Control, transforming them into unified datasets for analytics and reporting.
- Developed ETL/ELT workflows for data products such as time-series datasets, implementing metadata management and loading large-scale datasets into Azure and AWS cloud environments.
- Designed and implemented internal data engineering frameworks and reusable Python libraries for data ingestion, transformation, and processing.
- Automated repetitive data engineering tasks by building custom framework operators and reusable components, improving development efficiency and reducing manual effort.
- Implemented data validation, error handling, monitoring, and logging mechanisms to ensure high data accuracy, reliability, and pipeline stability.
- Automated CI/CD pipelines using Jenkins and Git for seamless deployment of data pipelines and data products across cloud platforms.
- Collaborated with business stakeholders, analysts, and engineering teams to gather requirements and deliver scalable, cloud-native data solutions.
- Enhanced data pipeline performance and scalability through code optimization, distributed processing, and process parallelization.
Software Engineer
Capgemini
10.2021 - 07.2022
- Engineered YAML configurations and scripts for containerizing EnodeB protocol layer binaries, orchestrated deployment in Kubernetes clusters, and implemented traffic capture and verification between UE and EnodeB using MME simulator.
- Engineered Python-based plugins for GPON network device interaction, enabling efficient data push and retrieval operations via NetConf protocol.
- Developed data pipelines interfacing with web microservices and Elastic Database, enhancing real-time data flow and visualization in MCP GUI.
Senior Software Engineer
Philips
07.2021 - 02.2022
- Designed software solutions to enhance patient monitoring systems at Philips.
- Developed Python features for exporting scanned images and structured reports to DICOM servers and PACS systems, improving data integration.
- Led code reviews to ensure quality and maintainability of software products.
- Authored unit tests and testing scenarios in Python, enhancing code quality and supporting reliable product delivery.
- Collaborated with cross-functional teams to define project requirements and specifications.
Education
B.E. - Computer Science & Engineering(CSE)
B M S Institute of Technology & Management
Bengaluru, Karnataka01.2018
Skills
- Python
- Polars and Pandas
- SQL
- REST API
- Flask
- Shell Scripting
- Selenium
- Microsoft Azure (Azure Data Factory, ADLS)
- AWS (S3, Lambda, Athena)
- PySpark
- Airflow
- ETL / ELT Pipeline Development
- Data Modeling
- Data Warehousing
- GIT & Jenkins
- MySQL
- Postgres
- Docker
- Kubernetes
Websites
Certification
- DP 203: Microsoft Certified Azure Data Engineer Associate
- DP 900: Microsoft Certified Azure Data Fundamentals
- AZ 900: Microsoft Certified Azure Fundamentals
- Python For Developers
Timeline
Assistant Manager - Data Engineer
KPMG
02.2022 - Current
Software Engineer
Capgemini
10.2021 - 07.2022
Senior Software Engineer
Philips
07.2021 - 02.2022
B.E. - Computer Science & Engineering(CSE)
B M S Institute of Technology & Management