Nikhil Koul
Data Engineer
Bangalore
Summary
Knowledgeable Data Engineer with robust background in data architecture and pipeline development. Proven ability to streamline data processes and enhance data integrity through innovative solutions. Demonstrates advanced proficiency in SQL and Python, leveraging these skills to support cross-functional teams and drive data-driven decision-making.
Overview
8
8
years of professional experience
4
4
years of post-secondary education
1
1
Certification
Work History
Data Engineer
MAERSK GSC (INDIA) PVT. LTD.
05.2021 - Current
- Managed data processing pipelines to enhance the efficiency and reliability of data infrastructure.
- Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.
- Leveraging Apache Spark for distributed data processing, Python for scripting and data manipulation, and Azure services such as ADLS for storage.
- Managed robust ETL processes using Apache Airflow for workflow management, ensuring data consistency and integrity throughout the pipeline.
- Managed data quality checks and monitoring mechanisms to ensure data accuracy and consistency.
- Streamlined complex workflows by breaking them down into manageable components for easier implementation and maintenance.
- Designed scalable and maintainable data models to support business intelligence initiatives and reporting needs.
Data Engineer
Blackbuck Insights
10.2019 - 05.2021
- Worked on building a pipeline for Data Scientist and data management people.
- Good experience in handling different file formats like JSON, CSV and Parquet and compression techniques like snappy.
- Created data pipeline for different loan related applications, filter and load data from drop locations (S3/ SFTP Source location) in AWS S3 bucket into Dremio.
- Created various python related UDFs in Spark.
- Have good experience in performing the RCA of defects and providing the preventive measures to prevent defect occurrence in future.
- Good experience in dealing with Business stakeholders.
Software Engineer
DXC Technology (Hewlett Packard Enterprise)
09.2016 - 08.2019
- Analyzed proposed technical solutions based on customer requirements.
- Have good experience in performing the RCA of defects and providing the preventive measures to prevent defect occurrence in future.
- Have good experience in analysis of business problems and providing effective solutions by using different technologies.
- Automated routine tasks, freeing up valuable developer time for more complex problem-solving.
- Improved software performance by identifying and resolving bottlenecks in the code.
- Refactored legacy code bases for improved maintainability, paving the way for easier future updates.
Education
Bachelor of Technology - Electronics & Communication
Chandigarh Group Of Colleges
Mohali 07.2012 - 07.2016
Skills
Python
undefinedCertification
Post Graduate Certificate in Data Science and Machine Learning from IIT Roorkee
Timeline
Data Engineer
MAERSK GSC (INDIA) PVT. LTD.
05.2021 - Current
Data Engineer
Blackbuck Insights
10.2019 - 05.2021
Software Engineer
DXC Technology (Hewlett Packard Enterprise)
09.2016 - 08.2019
Bachelor of Technology - Electronics & Communication
Chandigarh Group Of Colleges
07.2012 - 07.2016
Similar Profiles
Somayajulu NukalaSomayajulu Nukala
Engineering Manager at Maersk GSC India Pvt Ltd.Engineering Manager at Maersk GSC India Pvt Ltd.
PRASHANTHI KOTHAPRASHANTHI KOTHA
Software Engineer at Maersk GSC India PVT LtdSoftware Engineer at Maersk GSC India PVT Ltd
Rohit Kailash SatiRohit Kailash Sati
Process Expert (OTCX) at Maersk GSC(INDIA) Pvt. LtdProcess Expert (OTCX) at Maersk GSC(INDIA) Pvt. Ltd