Naveen Sudhakara Pai
Bengaluru
Summary
Results-driven Associate Data Engineer with 4 years of experience in optimizing ETL pipelines and data integration. Proficient in Impala, PostgreSQL, Hadoop and PySpark for seamless data processing and migration. Skilled in real-time data streaming with Kafka and Pulsar. Committed to enhancing data workflows and supporting data-driven decision-making.
Overview
4
4
years of professional experience
Work History
Associate Data Engineer
Cargill Business Services
Bengaluru
09.2020 - Current
- Crafted and optimized ETL pipelines, utilizing Impala and PostgreSQL, to facilitate incremental data loads from raw sources to structured data suitable for analytics and application use.
- Demonstrated success in building PySpark frameworks for seamless data integration from Impala to Aurora, enhancing ETL processes.
- Experienced in implementing real-time data streaming solutions with Kafka and Pulsar, driving efficient and scalable data consumption.
- Committed to leveraging technical skills to streamline data workflows and support data-driven decision-making.
Education
Bachelor of Engineering - Computer Science
St Joseph Engineering College
Mangalore08-2020
Skills
- Python
- SQL
- Spark
- Kafka
- Pulsar
- PostgreSQL
- Hadoop
- Oozie
- vela(CI/CD)
- Version Control Systems: Git, Github
Accomplishments
- First rank in Bachelor of Engineering in Computer Science & Engineering 2020 batch
- IEEEXTREME 12.0 -24 hr coding contest
Indian Ranking: 98
Global ranking:870
Timeline
Associate Data Engineer
Cargill Business Services
09.2020 - Current
Bachelor of Engineering - Computer Science
St Joseph Engineering College
Similar Profiles
Sathish RSathish R
Process Specialist at Cargill Business Services India Pvt Ltd, Cargill India Pvt. Ltd, CargillProcess Specialist at Cargill Business Services India Pvt Ltd, Cargill India Pvt. Ltd, Cargill
Oscar FernandesOscar Fernandes
Vessel Operator at Cargill Business ServicesVessel Operator at Cargill Business Services
SHANKAR RAMESH LSHANKAR RAMESH L
Corporate Finance Reporting Specialist at Cargill Business ServicesCorporate Finance Reporting Specialist at Cargill Business Services
Yaseer MohammedYaseer Mohammed
Associate Total Rewards Analyst at Cargill Business ServicesAssociate Total Rewards Analyst at Cargill Business Services
Praveen CPraveen C
Senior Software Engineer at L&T Technology ServicesSenior Software Engineer at L&T Technology Services