Kinjal Dutta Choudhury
Data Engineer
Bangalore
Summary
GCP certified Professional Data Engineer with 5 years of experience in building ETL pipelines and maintaining backend databases for data intensive products and applications.
Overview
5
5
years of professional experience
4
4
years of post-secondary education
1
1
Certification
Work History
Senior Data Engineer
Willow Innovations
Bangalore
01.2022 - Current
- Set up backend data pipelines for IoT devices using Python, BigQuery and Airflow.
- Built a logical data deletion framework to ensure compliance with American Data Privacy and Protection Act.
- Built an automated data testing framework using Airflow for performing regular checks on pipeline stability.
- Designed database schemas using Dimension and Facts tables.
- Actively worked towards improving the legacy operational costs and bring it down to 50% in 2 months
Member of Technical Staff (Data Engineering)
CapitalFloat
Bangalore
04.2021 - 12.2021
- Participated in continuous improvement of existing ETL infrastructure and parallelize pipelines thus bringing down the processing time by more than 60%.
- Developed and implemented streaming ETL pipelines using AWS Lambda.
- Handled incoming financial data in the range of 75-100 GB every day for a loan management system.
Data Engineer
Datalicious (An Equifax Company)
Bangalore
05.2018 - 03.2021
- Worked closely in a team of 6 for building a realtime recommendation system for one of the biggest publishers in New Zealand. Handled live requests with a response time < 1 second.
- Developed and automated ETL pipelines using Apache Beam on Dataflow for terabytes of batch data using Airflow.
- Extensively used Google Cloud Platform services to maintain backend databases for our media attribution product and ensure data reliability, efficiency, and quality.
- Worked with clients and helped them integrating their offline data with online data in Google Cloud Platform, in turn deriving insights, which resulted in a 70% increase in ROI over following months. The case study won Google’s Best Customer Use Case 2019 Award in Australia and New Zealand region.
- Contributed in building a Data Integration Service which fetches data from various ad-marketing platforms and exports them to Google BigQuery for further processing.
- Collaborated with various Google Analytics clients to provide them with valuable insights using their data stored in Google BigQuery, which was not possible using the Google Analytics user interface.
Data Engineering Intern
Datalicious (An Equifax Company)
Bangalore
02.2018 - 04.2018
- Developed and maintained a Query Builder as a micro-product for Google Analytics 360 clients with BigQuery as the backend database.
- Worked on automating the integration of Google Analytics data and Google Search Console data for several clients
Education
Bachelor of Engineering - Electronics And Communications Engineering
Bangalore University
Bangalore 08.2013 - 08.2017
Skills
Programming - Python
Certification
GCP certified Professional Data Engineer
Timeline
Senior Data Engineer
Willow Innovations
01.2022 - Current
Member of Technical Staff (Data Engineering)
CapitalFloat
04.2021 - 12.2021
Data Engineer
Datalicious (An Equifax Company)
05.2018 - 03.2021
Data Engineering Intern
Datalicious (An Equifax Company)
02.2018 - 04.2018
Bachelor of Engineering - Electronics And Communications Engineering
Bangalore University
08.2013 - 08.2017
Similar Profiles
Nayely Becky RomeroNayely Becky Romero
Sr. HR Operations Manager at Willow Innovations Inc.,Sr. HR Operations Manager at Willow Innovations Inc.,
Kamdjeu LambertKamdjeu Lambert
Warehouse Forklift Operator at Dessert Innovations/Trulli Fresh Innovations BakerWarehouse Forklift Operator at Dessert Innovations/Trulli Fresh Innovations Baker
Ryan VulgamoreRyan Vulgamore
Host at Clydes Willow Creek FarmHost at Clydes Willow Creek Farm