Aniket Sinha
Bengaluru,KA
Summary
A highly skilled and detail-oriented Data Engineer with over 3 years of experience in data engineering, analytics, and software development. Proficient in designing, building, and maintaining robust and scalable data pipelines. Experienced in working with large-scale data systems, cloud services (Azure), and modern data tools. Adept at leading data engineering projects and collaborating with cross-functional teams to deliver high-quality solutions.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Data Engineer II
TVS Motor Company
04.2022 - Current
- Designed and developed scalable real-time data pipelines as microservices using Azure tools, Kafka and Kubernetes and Docker.
- Developed and deployed APIs using FAST and GraphQL to enhance data accessibility and integration capabilities as microservices using Kubernetes and Nginx.
- Optimized ETL processes using Polars and ADLS, reducing data processing time by 30%.
- Implemented workflow management using Apache Airflow to orchestrate complex data processing tasks, improving data pipeline reliability and monitoring.
- Acted as a scrum master for a squad under SaFe Framework .
Data Engineer I
TVS Motor Company
07.2021 - 03.2022
- Developed and maintained ETL pipelines to process batched data using Spark Streaming.
- Developed automated data archival pipelines to store data into Azure blob archived storage
- Established robust data quality checks and monitoring solutions, leading to 25% decrease in data anomalies and discrepancies.
- Collaborated with data scientists and business analysts to design and deploy machine learning models in production using Azure web apps, facilitating data-driven decision-making.
- Administered Azure cloud resources, optimizing cost and performance for data processing and storage solutions.
Education
B.Tech - Civil Enginenerinng
Indian Institute of Technology Guwahati
Guwahati05.2021
Skills
- Programming: Python, SQL, JavaScript, C
- Big Data Technologies: Pyspark, Kafka, Hive, Hadoop
- Cloud Services: Databricks, Microsoft Azure resources
- Databases: ClickHouse,PostgreSQL
- Data Processing Libraries: pandas, polars
- Workflow Management: Apache Airflow, Kubernetes
- API Development: REST, GraphQL
- Tools: Docker, Git, Nginx
- Data Visualization: Grafana
Certification
Atlassian - Agile project management professional certificate
LinkedIn Learning - Getting started as Azure developer
LinkedIn Learning - Getting started with Kubernetes
LinkedIn Learning - Analyzing big data with Hive
LinkedIn Learning - Learning Hadoop and Learning Apache Airflow
Timeline
Data Engineer II
TVS Motor Company
04.2022 - Current
Data Engineer I
TVS Motor Company
07.2021 - 03.2022
B.Tech - Civil Enginenerinng
Indian Institute of Technology Guwahati
Atlassian - Agile project management professional certificate
LinkedIn Learning - Getting started as Azure developer
LinkedIn Learning - Getting started with Kubernetes
LinkedIn Learning - Analyzing big data with Hive
LinkedIn Learning - Learning Hadoop and Learning Apache Airflow
Similar Profiles
V GOKULASELVANV GOKULASELVAN
HSE Officer at TVS MOTOR COMPANY - TVS Supply Chain Solutions LtdHSE Officer at TVS MOTOR COMPANY - TVS Supply Chain Solutions Ltd
VAIRAMUTHU V VAIRAMUTHU V null
Trainee Junior Engineer at TVS Motor Company LimitedTrainee Junior Engineer at TVS Motor Company Limited
NEETU CHAWLANEETU CHAWLA
Customer Delight Manager – Department D&AI at TVS Motor Company Ltd.Customer Delight Manager – Department D&AI at TVS Motor Company Ltd.