Summary
Overview
Work History
Education
Skills
Accomplishments
Projects
Languages
Languages
Timeline
BusinessAnalyst
ANINDITA MAL

ANINDITA MAL

Kolkata

Summary

Results-driven Data Engineer known for high productivity and efficient task completion. Skilled in big data processing frameworks like Hadoop and Apache Spark, database management using SQL, and cloud platform like AWS. Excel in problem-solving, collaboration, and adaptability to leverage technical skills in developing innovative data solutions across diverse environments.

Overview

11
11
years of professional experience

Work History

Data Engineer

LTI Mindtree
04.2022 - Current
  • Automated ETL processes by ingesting data from different sources using Spark for scalable data processing
  • Worked with client to understand business needs and translate those into actionable reports in Tableau
  • Optimized data storage and performance in a data warehouse environment, enhancing query execution time by 30%
  • Implemented basic monitoring tools resulting in a 15% reduction in downtime
  • Automated testing process for functional and regression testing to reduce manual workload by 35%
  • Reduced ETL processing time by 30% through the optimization of data pipelines, leveraging parallel processing and distributed systems such as Apache Spark
  • Configured and maintained cloud-based data infrastructure on platforms like AWS to enhance data storage and computation capabilities.
  • Provided technical mentorship to junior data engineers, guiding them on best practices and project execution.

Data Engineer

TATA Consultancy Services
02.2019 - 03.2022
  • Analyzed user requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
  • Developed Python scripts for extracting data from web services API's and loading into databases.
  • Designed, constructed, and maintained scalable data pipelines for data ingestion, cleaning, and processing using Python and SQL.
  • Streamlined data flow from diverse sources using ETL tools such as Airflow.
  • Managed version control and deployment of data applications using Git and Jenkins.
  • Implemented data security best practices and optimized cloud storage, achieving a 20% reduction in operational costs
  • Successfully implemented data processing pipeline, which improved data latency by 40%, enabling faster decision-making

Quality Excellence Projects

Tata Consultancy Services
11.2013 - 02.2019
  • Worked as Functional designer and technical lead for automation and quality checks
  • Supported integration of stakeholders to automate processes
  • Transformed a legacy system from mainframe to SAP for Supply Chain visibility
  • Led quality excellence projects for compliance and product requirements
  • Migrated legacy mainframe system functions like order, production, sales, auto application, despatch to SAP system

Education

B.Tech/B.E -

KIIT UNIVERSITY
05.2013

Skills

  • Agile
  • Apache Spark
  • Athena
  • AWS
  • AWS Glue
  • AWS Lambda
  • AWS Redshift
  • AWS Services
  • Big Data
  • CloudWatch
  • DynamoDb
  • ETL
  • Data Pipelines
  • GitHub
  • Hadoop
  • IAM
  • JIRA
  • PostgreSQL
  • PySpark
  • Python
  • S3
  • SNS
  • SQL
  • SQS
  • Terraform

Accomplishments

  • Quality Excellence Projects at TATA STEEL, Led various quality excellence projects at TATA STEEL Europe to improve process quality checks and compliance ensuring timely deliveries to customers. Automated the quality assurance processes reducing the manual workload by 30%.
  • Asynchronous Bulk processing of data, Worked on creating bulk sending of messages in asynchronous format via API from AWS to CRM systems. Helped in sending millions of records to the CRM system in lesser time.
  • Automation of testcase execution and validation, Designed and created ETL workflows to automate creation of quality test data, and execution of testcases, reducing manual testing work by 35% and increasing team productivity by 20%.
  • Consistently maintained high customer satisfaction ratings.

Projects

BMW Technologies (04/01/22- Present)

Automated ETL processes across millions of rows reducing workload.Ingested data from different sources using SQL, Spark, S3, Redshift, and Python.Worked with client to understand business needs and translate those into actionable reports in Tableau.Managed large datasets using Spark for scalable data processing., Optimized data storage and performance in a data warehouse environment, enhancing query execution time by 30%. Implemented basic monitoring tools resulting in a 15% reduction in downtime.

Amgen ( 02/01/19- 03/01/22)

Analyzed and organized raw data from different source system to develop data systems and pipelines. Built necessary infrastructure using AWS , Python and SQL technologies to enable effective ETL operation on data from different data sources.  Implemented data security best practices and optimized cloud storage, achieving a 20% reduction in operational costs.

Quality Excellence Projects Tat Steel Europe (01/01/17 -02/01/19)

Worked as Functional designer and technical lead for automation and quality checks.Supported integration of stakeholders to automate processes.

Supply Chain Transformation( 11/01/13- 01/01/17)

Transformed a legacy system from mainframe to SAP for Supply Chain visibility. Led quality excellence projects for compliance and product requirements. Migrated legacy mainframe system functions like order, production, sales, auto application, despatch to SAP system.

Languages

  • English, Native
  • Hindi, Proficient
  • Bengali, Proficient

Languages

English
Proficient
C2
Hindi
Proficient
C2
Bengali
Proficient
C2

Timeline

Data Engineer

LTI Mindtree
04.2022 - Current

Data Engineer

TATA Consultancy Services
02.2019 - 03.2022

Quality Excellence Projects

Tata Consultancy Services
11.2013 - 02.2019

B.Tech/B.E -

KIIT UNIVERSITY

Similar Profiles

CREATE PROFILE
ANINDITA MAL