Dhivya Bharathi B
Madurai
Summary
Results-driven and highly skilled Data Engineer with python over 5 years of hands-on experience, specializing in core backend development. Recognized as a key contributor to the success of the Spark Meter project at Happiest Minds Technologies. Proficient in Python, REST API development, and PostgreSQL, with a solid track record in database design, optimization, performance tuning, and data security.
Overview
6
6
years of professional experience
1
1
Language
Work History
Data Engineer
Happiest Minds Technologies
04.2023 - Current
- Lead the development of robust data pipelines for ingesting, processing, and analyzing large datasets
- Collaborate with cross-functional teams to design and implement efficient data solutions to meet business requirements
- Utilize AWS services, including Lambda, S3, and Redshift, to create scalable and cost effective data processing solutions
- Implement data security measures and access controls to ensure the integrity and confidentiality of sensitive data
- Work closely with stakeholders to understand data requirements and provide insights through effective data modeling and analysis
Robotics and Automation team member
Tata Consultancy Service
01.2019 - 03.2023
- Worked on a pen test project involving OCR for invoice text extraction, analyzing invoice documentation, and feeding the model to predict customer information
- Utilized various defined models, classifiers, and tf-idf vectors to enhance accuracy in predicting customer information from invoices
- In the IKEA project, contributed to the RDC part, managing incident management for Angular and .NET frameworks
- Resolved complex grid view model issues and designed a tool for daily product updates with a dashboard and email notifier
- In the PCAT application, automated user log status updates, reducing manual effort
- Implemented a solution to fetch records, segregate data logs with weeks
Education
Master in Computer Application -
Thiagarajar College Of Engineering And Technology
MaduraiB.Sc - Physics
N.P.R Arts and Science and College
DindigulB.Ed - Physics
Gandhigram Rural University
Skills
Python
SQLAlchemy
REST API Development
MySQL
PostgreSQL
Oracle
Flask
Django
Pytest
PySpark
Heroku
Amazon Web Services (EC2, S3, Lambda)
Redshift
S3
Athena
Spectrum
Glue
Lambda
IAM
Data Pipeline
Numpy
Pandas
Scikit Learn
Keras
TensorFlow
Gitlab
Docker
AWS
dbeaver-ce
Thunderclient
Jupyter Notebooks
Anaconda
JSON
XML
API Design
Postman
Test-Driven Development
HTTP
VSCode
Event-Driven Architecture
Git
Github
Accomplishments
- In the dynamic realm of data engineering, I am adept at steering projects through the entire data lifecycle - from conceptualization and design to implementation and optimization. Skilled in SQL, data modeling, and hands-on administration of PostgreSQL databases, ensuring robust and scalable solutions for diverse business needs.
- Committed to effective requirement gathering and analysis, translating business needs into precise technical specifications for robust data engineering solutions. Looking to leverage proven skills and experience to drive excellence in the dynamic and evolving field of Data Engineering.
Timeline
Data Engineer
Happiest Minds Technologies
04.2023 - Current
Robotics and Automation team member
Tata Consultancy Service
01.2019 - 03.2023
B.Sc - Physics
N.P.R Arts and Science and College
B.Ed - Physics
Gandhigram Rural University
Master in Computer Application -
Thiagarajar College Of Engineering And Technology