MAHENDRA MEESALA
Data Engineer
Bangalore
Summary
3.6 years of experience as Data Engineer. I am an avid learner, technology enthusiast and try to keep myself updated with latest technology.
Overview
4
4
years of professional experience
4
4
years of post-secondary education
2
2
Languages
Work History
Consultant
Saksoft Limited
Pune, Maharashtra
06.2022 - Current
- Project: Bandhan life Data Lake
- Skills: Python, PySpark, Pandas, Great Expectations, AWS, PostgreSQL, Quicksight
- Real-time data ingestion from microservices and SFTP.
- Real-time ingestion to S3 using Kinesis Data Stream and lambda.
- ETL using AWS Glue.
- Data pipeline design and workflow.
- Glue spark Job Optimization.
- Data quality checking using python’s Great Expectations.
- Automated and scalable way to deploy, back up, and replicate Amazon Quicksight assets at scale.
- Realtime publication of data to database using lambda.
- Generating reports using Glue ETL job on daily, weekly, monthly and from inception frequency.
- Orchestration of glue jobs using step function.
- Creating Infrastructure for Aws services using CDK in typescript.
- API Gateway to accept requests and share data.
Data Engineer
Futurense Technologies
08.2021 - 02.2022
- Project: Lemonade Datalake
- Skills: Python, PySpark, PostgreSQL, AWS
- File ingestion and validation from Sftp using Lambda.
- Converting raw files into parquet using glue dynamic frame.
- Writing PySpark jobs for report generation using Glue.
Education
B.Tech. - ECE
JNTU Anantapur
07.2015 - 11.2019
Skills
- Python
- PySpark
- Spark
- AWS
- TypeScript
- DynamoDB
- MySQL
- PostgreSQL
- Glue
- Lambda
- S3
- SNS
- SQS
- Step Functions
- Event Bridge
- API Gateway
Timeline
Consultant
Saksoft Limited
06.2022 - Current
Data Engineer
Futurense Technologies
08.2021 - 02.2022
B.Tech. - ECE
JNTU Anantapur
07.2015 - 11.2019