DHARANI M

• Collaborate with business analyst and gather data requirement for generating useful insights for business optimization
• Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
• Explained data results and discussed how best to use data to support project objectives.
• Communicated new or updated data requirements to global team.

Technology Used: AWS Glue, AWS-CDK, Lake formation, S3, SNS, SQS, PySpark, Lambda, Step function, Athena

Our Scope of work is Ingest data from multiple source system into AWS

Working on Glue ETL to connect multiple sources and pull the data

Pull data from source system and apply transformation logic based on client requirement using PySpark

Create Crawler to create Athena table, allowing user to connect their Dashboards

Create AWS Resource (Glue Jobs, Crawler, IAM User and Athena tables) by using Cloud Development Kit and deploy the code using CI/CD

As a Lead developer in the Team, I took responsibility for making the process into framework and improvisation.

Worked on Migration project on-premise to cloud(AWS)

Applied Pyspark transformation logic based on existing ETL tool called alteryx.

Highly worked on AWS glue, S3 , lambda and step function service to convert entire ETL flow

Worked on python web automation projects by using selenium webdriver.

• Analyzed test results and prepared system-level evaluation reports to verify and validate system performance.
• Reviewed, evaluated and identified requirements for testability.
• Created comprehensive test plans, test scripts and use cases to support testing objectives.