PRAVEEN SELVARAJ
Lead Data Engineer
Chennai
Summary
A driven professional with 13 years of experience in developing robust code for highvolume businesses, implementing scoring models using technologies like PySpark, DataStage etl tool ,HIVE and Bigdata/AWS Services. Renowned problem solving and technical skills, troubleshooting and providing optimized solution for complex problems. Deep understanding of technology with focus on delivering business solutions.
Overview
13
13
years of professional experience
3
3
years of post-secondary education
Work History
Lead Data Engineer
Bank of America
08.2021 - Current
- Designed and deployed real-time ETL pipelines using PySpark and Spark SQL to process multi-million record datasets
- Integrated data from internal/external APIs into data lake environments for real-time analytics
- Led a team of 4 data engineers in Agile projects using Jira, Confluence; resolved escalations and ensured timely delivery
- Collaborated with compliance and business teams to enforce data quality and security standards
- Developed CI/CD pipelines with Jenkins and shell scripts for deployment automation
- Engaged in AI use cases enabling actionable analytics for financial users
- Built data ingestion workflows integrating AWS S3, AWS Glue, and Athena for hybrid cloud analytics
- Created and triggered notification workflows using AWS Lambda, SES, and SNS for monitoring, alerting, and reporting
- Configured CloudWatch for real-time job monitoring, logging, and anomaly detection
- Participated in POCs leveraging AWS Glue for schema discovery and metadata cataloging
Lead Software Engineer
Cognizant Technology Solutions
09.2015 - 08.2021
- Automated large-scale ETL workflows using DataStage and Hive, reducing manual effort by 40%
- Led scrum ceremonies and cross-functional collaboration across delivery teams
- Tuned ETL performance with partitioning, indexing, and schema redesign
- Built Jenkins pipelines for automated deployments across QA, staging, and production
Project Engineer
Wipro Technologies
05.2012 - 09.2015
- Developed ETL workflows using IBM DataStage for complex business use cases
- Modeled data warehouses using star schema and ERwin for metadata design
- Improved performance of legacy ETL systems through concurrent workflow optimization
Education
Master of Computer Applications -
Sathyabama University
Chennai 01.2009 - 04.2012
Skills
AWS (S3, Lambda, Glue, Athena, CloudWatch)
PySpark
Hive
SQL
Spark SQL
Impala
DataStage
Shell Scripting
Jenkins
GitHub
Shell scripting
Deployment Automation
Jira
Real-time & Batch Pipelines
Airflow
AutoSys
Git
Extras
Domain knowledge in Financial Services/Banking Strong analytical and problem-solving skills Excellent communication and cross-team collaboration skills
Certifications Awards
- Gold Award for critical production solution delivery at Bank of America
- AWS Certified Solution Architect – Associate
Timeline
Lead Data Engineer
Bank of America
08.2021 - Current
Lead Software Engineer
Cognizant Technology Solutions
09.2015 - 08.2021
Project Engineer
Wipro Technologies
05.2012 - 09.2015
Master of Computer Applications -
Sathyabama University
01.2009 - 04.2012