ATITHI RANJAN JHA
Bengaluru
Summary
Senior Data Engineer with 8+ years of experience in Big Data, AWS, Spark, Python, SQL, ETL modernization, cloud migration, and enterprise data engineering solutions. Proven expertise in migrating legacy SAS-based platforms to cloud-native architectures and delivering scalable data platforms.
Overview
10
10
years of professional experience
Work History
Technical Lead-Data & AI
Coforge Ltd
10.2024 - Current
- Performed detailed business and data requirement analysis to architect migration strategies for modernizing OneBrain legacy SAS-based ETL workflows into scalable cloud-native data processing frameworks.
- Performed end to end migration from on-prem to AWS for CAIS regulatory project involving multiple portfolios within the bank.
- Created data ingestion pipelines, data transformations, data management, and data governance frameworks at the enterprise level.
- Designed and implemented complex data transformation pipelines to migrate and standardize data from legacy platforms into target canonical data models, ensuring data integrity, consistency, and regulatory compliance.
- Reverse-engineered and translated legacy SAS business logic into optimized, reusable, and scalable data engineering solutions leveraging modern ETL/ELT frameworks.
- Collaborated with business analysts, data architects, stakeholders to elicit requirements, define transformation rules, and validate data lineage and business logic.
Senior Associate
Cognizant Technology Solutions
09.2023 - 09.2024
- Spearheaded the implementation of a cutting-edge Big Data solution for a prominent banking client, elevating data analytics capabilities and optimizing decision-making processes.
- Engineered and deployed an end-to-end pipeline leveraging AWS S3 as the primary data source and Apache Spark for efficient data transformation, cleaning, and preparation tasks, enhancing data quality and operational efficiency.
- Architected ETL workflows within Apache Airflow for payment gateways, automating data ingestion, transformation, and loading to enhance operational efficiency and data integrity.
- Optimized Spark jobs in collaboration with data science team, troubleshooting errors using Resource Manager and Autosys logs to ensure seamless execution.
- Collaborated with diverse teams to understand business requirements and develop scalable Big Data solutions.
Senior Software Engineer
Scientific Games India Pvt Ltd
05.2019 - 08.2023
- Engineered a robust data flow in Spark using PySpark to efficiently process application logs in batch mode, ensuring precise reconciliation with production data and optimizing data processing efficiency.
- Utilized Spark for comprehensive data computation and transformation over HDFS, optimizing Spark queries for efficient job execution.
- Built ETL workflow for gaming client using hive queries and automated data processing and unit testing with PySpark in Jupyter.
- Developed and implemented 100+ Sqoop import and export jobs for seamless data extraction from Oracle, SQL Server, MySQL into HDFS.
- Loaded transformed data into staging databases and utilized SSAS cubes for analytics, enhancing data accessibility.
System Engineer
Tata Consultancy Services
09.2017 - 05.2019
- Automated data workflows using SSIS to design and deploy ETL processes, streamlining data integration into Power BI datasets.
- Integrated data from various sources using SSIS and SQL queries to provide actionable insights to stakeholders and decision-makers.
- Ensured data quality and integrity through data cleansing and transformation techniques, optimizing reporting performance.
- Designed and implemented dynamic dashboards and reports in Power BI, enhancing data visualization for stakeholders.
SQL Developer
Infosys
09.2016 - 09.2017
- Tuned SQL queries to ensure quick retrieval and processing of large volumes of transactional data, improving overall system efficiency.
- Implemented SQL queries, indexes, and stored procedures to optimize database performance and responsiveness for retail operations.
- Developed custom reports using SQL Server Reporting Services (SSRS) to deliver actionable insights into retail sales trends, customer behavior, and inventory levels.
- Collaborated with business stakeholders to define report requirements and deliver solutions that support informed decision-making and business growth.
Education
B.E. - Computer Science Engineering
Navodaya Institute of Technology
05-2016
Skills
- AWS (S3, EMR, Glue)
- Spark
- Airflow
- ETL/ELT
- Data Pipeline Optimization
- Python
- SQL
- Hive
- SSIS
- SSRS
- Power BI
- Data Modeling
- Docker
- Shell Scripting
Timeline
Technical Lead-Data & AI
Coforge Ltd
10.2024 - Current
Senior Associate
Cognizant Technology Solutions
09.2023 - 09.2024
Senior Software Engineer
Scientific Games India Pvt Ltd
05.2019 - 08.2023
System Engineer
Tata Consultancy Services
09.2017 - 05.2019
SQL Developer
Infosys
09.2016 - 09.2017
B.E. - Computer Science Engineering
Navodaya Institute of Technology