Eswar Namuduri
Staff Engineer - Data Engineering
Hyderabad
Summary
Competent Engineering professional with extensive expertise in designing, building, and managing complex data pipelines, specializing in cloud-based data warehousing and big data technologies, proven track record of delivering high-quality data solutions to drive business insights and decision-making, with a focus on scalability, performance, and data governance best practices. Proven experience in Databricks environment and platform migrations.
Overview
9
9
years of professional experience
6
6
years of post-secondary education
Work History
Staff Engineer - DE & DE Governance Lead
Altimetrik
10.2023 - Current
- As a Data Engineering Lead, managed multiple concurrent projects, ensuring timely completion and adherence to budget constraints.
- Got an opportunity to work as a Data Engineering Governance Lead. Presented technical findings and recommendations to key stakeholders with clarity, supporting informed decision-making processes.
- Ensured compliance with regulatory requirements by diligently reviewing documentation and implementing necessary modifications.
- Facilitated effective team collaboration by establishing clear goals and expectations, leading to higher morale and increased productivity.
- Worked closely with Client Team understanding requirements and effort estimated for timely delivery of the project.
- Conducted thorough analyses of existing systems to identify areas for improvement and recommend viable upgrades.
- Worked on multiple migration and version upgradation projects.
- Performed a POC on Delta Lake migration of DataBricks.
Senior Data Engineer
Altimetrik
09.2021 - Current
- Enhancements from the clients on the Production application to be analyzed and do the necessary fixes to the code and re-deploy the code to prod
- Perform E2 Migration for all the repositories in the project
- Interact with the client to understand the requirements and do the necessary optimizations
- Work on Snowflake DB Tables
Senior Data Engineer
Altimetrik
10.2022 - 10.2023
- Analyze data coming from various sources in to a frame work called F1 and derive objects
- Analyze the scrips & procedures existing in Oracle DB and re-write the same in PySpark.sql
- Create ETL Pipe line to execute the jobs in Airflow
- Create notebooks in Databricks in which the scripts will be ideally executed as part of DAG run
- Validate the data which has to match exactly with existing PROD Data
- All the KPIs build on PRD Qlik Dashboard should be matching with the processed data
- Work closely with business to make the data prod ready for deployment
- Used Databricks, AWS, PySpark - SQL, Airflow, Jenkins
PySpark Developer
Altimetrik
09.2021 - 09.2022
- Responsible for Integrating .zip/.csv/.txt files from different source systems and loading data to different layers of framework applying required logics using Pyspark
- Implementing business rules on top of the processed data to generate outbound files with the critical key potential identifiers
- This involves complex business logic and data to be presented at different hierarchy level and extensive use of Pyspark data frames
- Finally, the data frame data is written to Files with required delimiter information and sent to downstream consumption (s3 Location)
Associate
CTS
09.2019 - 09.2021
- Created flow to generate outbound Files, applying business logic and to deliver the Files in Amazon S3 for downstream Consumption
- Created end to end data pipeline to process data coming from different sources
- Created end to end Data Pipelines
- Worked with Airflow
- Conducted KT sessions to client support team for applications developed
Applications Services Analyst - I
ICON PLC
12.2015 - 09.2021
- Design and Deployment of Request, Incident and Change Request forms with the ServiceNow platform
- Configuration/Customization of the ServiceNow system, including creating workflows
- Build service requests from customer requirements including requests, request items and tasks using workflows -to manage data flows from the customer to the support teams
- Creating workflows for Change Management, Incident Management and Risk Management
- Version Upgrade activities for ServiceNow tool
ServiceNow Developer
12.2015 - 09.2019
- Responsible for Design, Develop and Deployment of Catalog, Incident & Change Request forms with the ServiceNow platform
- Configuration/Customization of the ServiceNow system, including creating workflows
- Build workflows for the forms created based on the business need and integrate the same to the forms created
- Used scripting tools and ServiceNow functionality to create scripts to automate tasks in ServiceNow
- Load, manipulate and maintain data between Service-now and other systems
- Service now implementation experience in ITSM modules (Incident, Request and Change)
Education
Bachelor Of Tech. - Electrical, Electronics and Communications Engineering
JNTU Kakinada
01.2011 - 01.2015
Post Graduate Deploma - IT Management
Symbiosis Center For Distance Learning
Pune, India 04.2015 - 01.2017
Skills
- PySpark
- AWS: RDS
- AWS: S3
- AWS: Glue
- AWS: Lambda
- AWS: EC2
- Databricks
- Scripting - Python
- Database: Oracle
- Database: PostgreSQL
- Database: Snowflake
- Database: MS-SQL
- Version Control Tools: Git
- Version Control Tools: Bitbucket
Awards
- Raise & Shine, Go-to team member for the client and accessing scope and raising risks in time.
- Client Appreciation, Appreciation mail from client for the successful completion of the project with ZERO Escalations.
Timeline
Staff Engineer - DE & DE Governance Lead
Altimetrik
10.2023 - Current
Senior Data Engineer
Altimetrik
10.2022 - 10.2023
Senior Data Engineer
Altimetrik
09.2021 - Current
PySpark Developer
Altimetrik
09.2021 - 09.2022
Associate
CTS
09.2019 - 09.2021
Applications Services Analyst - I
ICON PLC
12.2015 - 09.2021
ServiceNow Developer
12.2015 - 09.2019
Post Graduate Deploma - IT Management
Symbiosis Center For Distance Learning
04.2015 - 01.2017
Bachelor Of Tech. - Electrical, Electronics and Communications Engineering
JNTU Kakinada
01.2011 - 01.2015
Similar Profiles
Nandhakumar S. SelvarajanNandhakumar S. Selvarajan
Staff Engineer at AltimetrikStaff Engineer at Altimetrik
Sobhan GhoshSobhan Ghosh
Staff Engineer-Product & Platform Engineering at AltimetrikStaff Engineer-Product & Platform Engineering at Altimetrik
Aman KumarAman Kumar
Senior Software Engineer at AltimetrikSenior Software Engineer at Altimetrik