Summary
Overview
Work History
Education
Skills
Certification
Interests
Timeline
Generic
Amlanjyoti Patnaik

Amlanjyoti Patnaik

Senior Data Engineer
Hyderabad

Summary

Seasoned Data Engineer with excellent troubleshooting, issue resolution and Coding and thinking skills. Dependable and driven with record seeing complex projects through to completion.

Overview

11
11
years of professional experience
4
4
years of post-secondary education
2
2
Certifications
3
3
Languages

Work History

Senior Consultant

Infosys (Client- American Express)
Hyderabad
01.2022 - Current


  • Architect,Designed,Developed frame work for migration of ETL pipeline built in Ab initio to Highly scalable open source Spark.
  • Written lot of reusable program and complex UDFs to be used by team.
  • Implemented UDFs to implement lookup alike function in spark(scala).
  • Dealt with Reading/Processing and writing fixed length files in spark.
  • Determined areas for improvement and implemented processes to alleviate problems.
  • Analyzed problematic areas to provide recommendations and solutions.
  • Streamlined processes to cut downtime and optimize employee productivity.
  • Worked in a POC to evaluate Prophecy Transpiler for ETL migration activity.
  • Performed business research and financial analysis.
  • Written many housekeeping jobs and command line utility in python.
  • Coded some ab initio logic(like expanded scan) in python which could not be done in spark.
  • Designed and developed Airflow DAGS for job scheduling.
  • Automated metadata generation process using python.
  • Written function to implement Meta Programing Function in Spark-Scala.
  • Mentored junior teammates.

Consultant

Infosys (Client- Fiserv INC)
Omaha
02.2020 - 12.2021


  • Delivered outstanding service to clients to maintain and extend relationship for future business opportunities.
  • Supported clients with business analysis, documentation, and data modeling.
  • Liaised with customers, management, and sales team to better understand customer needs and recommend appropriate solutions.
  • Analyzed problematic areas to provide recommendations and solutions.
  • Deployed Spark jobs wrapped under shell script in accordance with client requirements.
  • Enhanced performance of Spark applications for fixing accurate batch interval time and memory tuning.
  • Created Scala/Spark SQL codes to extract data from multiple databases & conceptualized ideas for Advanced Data Analytics.
  • Deployed process to create application logs for consumption of SPLUNK for application monitoring and alerting.
  • Developed and debugged graphs, plans, parameter sets in Ab Initio ETL Tool based on the requirements and logic provided in the requirement specification documents and mapping documents.
  • Experience in both Batch and Real time process.
  • Have worked on processing large scale data integration acquisition, transformation in Batch mode using HIVE, Sqoop, sparkSql.
  • Dealt with Hive internal/external tables with Partitioning, Bucketing, storage format formats (Parquet, AVRO, Sequence)

Associate Consultant

Infosys (Client - VISA INC.)
Fostercity
06.2015 - 01.2020


  • Worked as a SME for Visa's 3DS application Verified By Visa(VBV).
  • Worked in migration of existing Ab Initio process to Spark and HIVE HQL.
  • Evaluated diverse organizational systems to identify workflow, communication, and resource utilization issues.
  • Conducted thorough reviews of operations to devise and deploy improvement strategies.
  • Worked in Oracle Golden gate and Ab Initio continuous flow to capture and process real time transaction.
  • Re-engineered billing system for Verified by Visa application using Spark and Hive.
  • Performed changes in the existing processes as per Business requirement and made sure to deploy bug free code in production.
  • Created Sqoop/Spark jobs to move data between HDFS and DB2 system and vice versa.
  • Worked on audit processes to compare data between various hive data formats for formats like Parquet , avro and sequential .
  • Created a ML based load audit process for production sanity.
  • Identified long pending issues from the current billing system and re engineered it to a new process which managed to increase the revenue for visa by 40%.
  • Identified bottlenecks in existing data pipelines and re designed few processes to achieve best possible performance.

Systems Engineer

Infosys ( Client - American Express)
Bhubaneswar
09.2014 - 04.2015


  • Understood the current process and flows of the system running on Ab initio.
  • Analyzed downstream impact and reports.
  • Analyzed graphs and underlying logic and to translate the same into common understandable form, so that other developers can follow the logic and develop the ETL process in their respective tools(Internally Developed and used Tool called MDF).
  • Involved in automation of migration process.
  • Also involved in SIT. Validated all the Test Cases manually.
  • Done several code reviews with clients directly.
  • Ensuring proactive communication and notification to clients regarding operations,issue and status.

Software Engineer

Tech Mahindra ( Client - Synchrony Financial)
Bhubaneswar
11.2011 - 09.2014


  • Involved in Design, Testing and implementation phase for ETL.
  • Performed extraction, transformation, and load (ETL) programming functions as directed by the user requirements using Ab initio product suite
  • Gathered requirements, created functional specifications, implemented and completed the project testing within establish time frames and resource constraints.
  • Also involved in SIT. Validated all the Test Cases manually.
  • Done several code reviews with clients directly.
  • Ensuring proactive communication and notification to clients regarding operations,issue and status.
  • Involved in numerous process process improvements activities.
  • As part of this project I have modified few graphs which were running for almost 6 hours. After the implementation, the jobs were managed to complete within 1 hour. Hence, we had successfully eliminated 3rd shift from production environment.
  • Tuned another important job which was previously running for 4 hours to complete.After tuning the job got completed within 30 mins on daily basis and we managed to reclaim 150 GB of ETL space.

Education

B.Tech,Information Technology

C.V Raman College of Engineering
Bhuabaneswar
06.2007 - 04.2011

Skills

    Advanced analytics

undefined

Certification

DataBricks-Data Transformation and Loads (with capstone)

Interests

Cloud Computing

Artificial Intelligence

Timeline

Senior Consultant

Infosys (Client- American Express)
01.2022 - Current

Python - Hacker Rank

10-2020

DataBricks-Data Transformation and Loads (with capstone)

04-2020

Consultant

Infosys (Client- Fiserv INC)
02.2020 - 12.2021

Associate Consultant

Infosys (Client - VISA INC.)
06.2015 - 01.2020

Systems Engineer

Infosys ( Client - American Express)
09.2014 - 04.2015

Software Engineer

Tech Mahindra ( Client - Synchrony Financial)
11.2011 - 09.2014

B.Tech,Information Technology

C.V Raman College of Engineering
06.2007 - 04.2011

Similar Profiles

CREATE PROFILE
Amlanjyoti PatnaikSenior Data Engineer