Results-driven Software Engineer with six years of IT experience in software development, including three and a half years working on big data and cloud technologies using Agile model and methodology, and a proven track record in designing and maintaining data pipelines. And it ensures high data quality and effective collaboration across teams.
Experience SUMMARY
Systems Engineer - TCS - Bangalore 01/2022 - 01/2025
Project: Netezza Migration Client: Marriott
DESCRIPTION: Netezza Migration is a project where the Marriott using its legacy system Netezza to move its complete
Data to modern data platform using snowflake and cloud platform.
ROLES AND RESPONSIBILITIES
· Designed and implemented end-to-end data migration strategies from legacy systems to modern cloud-based solutions.
· Developing and scheduling workflow in AIRFLOW for job orchestration.
· Developed snowflake compatible code and implemented them successfully in Production Environment.
· Implemented cloud-based solutions leveraging AWS Services.
· Creating wrapper scripts for various UNIX operation and calling Snowsqls.
· Developed and maintained efficient data pipelines for extract, transform, and load (ETL) processes.
· Monitor and troubleshoot production data pipelines to ensure reliability and accuracy.
· Worked closely with analysts and business teams to understand data requirements and deliver solutions.
· Ensure compliance with data privacy and information security policies.
· Work within an Agile framework, sprint planning and technical discussions.
· Establish documentation standards and ensure comprehensive system documentation.
Project: DDM Campaign Taxonomy Client: Marriott
DESCRIPTION: DDM (Digital Data Migration) is a Ecommerce project, where Adobe will send its Data to Marriott to
AWS S3 bucket. Marriott will capture those data records and storing into Modern Data Platform.
ROLES AND RESPONSIBILITIES
· Developing IR registration for complex JSON file and pushing them to S3 bucket successfully and validating it.
· Developing the wrapper scripts holding various other scripts to be called and successfully implementing to Production Environment.
· Configured and maintained AIRFLOW for job orchestration.
· Complied input data for data analytics team to analyze various cases.
· Create and maintain efficient data pipelines for extract, transform, and load (ETL) processes.
· Design and implement data quality controls and validation processes to ensure data integrity.
· Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
· Establish documentation standards and ensure comprehensive system documentation.
· Demonstrated ability to work within and help guide Agile development methodologies.
· Excellent written communication skills for technical documentation.
Junior Software Engineer - Tech Mahindra Ltd - Bangalore 10/2017 -04/2021
Project: PCL School Fee Plan Client: PCL
DESCRIPTION: PCL is a Banking project, where Data from various sources are moved to buckets in a common format and then quality checks are applied over thosefiles to filter out the approved records. These records were later fed to client application.
ROLES AND RESPONSIBILITIES
· Creating jobs in JAMS tool on various Test Environment and implementing in Production Environment.
· Integrating various jobs with SSIS packages and SSMS tool.
· Carrying out Unit testing for new changes. And tuning the HIVE queries with bucketing and partitioning
· Monitoring App insights for performance check.
· Performing Application Enhancement Activity.
· Monitoring end to end JAMS tool and fix issue on production environment on failure of jobs.
· Worked closely with analysts and business teams to understand data requirements and deliver solutions.
· Work within an Agile framework and technical discussions.
· Establish documentation standards and ensure comprehensive system documentation