Summary
Overview
Work History
Education
Skills
Certification
Databases
Frameworks
Ide
Dataprofilertool
Bitools
Sourcecodemanagement
Deploymenttools
Scriptinglanguage
Os
Thirdpartytools
Citizenship
Cloudservices
Accomplishments
Work Availability
Work Preference
Timeline
AdministrativeAssistant
SOUMYAKANTA GARABADU

SOUMYAKANTA GARABADU

Senior Data Engineer
Bhubaneswar

Summary

Having 12 years of IT experience out of which 5.5 years on Big Data Technologies.

Responsive expert experienced in developing data pipelines, troubleshooting issues and optimizing spark jobs and hive queries. Possesses strong analytical skills, excellent problem-solving abilities, and deep understanding of bigdata technologies and eco-systems. Equally confident working independently and collaboratively as needed and utilizing excellent communication skills.

Overview

14
14
years of professional experience
3
3
years of post-secondary education
5
5
Certifications
3
3
Languages

Work History

Senior Data Engineer

LtiMindtree
11.2021 - Current
  • Leading team with gathering requirements from client to finalize deliverables till deployment.
  • Creating data pipeline using ADF,ADB and Spark with Intellij for reading from variety of data sources like Hive,Oracle,S3,Azure Data Lake, Oracle and writing into Hive,Oracle,S3,Azure Data Lake.
  • Worked on multiple file formats for data processing such as Xml, CSV, Parquet, Json.
  • Optimized batch job in spark by applying guidelines given and able to achieve 30-40 % time reduction.
  • Creating Views, Tables in Hive and optimized hive queries by applying different techniques.
  • Worked on kafka for batch processing by creating producer and topic which is consumed by multiple consumers/clients.
  • Movement of Azure HD insight jobs to Azure K8s.
  • Implemented Prometheus with Grafana for monitoring Spark Metrics.
  • Worked on Scala and python in Spark as per project requirements.
  • Worked on Autosys, Udeploy, Intellij,GitHub,Jenkins,GitLab with Devops tool for my day to day activity.
  • Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
  • Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
  • Championed the adoption of agile methodologies within the team, resulting in faster delivery times and increased collaboration among team members.
  • Delivered exceptional results under tight deadlines, consistently prioritizing tasks effectively to meet project timelines without compromising quality or accuracy.
  • Mentored junior team members in best practices for software development, code optimization, and troubleshooting techniques.
  • Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects.

Software Engineer

Wells Fargo
07.2016 - 11.2021
  • Creating and Managing Spark Jobs for Processing of files, Scheduling Spark Jobs, Refactor external HIVE tables, partitioning and bucketing of table, Develop complex HIVE queries for data quality checks and implement SCD, Performance tune HIVE queries by implementing parallelism, partitioning, optimize joins and bucketing functions, Client management with handling end to end development cycle, Designing, architecture and integration of various critical modules in application, Managing Deployments using GIT
  • Developed reusable components that significantly reduced development effort on multiple projects.
  • Improved software performance by identifying and resolving bottlenecks in code.
  • Movement of SSIS jobs to Azure Cloud Environment.
  • Development of Web application using C#,WEB API,MVC,WCF and Sql Server.
  • Participated on client calls to gather requirements and developing application accordingly.
  • Integration of various critical modules after making changes into existing application.
  • Provided technical guidance to junior developers, fostering positive team environment and promoting professional growth.
  • Worked with software development and testing team members to design and develop robust solutions to meet client requirements for functionality, scalability, and performance

Technology Consultant

Capgemini
11.2014 - 6 2016
  • Design & Development of DB Tables, Procedures, Triggers, Views, UDFs
  • Development of Web API/MVC controllers and other layered architectures, Code/UI/Middle Layer development using MVC, Web API, WCF, SQL Server, Client management with handling end to end development cycle, Code Merging, Management using TFS, Code Review, Peer Reviews, Coordination with QAs in easy testing, Defect triage of application, Using JQuery, Kendo UI tools to create Kendo Grids and other UI controls
  • Development of SSIS and SSRS Reports.
  • Conformed to quality, performance and inter-operability standards for implementation of solutions.

Analyst Programmer

CSM Technology
06.2010 - 11.2014
  • Development of web applications using ASP.NET, C#, JQuery, SQL Server, Development of SQL Stored Procedures, Triggers, Functions, Views
  • Development of Web apps using SOA guidelines.
  • Development of Custom Jquery plugin using kendo.
  • Enhanced software quality with thorough testing, debugging, and documentation processes.
  • Stored, retrieved and manipulated data for close analysis of database performance.

Education

Master of Computer Applications – MCA -

IGNOU
Bhubaneswar
06.2010 - 06.2013

Skills

Python Programming

Certification

Azure Data Engineer Associate (05/2022)

Databases

  • Oracle
  • SQL Server
  • Mongo DB
  • Cassandra

Frameworks

  • Cloudera
  • Ambari
  • Databricks

Ide

  • IntelliJ
  • Eclipse

Dataprofilertool

Amazon Deeque

Bitools

  • SSIS
  • SSRS
  • ADF

Sourcecodemanagement

  • GITLAB
  • GITHUB
  • Bitbucket

Deploymenttools

  • Azure Dev Ops
  • Udeploy
  • Autosys

Scriptinglanguage

  • Shell Script
  • VB Script
  • Java Script

Os

  • Unix
  • Linux
  • Windows

Thirdpartytools

  • Telerik Controls
  • Kendo UI

Citizenship

Indian

Cloudservices

  • MS Azure( ADF, ADB, ADL)
  • AWS (S3, Glue, EMR, Athena)

Accomplishments


  • Received Wells Fargo Champion award for moving on-prem SSIS Jobs to Azure Cloud Environment without any issues..
  • Got Client Appreciation from CNA for delivering the application on time with High Quality
  • Got Client Appreciation from Nokia for smooth transformation of spark codes from one version to another version which has many complex requirements.

Work Availability

monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse

Work Preference

Work Type

Full Time

Location Preference

On-SiteRemoteHybrid

Important To Me

Company CultureWork-life balanceCareer advancementHealthcare benefits

Timeline

Senior Data Engineer

LtiMindtree
11.2021 - Current

Software Engineer

Wells Fargo
07.2016 - 11.2021

Technology Consultant

Capgemini
11.2014 - 6 2016

Master of Computer Applications – MCA -

IGNOU
06.2010 - 06.2013

Analyst Programmer

CSM Technology
06.2010 - 11.2014

Similar Profiles

CREATE PROFILE
SOUMYAKANTA GARABADUSenior Data Engineer