SOUMYAKANTA GARABADU
Senior Data Engineer
Bhubaneswar
Summary
Having 12 years of IT experience out of which 5.5 years on Big Data Technologies.
Responsive expert experienced in developing data pipelines, troubleshooting issues and optimizing spark jobs and hive queries. Possesses strong analytical skills, excellent problem-solving abilities, and deep understanding of bigdata technologies and eco-systems. Equally confident working independently and collaboratively as needed and utilizing excellent communication skills.
Overview
14
14
years of professional experience
3
3
years of post-secondary education
5
5
Certifications
3
3
Languages
Work History
Senior Data Engineer
LtiMindtree
11.2021 - Current
- Leading team with gathering requirements from client to finalize deliverables till deployment.
- Creating data pipeline using ADF,ADB and Spark with Intellij for reading from variety of data sources like Hive,Oracle,S3,Azure Data Lake, Oracle and writing into Hive,Oracle,S3,Azure Data Lake.
- Worked on multiple file formats for data processing such as Xml, CSV, Parquet, Json.
- Optimized batch job in spark by applying guidelines given and able to achieve 30-40 % time reduction.
- Creating Views, Tables in Hive and optimized hive queries by applying different techniques.
- Worked on kafka for batch processing by creating producer and topic which is consumed by multiple consumers/clients.
- Movement of Azure HD insight jobs to Azure K8s.
- Implemented Prometheus with Grafana for monitoring Spark Metrics.
- Worked on Scala and python in Spark as per project requirements.
- Worked on Autosys, Udeploy, Intellij,GitHub,Jenkins,GitLab with Devops tool for my day to day activity.
- Ensured data quality through rigorous testing, validation, and monitoring of all data assets, minimizing inaccuracies and inconsistencies.
- Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
- Championed the adoption of agile methodologies within the team, resulting in faster delivery times and increased collaboration among team members.
- Delivered exceptional results under tight deadlines, consistently prioritizing tasks effectively to meet project timelines without compromising quality or accuracy.
- Mentored junior team members in best practices for software development, code optimization, and troubleshooting techniques.
- Collaborated with cross-functional teams to define requirements and develop end-to-end solutions for complex data engineering projects.
Software Engineer
Wells Fargo
07.2016 - 11.2021
- Creating and Managing Spark Jobs for Processing of files, Scheduling Spark Jobs, Refactor external HIVE tables, partitioning and bucketing of table, Develop complex HIVE queries for data quality checks and implement SCD, Performance tune HIVE queries by implementing parallelism, partitioning, optimize joins and bucketing functions, Client management with handling end to end development cycle, Designing, architecture and integration of various critical modules in application, Managing Deployments using GIT
- Developed reusable components that significantly reduced development effort on multiple projects.
- Improved software performance by identifying and resolving bottlenecks in code.
- Movement of SSIS jobs to Azure Cloud Environment.
- Development of Web application using C#,WEB API,MVC,WCF and Sql Server.
- Participated on client calls to gather requirements and developing application accordingly.
- Integration of various critical modules after making changes into existing application.
- Provided technical guidance to junior developers, fostering positive team environment and promoting professional growth.
- Worked with software development and testing team members to design and develop robust solutions to meet client requirements for functionality, scalability, and performance
Technology Consultant
Capgemini
11.2014 - 6 2016
- Design & Development of DB Tables, Procedures, Triggers, Views, UDFs
- Development of Web API/MVC controllers and other layered architectures, Code/UI/Middle Layer development using MVC, Web API, WCF, SQL Server, Client management with handling end to end development cycle, Code Merging, Management using TFS, Code Review, Peer Reviews, Coordination with QAs in easy testing, Defect triage of application, Using JQuery, Kendo UI tools to create Kendo Grids and other UI controls
- Development of SSIS and SSRS Reports.
- Conformed to quality, performance and inter-operability standards for implementation of solutions.
Analyst Programmer
CSM Technology
06.2010 - 11.2014
- Development of web applications using ASP.NET, C#, JQuery, SQL Server, Development of SQL Stored Procedures, Triggers, Functions, Views
- Development of Web apps using SOA guidelines.
- Development of Custom Jquery plugin using kendo.
- Enhanced software quality with thorough testing, debugging, and documentation processes.
- Stored, retrieved and manipulated data for close analysis of database performance.
Education
Master of Computer Applications – MCA -
IGNOU
Bhubaneswar 06.2010 - 06.2013
Skills
Python Programming
Sql Server
Scala Programming
Spark
Hive
Kafka
Oozie
Sqoop
Performance Tuning
Big Data Processing
Kafka Streaming
Azure Data Factory
Azure Data Bricks
S3
Azure Data Lake
Azure Synapse
Oracle
C#
Web API
Shell Scripting
Data Pipeline Design
Advanced SQL
Certification
Azure Data Engineer Associate (05/2022)
Databases
- Oracle
- SQL Server
- Mongo DB
- Cassandra
Frameworks
- Cloudera
- Ambari
- Databricks
Ide
- IntelliJ
- Eclipse
Dataprofilertool
Amazon Deeque
Bitools
- SSIS
- SSRS
- ADF
Sourcecodemanagement
- GITLAB
- GITHUB
- Bitbucket
Deploymenttools
- Azure Dev Ops
- Udeploy
- Autosys
Scriptinglanguage
- Shell Script
- VB Script
- Java Script
Os
- Unix
- Linux
- Windows
Thirdpartytools
- Telerik Controls
- Kendo UI
Citizenship
Indian
Cloudservices
- MS Azure( ADF, ADB, ADL)
- AWS (S3, Glue, EMR, Athena)
Accomplishments
- Received Wells Fargo Champion award for moving on-prem SSIS Jobs to Azure Cloud Environment without any issues..
- Got Client Appreciation from CNA for delivering the application on time with High Quality
- Got Client Appreciation from Nokia for smooth transformation of spark codes from one version to another version which has many complex requirements.
Work Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Work Preference
Work Type
Full TimeLocation Preference
On-SiteRemoteHybridImportant To Me
Company CultureWork-life balanceCareer advancementHealthcare benefitsTimeline
Senior Data Engineer
LtiMindtree
11.2021 - Current
Software Engineer
Wells Fargo
07.2016 - 11.2021
Technology Consultant
Capgemini
11.2014 - 6 2016
Master of Computer Applications – MCA -
IGNOU
06.2010 - 06.2013
Analyst Programmer
CSM Technology
06.2010 - 11.2014