Tableau
Reddappa Reddy
Senior Data Engineer
Bangalore
Summary
Detail-oriented Senior Data Engineer, designs, develops and maintains highly scalable, secure and reliable data structures. Accustomed to working closely with system architects, software architects and design analysts to understand business or industry requirements to develop comprehensive data models. Proficient at developing database architectural strategies at the modeling, design and implementation stages.
Overview
12
12
years of professional experience
4
4
Certifications
Work History
Senior Data Engineer
Jones Lang LaSalle Property Consultants Ltd
07.2022 - Current
- Developed custom algorithms for efficient data processing, enabling faster insights and decision making.
- Championed the adoption of agile methodologies within the team, resulting in faster delivery times and increased collaboration among team members.
- Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
- Optimized data pipelines by implementing advanced ETL processes and streamlining data flow.
- Participated in regular code reviews with team members to promote clean coding standards and consistent adherence to best practices across projects.
- Developed efficient stored procedures and functions for streamlined data processing, resulting in improved system performance.
- Designed and developed ETL processes for seamless data integration across multiple platforms.
- Developed, implemented and optimized stored procedures and functions using T-SQL.
- Assisted in database migration projects, ensuring accurate data transfer between systems.
Senior Data Engineer
Akira Consultancy Limited
12.2021 - 07.2022
- Simplified complex business logic by designing modularized code structures within a functional programming paradigm using Scala or Python alongside Apache Spark libraries.
- Streamlined ETL processes by developing custom Spark transformations and actions.
- Optimized application performance by profiling Spark jobs and identifying bottlenecks in code execution.
- Collaborated with cross-functional teams to define requirements, design solutions, and ensure successful project delivery utilizing Apache Spark technology stack.
- Implementing the requirements in Bigdata solutions by interacting with the functional users and Analysing and Gathering the requirements and implementing the solutions in Azure Databricks
- Building and Designing an Azure data lake storage (ADLS) storage solution and maintaining ADLS across Raw, Staging Serving and Semantic Layers.
- Implementing Deltalake solutions using Databricks and PySpark across several stages of the Big data Solutions on Azure cloud.
- Analysed the FRS document and Created corresponding ETL mapping document and the transformations across various data layers.
- Analysed, Developed and Orchestrated several Talend pipelines to generate data from various sources and pull the data into Azure data lake solutions for futher processing using Databricks notebooks using PySpark.
- Creating Databricks notebook using Python and Spark across pre-staging, staging, data mart and semantic layer while applying best practices to reduce redundancies in code.
- Implementing Security best practices in the Azure Cloud projects by using Azure Key Vault to fetch sensitive data securely into Databricks notebooks
- Streamlined deployment processes through the use of Azure DevOps pipelines, reducing time to production and increasing efficiency.
- Troubleshot complex issues within the Azure environment, delivering timely resolutions to minimize downtime and maintain optimal performance levels.
- Authored code fixes and enhancements for inclusion in future code releases and patches.
Senior Implementation Specialist
NTT Data Global Delivery Services
08.2015 - 12.2021
- Developed reusable components in SSIS to minimize development efforts across multiple projects.
- Provided ongoing support for existing SSIS solutions, addressing issues as needed and making enhancements when necessary.
- Reduced data processing time with efficient SSIS package designs and performance tuning techniques.
- Utilized various SSIS tools like Data Flow Task, Execute SQL Task, Script Task to achieve desired outcomes within set deadlines.
- Increased efficiency by automating manual tasks using SSIS features such as loops and event handlers.
- Participated in cross-functional team meetings to gather requirements, understand project objectives, and contribute valuable insights as an SSIS expert.
- Analyzed existing SQL queries to identify opportunities for improvements.
- Designed and developed customized extract, transform and load (ETL) applications per client specifications.
- Resolved complex business issues, proposing long-term solutions to avoid repeat problems.
- Maintained complex T-SQL queries, views and stored procedures in multi-database environment with little supervision.
- Devised high-quality database solutions ranging in size and complexity, increasing productivity and improving data sharing.
- Elevated overall system performance by conducting regular analysis of execution logs, identifying bottlenecks, and implementing improvements accordingly.
- Maintained clear documentation of developed solutions for easy reference by team members and future developers.
- Enhanced data accuracy by optimizing SSIS packages and implementing data validation techniques.
- Develop End to End ETL Solutions for Client Services using iWay DataMigrator
- Development of PL/SQL Packages, Functions and Triggers, performance tuning SQL Queries.
- Work with Data Analytics team to develop Tableau reports for Business Analytics
Systems Engineer
Tata Consultancy Services Limited
02.2012 - 07.2015
- Monitoring the Hadoop Cluster proactively and collecting the performance metrics to deliver optimized solutions;
- Monitor the Database of the production environment using OEM
- Review the Performance testing results, Database Settings and provide instance tuning recommendations.
- Analyze the AWR reports to identify poorly performing SQL Queries and tune poorly performing PL/SQL Queries, Master data load queries and provide an efficient and improved solution;
- Migration of massive data to the application without performance bottlenecks
- Provide PL/SQL Tuning, which prevents the performance degradation in the Production system
Education
B.Tech - Computer Science
Sri Vidyanikethan Engineering College
Tirupathi, India 04.2001 -
Skills
PySpark Development
ETL development
Azure Technologies
SQL Expertise
Databricks
Alteryx
Power BI (Fabric)
Azure Data Factory
Certification
Databricks Certified Data Engineer Associate
Software
SSIS
IWay Data Migrator
Timeline
Databricks Certified Data Engineer Associate
01-2024
Databricks Certified Associate Developer for Apache Spark 3.0
10-2023
Microsoft Certified Data Engineer Associate
03-2023
Microsoft Certified Data Analyst Associate
03-2023
Senior Data Engineer
Jones Lang LaSalle Property Consultants Ltd
07.2022 - Current
Senior Data Engineer
Akira Consultancy Limited
12.2021 - 07.2022
Senior Implementation Specialist
NTT Data Global Delivery Services
08.2015 - 12.2021
Systems Engineer
Tata Consultancy Services Limited
02.2012 - 07.2015
B.Tech - Computer Science
Sri Vidyanikethan Engineering College
04.2001 -