PRATHAP REDDY
Azure Databricks Architect
Bangalore
Summary
Data Engineering Specialist, utilizing my 15+ years of experience in design Architecture, engineering, development and delivery of large-scale data solutions with about 5+ years’ experience in Azure based Cloud environment and staying up to date with latest techniques and emerging technological trends and best practices in Data Engineering technologies. My goal is to maximize the extraction of value from data by helping my organization to leverage on cloud based distributed systems while continuously enhancing my skills and abilities.
Overview
11
11
years of professional experience
13
13
Certifications
Work History
Big Data Architect
Persistent Systems Ltd
02.2024 - Current
- Implemented the scientific and evidence-based approach of handling the data migration project involving legacy systems and processes into modernized and automated, reusable Big Data Storage and Processing Infrastructure, resulting in more than a 70% reduction in time and effort across the IRM-RE portfolio.
- Migrated numerous legacy risk analytics codes with significant architectural gaps into fully automated Big Data pipelines on Azure Databricks.
- Specialized in building the ETL job notebooks with multiple and multi-level automated orchestrations, with resilient checkpointing integrated with granular milestone logging, and real-time email alerting.
- Tuning the storage infrastructure to perform at its best optimal time and efficiency resulting in increased data processing speed by more than 250%.
- Mentored junior team members, fostering a culture of continuous learning and professional growth within the organization.
- Enabled faster query response times through meticulous performance tuning efforts focused on indexing strategies and partitioning techniques.
- Evaluated emerging industry trends, ensuring alignment with cutting-edge tools and methodologies for maximum competitive advantage in the realm of big data.
Data Architect
Ampcus Tech Pvt Limited-Sompo International
03.2023 - 08.2023
- Revamped the ETL packages by transitioning them to Azure-based cloud technologies, leading the pioneering efforts in optimizing ETLs, resulting in 70% time and cost savings.
- Conceptualized providing cloud-based solutions to enable the business to track data lineages and maintain data catalogues, resulting in reduced data lineage and RCA efforts by 70%.
- Pioneered reusability in design to optimize the development efforts based on common use-case scenarios, and using parametrization techniques, resulting in a compact solution and a development effort reduction of 80%.
- Designed internal process improvements to automate repetitive tasks, shortening data delivery times.
- Migrated numerous legacy systems to newer technologies, reducing costs, and enhancing efficiency of computing tasks.
- Gathered, defined and refined requirements, led project design and oversaw implementation.
- Drafted conceptual and logical data models for high-level system planning tasks, optimizing each model to customers' needs and budgets.
- Enhanced data quality by designing and implementing efficient data models, schemas, and storage techniques.
- Conducted thorough root-cause analysis on complex data issues, proposing practical solutions that align with business objectives.
Lead Data Engineer
Onedata Solutions Pvt Ltd.
04.2022 - 10.2022
- Guided business requirements and functional specifications into logical program designs and to deliver modules, stabilize application systems, and Data or Platform solutions.
- Provided product leadership with identified or emerging risks and issues with regards to migration, consolidation, standardization, reporting and dashboard building.
Senior Data Engineer
LTI-Larsen and Toubro Infotech Ltd
10.2014 - 12.2021
- Define strategic solutions and tactical implementation approaches to support customer business problems and provide innovative solutions to provide scalable ETLs.
- Provided project Knowledge Management capabilities and formed team to stabilize deliverables in the context of diversified Data Technology solutions resulting in on-time deliverables on regular basis.
Education
PG Diploma - Data Science and Big Data Engineering
IIIT-Bangalore
10.2019
Bachelor of Engineering - Electrical and Electronics Engineering
Anna University
Chennai05.2007
Skills
Certification
Python Institute-[PCAP-30-03] PCAP
AWARDS AND APPRECIATIONS
Awarded and appreciated by clients for implementing pioneering solutions for challenging business and technical problems using innovative ideas and solutions using python coding which could be reused in their business. Specifically recognized for automating the routine and manual business activities enabling business to focus more on strategic business initiatives.
Timeline
Big Data Architect
Persistent Systems Ltd
02.2024 - Current
Data Architect
Ampcus Tech Pvt Limited-Sompo International
03.2023 - 08.2023
Lead Data Engineer
Onedata Solutions Pvt Ltd.
04.2022 - 10.2022
Senior Data Engineer
LTI-Larsen and Toubro Infotech Ltd
10.2014 - 12.2021
PG Diploma - Data Science and Big Data Engineering
IIIT-Bangalore
Bachelor of Engineering - Electrical and Electronics Engineering
Anna University