Jahnavi
DATA ENGINEER
Bangalore
Summary
Data-driven professional with over 2 years of experience, targeting Data Engineer roles with an organization of high impact potential. As a Data Engineer, I focus on data migration from on prem to Azure Cloud. Experienced in designing, implementing, & optimizing data pipelines and data infrastructure in high-impact environments. Proven track record in improving data processing efficiency by 50% through advanced techniques such as partitioning, indexing, & caching, leading to significant cost savings & performance enhancements. Successfully led the transition of on-premises data infrastructure to Azure cloud, achieving a 30% reduction in costs and enhancing scalability and reliability. Utilized Scala, Apache Spark, & Azure Databricks to optimize data processing & ingestion, resulting in a 50% reduction in processing time & 40% boost in data ingestion speed.
Overview
4
4
years of professional experience
4
4
years of post-secondary education
Work History
Data Engineer
DXC Technology
Bangalore
01.2022 - Current
- Data Pipeline Development: Designing & implementing scalable & reliable data pipelines to collect, process, and transform raw data into a format suitable for analysis
- Data Integration: Integrating data from various sources, including databases, APIs, and third-party services, ensuring seamless data flow and consistency
- Database Management: Creating, managing, & optimizing databases & data warehouses to store large volumes of data securely
- Data Modeling: Developing & maintaining data models to support business requirements, including designing schemas and defining relationships between data entities
- Implemented a custom data vacuuming solution that reduced storage expenses by 40% and enhanced query performance by 60%, optimizing the data lake environment
- Orchestrated data optimization initiative using Scala, Apache Spark, & Azure Databricks, which led to a 50% decrease in processing time and a 40% boost in data ingestion speed
- Achieved 95% success in resolving change requests by issue analysis & resolution, with bug fixes & code enhancements, improving client satisfaction & data pipeline stability
- Championed the creation of scalable data pipelines, cutting data ingestion times by 40% and accelerating analytics and reporting processes for Azure Data Lake Storage
- Managed the transition of on-premises data infrastructure to the Azure cloud, realizing a 30% reduction in costs and enhanced scalability and reliability
- Boosted data processing efficiency by 50% by applying partitioning, indexing, and caching strategies, which resulted in significant cost savings and performance improvements
- Leveraged CI/CD pipelines for automated deployment and monitoring of data solutions using Azure DevOps, reducing deployment time by 30% and enhancing overall reliability
- Worked with cross-functional teams to translate business needs into technical solutions, ensuring compliance with data quality, integrity & security standards, which increased project efficiency by 20%
ETL Datastage Developer
DXC Technology
Bangalore
12.2020 - 01.2022
- Getting the functional requirements from the client and prepare the design, Data Mapping documents
- Developing Parallel Jobs using IBM IIS DataStage
- Extracting, Transforming, Loading (ETL) and Maintaining of Data Warehouses and Data marts, handling large data loads, automatic error handling
- Designed a low-level documentation for data flow architecture and source to target mappings
- Involved in strategies and developing architecture for building a Data warehouse
- Worked on Job Sequences to control the execution of the job flow using various Activities & Triggers (Conditional and Unconditional) like Job Activity, Sequencer, Routine activity and Exec Command Activities, unix shell programming
Education
BE - Engineering in Computer Science
KVG College of Engineering
Sullia 08.2016 - 08.2020
Skills
Python/Pyspark
Azure Databricks
Azure DevOps
Azure Data Factory
undefinedProfessional Activities Certifications
- Microsoft Certified Azure Fundamental AZ-900, Microsoft, 2023
- Microsoft Certified Azure Fundamental DP-900, Microsoft, 2023
Timeline
Data Engineer
DXC Technology
01.2022 - Current
ETL Datastage Developer
DXC Technology
12.2020 - 01.2022
BE - Engineering in Computer Science
KVG College of Engineering
08.2016 - 08.2020
Similar Profiles
Syed NadeemuddinSyed Nadeemuddin
Professional 2 Networks at DXC Technology (Was transitioned from AT&T to DXC)Professional 2 Networks at DXC Technology (Was transitioned from AT&T to DXC)
Henry Arthur VincentHenry Arthur Vincent
Client Capability Lead at DXC Technology, DXCClient Capability Lead at DXC Technology, DXC
Nikhil C TNikhil C T
Business Analyst / Manual QA Tester at DXC Technology/Fidelis Technology Services Pvt LtdBusiness Analyst / Manual QA Tester at DXC Technology/Fidelis Technology Services Pvt Ltd
Deepan Kumar SDeepan Kumar S
Associate Manager in Supply Chain Management at DXC TechnologyAssociate Manager in Supply Chain Management at DXC Technology
Sreeram TRSreeram TR
Catalog Manager at AmazonCatalog Manager at Amazon