Rachana S
Senior Data Engineer At Target
Summary
Results-driven Senior Data Engineer with an exceptional track record in designing, developing, and optimizing end-to-end data pipelines. Proficient in leveraging cutting-edge technologies to extract, transform, and load (ETL) data efficiently. Possesses extensive expertise in database management, and Big Data technologies. Demonstrates leadership qualities, collaborating seamlessly across teams to deliver scalable and high-performance data solutions. Proven ability to drive innovation, mentor junior team members, and provide strategic insights to enhance overall data architecture.
Overview
5
5
years of professional experience
Work History
Senior Data Engineer
Target Corporation
01.2022 - Current
- Common Library Development:Spearheaded the development of a common library for reusable code, reducing development time and effort duplication across all data pipelines.
Optimized performance components, enhancing overall efficiency and productivity.
- Performance Test Data Generator:Created a stress test data generator to evaluate and ensure the robustness of existing ETL pipelines under peak data loads.
Conducted performance tests, delivering comprehensive reports and insights to stakeholders.
- Argus Evaluation:Evaluated Argus for scalability, flexibility, and ease of use in containerization and service layers for Target's on-prem Hadoop platform.
Contributed to informed decision-making from the Data Engineering perspective.
- Documentation and Reporting:Prepared detailed documentation and analytic reports, summarizing results, analysis, and conclusions for stakeholders.
- Spark Job Listener Integration:Developed and integrated a Spark job listener utility into key pipelines, enhancing resource monitoring capabilities and optimizing resource allocation.
- Data Loss Incident Recovery:Successfully addressed a data loss incident in the data ingestion process, collaborating with cross-functional teams.
Acquired new skills by connecting Spark with the Cassandra database, leading to the successful retrieval of lost data.
Data Engineer
Target Corporation
07.2019 - 12.2021
- Developed, implemented and maintained ETL pipelines, standards and documentation.
- Communicated new or updated data requirements to global team.
- Contributed to internal activities for overall process improvements, efficiencies and innovation.
- Prepared documentation and analytic reports, delivering summarized results, analysis and conclusions to stakeholders.
- Explained data results and discussed how best to use data to support project objectives.
Education
Bachelor of Engineering - Computer Science And Engeering
Siddaganga Institute of Technology
Tumkur, Karnataka, India 08.2015 - 2019.05
Skills
CI CD
undefinedTimeline
Senior Data Engineer
Target Corporation
01.2022 - Current
Data Engineer
Target Corporation
07.2019 - 12.2021
Bachelor of Engineering - Computer Science And Engeering
Siddaganga Institute of Technology
08.2015 - 2019.05
Similar Profiles
Cameron MichaelCameron Michael
Security Specialist at Target CorporationSecurity Specialist at Target Corporation
Sharon HarrisSharon Harris
General Warehouse Associate at Target CorporationGeneral Warehouse Associate at Target Corporation
Jacklyn PackardJacklyn Packard
Barista at Target CorporationBarista at Target Corporation
Paris JerniganParis Jernigan
Senior Operations Manager at Target CorporationSenior Operations Manager at Target Corporation
Chih Han YuChih Han Yu
Senior Data Engineer / Data Engineer at MicronSenior Data Engineer / Data Engineer at Micron