Sri Lekha Pathakamuri
Guntur
Summary
Data professional with three years of experience in Big Data operations and ETL pipeline management, seeking a Data Engineer role. Proven expertise in Python, SQL, Shell Scripting and intermediate knowledge of PySpark, and Scala. Strong background in production deployment of data pipelines and big data operations.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Data Release Management Specialist
Cognizant Technology Solutions
Hyderabad
09.2023 - Current
- Led the deployment of 10 ETL pipelines from the development to the production environment.
- Collaborated with multiple data teams to ensure smooth integration and deployment of data pipelines.
- Implemented automated testing frameworks, reducing deployment issues by 20%.
- Monitored and optimized pipeline performance using [tools/methods].
- Developed a Python script to automate CSV to JSON file conversion with 64-bit encryption.
- Developed shell scripts to automate the functional testing of code.
- Tailored shell scripts to automate the data extraction and the file transfer from HDInsight to different environments and destinations, such as Amazon S3, shared Windows locations, etc.
- Created documentation for deployment procedures and best practices, along with ETL pipelines monitoring guidelines, to ensure swift action on failures.
Big Data Operations Support Engineer
Cognizant Technology Solutions
Hyderabad
09.2021 - 08.2023
- Effectively monitored Data Lake batch processes and delivered services to customers within agreed time frames, with less than 1% escalations.
- Developed and implemented shell scripts to perform data stability and audit checks, job status checks to increase data and delivery efficiency, and ensured hassle-free Azure HDInsight cluster migration.
- Enhanced data comparison processes between Hadoop and Oracle systems through Sqoop import, optimizing data consistency, accuracy, and operational efficiency.
- Collaborated with development teams to troubleshoot and resolve production issues, to maintain optimal system availability, and implemented automated alerts for system health monitoring.
- Created comprehensive performance reviews of Data Lake batches on a weekly and monthly basis. Suggested query performance optimizations for large-scale data processing.
- Proactively engaged in change management initiatives to resolve high-priority issues, while continuously monitoring Data Lake batches to ensure optimal performance and prevent potential downtime.
Education
Bachelor of Technology - Electronics And Communications Engineering
Vasireddy Venkatadri Institute of Technology
Guntur, Andhra Pradesh07-2021
Skills
- Cloud: Microsoft Azure
- Operating System: Linux/Unix
- Version Control: Git
- Languages: SQL, Python, Scala
- Tools: Azure Databricks, Azure HDInsight, Hadoop, Apache Spark (PySpark), Office 365
- Soft skills: Adaptability, critical thinking, effective communication, problem solving, collaboration
- Others: Big Data Operations Management, Change Management, Client Management
Accomplishments
- Received Q1 P&R award for contributions to the overall Centrica project in Cognizant
Certification
- Microsoft Azure Data Engineer Associate
Languages
Telugu
First Language
English
Upper Intermediate (B2)
B2
Hindi
Intermediate (B1)
B1
Japanese
Beginner (A1)
A1
Personal Interests
- Passion for painting
- Active badminton player
- Avid reader
Timeline
Data Release Management Specialist
Cognizant Technology Solutions
09.2023 - Current
Big Data Operations Support Engineer
Cognizant Technology Solutions
09.2021 - 08.2023
Bachelor of Technology - Electronics And Communications Engineering
Vasireddy Venkatadri Institute of Technology
Similar Profiles
PRAKASH NARAYANA VIGNESH BPRAKASH NARAYANA VIGNESH B
Business Analyst- Technical Lead at Cognizant technology SolutionsBusiness Analyst- Technical Lead at Cognizant technology Solutions
Raja RathinamadasamyRaja Rathinamadasamy
QA Manager at Cognizant Technology SolutionsQA Manager at Cognizant Technology Solutions
Josephine Arockiya Rani SJosephine Arockiya Rani S
Technical Lead -AWS at Cognizant Technology Solutions, CTSTechnical Lead -AWS at Cognizant Technology Solutions, CTS