Manjula Nagella
Nellore
Summary
I have 4.5 years of experience in IT, Results-driven GCP Cloud Data Engineer with over 3.5 years of hands-on experience in building and optimizing data pipelines using BigQuery, Airflow, and Dataproc. Skilled in data ingestion, transformation, and visualization to drive business insights. Proven ability to implement scalable data architectures and support real-time data processing in cloud environments.
Experienced with designing and optimizing data pipelines to ensure seamless data flow. Utilizes advanced SQL and Python skills to create and maintain robust data architectures. Track record of implementing scalable solutions that enhance data integrity and support informed decision-making.
Overview
5
5
years of professional experience
Work History
Data Engineer
Infinext Technologies
07.2023 - Current
- The Workplace insight project’s purpose is to deliver a scalable, interactive, data rich and modern digital Workplace insights solution via Tableau and a dashboard that informs users on how pension schemes are performing, while also making it easy to take action to improve member outcomes.
- Roles & Responsibilities:
- Understanding the client requirement by going through the Transformation rule document given by Business Analyst.
- Responsible for loading of the data into the GCP tables at different levels.
- Worked on Creating DAG’s and tasks to deploy and run PySpark jobs in the Airflow scheduling tool.
- Responsible for creating the GCP buckets, Datasets, Big Query tables in different layers of BQ projects.
- Responsible for ingesting the data from one dataset to different datasets through BQ Queries as a part of the ELT and ETL process.
- Proficient in Big Data technologies including Hadoop, Hive, Spark, and PySpark to build scalable data pipelines for processing large datasets.
- Developed and optimized data pipelines in GCP to support data-driven decision-making.
- Implemented data curation and transformation workflows using Spark and Scala.
- Automated data ingestion processes using Airflow, reducing data processing time by 35%.
- Created actionable dashboards in Tableau for business users, increasing data visibility by 50%.
- Conducted SIT testing and ensured data accuracy for downstream applications.
- Highlight specific achievements and impact in each role. Focus on metrics (e.g., optimized data pipeline by 30%, reduced processing time by 40%).
Data Engineer
ARI Pvt Ltd
09.2021 - 07.2023
- Designed and implemented BigQuery datasets and tables for data storage and analytics.
- Developed audit tables for data reconciliation, enhancing data quality monitoring by 30%.
- Developed and maintained data processing pipelines using Hadoop and Spark.
- Ensuring data accuracy and consistency across multiple data sources in a data lake architecture.
- Streamlined data ingestion from GCS to BigQuery using Airflow and Pub/Sub.
- Automated data processing pipelines using Dataflow, improving data processing efficiency by 40%.
Education
MCA - Computer Applications
JNTU
09-2020
Bachelor of Science - Computer And Information Sciences
Vikrama Simhapuri University
Nellore, India 04.2001 -
Skills
Database : SQL, Stored Procedures, Hive,Big Query
Tools/Languages : Python, Scala,Spark, Hadoop, PySpark, Linux
Cloud Tools : Google Cloud Platform (GCP),BigQuery,GCP SDK,Dataproc,Cloud Storage,Pub/Sub,Cloud Composer
Other: Jenkins,Github,Winscp,Putty
Data Formats : CSV, JSON, XML, ORC, Avro, Parquet
Project Execution Tools : Agile – Sprint, Scrum, JIRA, GitHub
Operating Systems : Windows, Unix and Linux
Data warehouse: Data warehouse and data management , DBMS, shell scripting and spark, batch and streaming data ticketing
Declaration:
The information provided above is correct to the best of my knowledge.
Timeline
Data Engineer
Infinext Technologies
07.2023 - Current
Data Engineer
ARI Pvt Ltd
09.2021 - 07.2023
Bachelor of Science - Computer And Information Sciences
Vikrama Simhapuri University
04.2001 -
MCA - Computer Applications
JNTU