BHOOPATHI SRAVAN
Hyderabad
Summary
Dynamic Data Engineer with a proven track record at Wellsfargo International Solutions, adept at leveraging AWS and Azure technologies. Expert in optimizing ETL processes and data migration, utilizing skills in PySpark and SQL. A collaborative problem-solver, I enhance data accessibility and performance, driving impactful analytics solutions.
Overview
6
6
years of professional experience
Work History
Data Engineer
Wellsfargo International Solutions Private Limited
02.2024 - Current
- Built an ETL by integrating AWS - S3, Databricks, Redshift services.
- Extracted the data from client’s server through API and imported raw data into AWS-S3.
- Automated the extraction process through Airflow.
- Utilized optimized techniques to get required transformations. We use optimization techniques like dpp, data serialization, predicate pushdown.
- Created DAG’s for query optimization based on event driven triggers or CDC.
- Implemented event-based triggers and scheduled triggers for effective and continuous migration of data from S3 to Redshift.
- Performed Analysis on data available in Redshift using Redshift Query Editor.
- Participated in Business Requirement gatherings to analyze and transform the data as per their requirement.
Data Engineer
Wipro Technologies
Hyderabad
03.2019 - 04.2022
- Migrate large volumes of structured and unstructured data from on-premises data sources to Azure Data Lake Storage for centralized data management and analytics.
- Configure and manage data movement activities, such as copy data tasks and data flows.
- Integrate with on-premises data sources and handle various data formats (structured, semi-structured, and unstructured).
- Design and implement data transformation logic using Azure Data Factory's mapping data flows or Spark activities.
- Optimize data processing workflows for performance and efficiency.
- Integrate Azure Data Lake Storage with other Azure services for data processing and analysis.
- Implement data integration patterns with Azure services like Azure Databricks, Azure Synapse Analytics.
- Collaborate with data analysts or data scientists to facilitate data access and consumption.
- Implement techniques like partitioning, compression, or parallel copying to improve transfer speeds.
- Continuously improve and refactor existing data ingestion pipelines for better performance, maintainability, and scalability.
Data Engineer
01.2019 - 12.2021
- Extracted data available in AWS – S3 and copied the data into Snowflake’s Tables.
- Integrated Snowflake and GitHub to DBT to perform ETL operations.
- Utilized Jinja and SQL together in writing Complex Sub-Queries, Joins, Views, Aggregations and created tables, views in Snowflake.
- Created Models, Macros, Tests and utilized Packages, Seeds as per the requirement to improve query performance.
- Involved in Data Modelling – Refined data for proper Data Types, Handled the Faulty, Duplicate and Null records etc.
- Applied Transformations and Loaded the transformed data into AWS – S3 in various semi-structured data formats like Json, Avro, Parquet, Text files (CSV) etc. as per Client’s requirement.
- Analysed the Business requirements and maintained inline with needs and expectations.
- Client: Nike
Education
B.Tech - ECE
Swami ramananda tirtha institute of science and technology
01.2017
Intermediate -
Narayana Junior College
01.2013
SSC -
Krishnaveni Talent School
01.2011
Skills
- Linux
- Windows
- Cloudera
- PySpark
- SQL
- MySQL
- Oracle
- Netezza DB
- Scala
- Python
- Ec2
- S3
- EMR
- Lambda
- Glue
- Athena
- Step Functions
- Databricks
Hobbies and Interests
- Listening Music
- Playing cricket
- Social service
Disclaimer
I do hereby declare that the above information is to the best of my knowledge.
Languages
- English
- Hindi
- Telugu
Personal Information
- Father's Name: BHOOPATHI DHARMAIAH
- Date of Birth: 01/17/96
- Gender: Male
- Marital Status: single
Timeline
Data Engineer
Wellsfargo International Solutions Private Limited
02.2024 - Current
Data Engineer
Wipro Technologies
03.2019 - 04.2022
Data Engineer
01.2019 - 12.2021
B.Tech - ECE
Swami ramananda tirtha institute of science and technology
Intermediate -
Narayana Junior College
SSC -
Krishnaveni Talent School
Similar Profiles
Naziya BegumNaziya Begum
Due Diligence Associate. at WellsFargo International Solutions Private LimitedDue Diligence Associate. at WellsFargo International Solutions Private Limited
SUSHMITHA MOGLISUSHMITHA MOGLI
Independent Testing Specialist| IT Auditor - Risk Management at WELLSFARGO INDIA SOLUTIONS PRIVATE LIMITEDIndependent Testing Specialist| IT Auditor - Risk Management at WELLSFARGO INDIA SOLUTIONS PRIVATE LIMITED
Ramesh NandipalliRamesh Nandipalli
Executive Director (Principal Engineer) at WellsFargo International Solutions Pvt LtdExecutive Director (Principal Engineer) at WellsFargo International Solutions Pvt Ltd
Saket RaiSaket Rai
Lead - Affiliate Marketing at GrabOn (InspireLabs Solution Pvt. Ltd.)Lead - Affiliate Marketing at GrabOn (InspireLabs Solution Pvt. Ltd.)
Krishna Prasad KurraKrishna Prasad Kurra
Consultant at Deloitte IndiaConsultant at Deloitte India