Backpacking
Cooking
Video Games
Pavan Kumar Vemula
DATA ENGINEER
HYD
Summary
As a data engineer, Having 2+ years and a proven track record of designing and implementing ETL pipelines, building and maintaining databases, and developing data processing systems. With expertise in programming languages, cloud computing platforms, and data analytics tools, to leverage technical skills for drive data-driven insights and enable efficient decision-making. Additionally, An effective communicator and collaborative team player, able to work with stakeholders across different departments and levels to ensure the successful delivery of projects
Overview
2
2
year of professional experience
1
1
Snowflake Certified
4
4
Azure Certified
1
1
DBT Certiified
Work History
Data Engineer
Anblicks Cloud Data Engineering Pvt Ltd
Hyd
01.2023 - Current
- Led a technical team of 3 to Enhance and support building various ETL data pipelines that brings data from different Databases to Data Warehouse.
- Developed and maintained key operations of ETL data pipeline and worked with different data sets in Azure Data factory.
- Implemented various components like pipeline, activity, mapping data flows, data sets, linked services, triggers and control flow.
- Performed debugging, data validation, error handling, transformation types, data clean up analysis within datasets.
- Had good experience on working with snowflake advance feature like RBAC, Architecture, Partner connect program, Query Optimization, Pricing etc..
- Developed and maintained data architecture and data models in snowflake.
- Implementing and managing Snowflake's security features, including roles, privileges, and access controls.
- Developed DBT models with other tools such as Airflow to create automated data workflows that can schedule, execute, and monitor data transformations in Snowflake. This helps data teams to streamline their data processes and reduce manual effort.
- Writing complex snow-sql scripts in snowflake cloud data warehouse to business analysis and reporting.
- Developed snowflake procedure for existing sql scripts in Azure Sql Pool for migrating Data from Synapse to snowflake.
- Collaborating with cross-functional teams, including data scientists, engineers, and analysts, to deliver impactful business insights and data-driven decision-making.
- Creating and maintaining data refresh schedules and automating data updates.
- Collaborating with business users and stakeholders to identify data analysis needs and delivering actionable insights
- Creating calculated measures, hierarchies, and other data transformations in PBI.
- Created PBI dashboards to their business needs.
- Proved successful working within tight deadlines and a fast-paced environment.
Associate Data Engineer
Anblicks Colud Data Engineering Pvt Ltd
Hyd
04.2022 - 12.2022
- Along with DevOps Engineers, developed automated CI/CD and test driven pipeline using Azure as per client standards.
- Gained knowledge on Azure stack like Azure Synapse Analytics for Data Warehousing and Big Data Analytics, Azure Stream Analytics to process Real-time data streams.
- Communicated new or updated data requirements to global team.
Contributed to internal activities for overall process improvements, efficiencies and innovation. - Restructure existing Pipelines in Data Factory to migrate data from different sources to target data warehouse.
- Had a strong leadership skills by managing team for projects starting from scratch.
- Experience with Big Data technologies such as Hadoop and Kafka
- Implementing ETL pipelines within and outside of a data warehouse using Python and Snowflakes Snow SQL.
Junior Data Engineer
Anbilcks Cloud Data Engineer Pvt Ltd
Hyd
- Build an End to End pipeline using AWS and Azure external stages that will migrate data form cloud to virtual data warehouse in snowflake.
- Worked on fundamental concepts of virtual Warehouse includes databases, external and internal stages,tasks,streams, stored procedures.
- Worked in creating POC on Snowflake Data Vault Modeling and snow-park to showcase to one of client.
- Implemented DataVault modeling to provide long-term historical storage of data coming in from multiple operational systems.
- Created Environment n VScode for snowpark and a session for snowpark to connect with snowflake working with dataframes and writing scala code for performing some aggregation on it.
- Creating UDFs and also using SnowSQL.
- As a Jr data engineer learned new technologies like Snowflake, Azure, AWS cloud basics, Data modeling, Microsoft Power BI, SSMS, Hadoop, Kafka, Spark, Scala, Python etc...
- Self-motivated, with strong sense of personal responsibility.
- Exercised leadership capabilities by successfully motivating and inspiring others.
Data Engineer Intern
Anblicks Cloud Data Engineer Pvt Ltd
Hyd
- Evaluate tuning the accuracy by training of the acoustic model, speaker detection, language configuration and other dependent features
- Identifying options to train and customize the sentiment and topic libraries based on certain business domain, Display the conversation text separated by the speaker, highlight the positive and negative sentiment in the conversation journey
- Display the overall sentiment of the call and display the captured topics from the call
- Learn about Airflow and setting up the airflow on the Different VMs.
Education
Bachelor of Technology - Electronics And Communication Engineering
2021-03
Skills
- Analytical and problem-solving skills
- Communication and interpersonal skills
- Time management and organization
- Teamwork and collaboration
- Leadership and management skills
Certification
All Matillion Badges
DBT Fundamentals
Certified Snowflake SnowPro Core data engineer
Certified Azure Data Engineer Associate(Dp203)
Certified on Azure Data Fundamentals(DP-900)
Certified on Azure Fundamentals(AZ-900)
Certified on Azure Artificial intelligence(AI-900)
Interests
Timeline
Data Engineer - Anblicks Cloud Data Engineering Pvt Ltd
01.2023 - Current
Associate Data Engineer - Anblicks Colud Data Engineering Pvt Ltd
04.2022 - 12.2022
Junior Data Engineer - Anbilcks Cloud Data Engineer Pvt Ltd
Data Engineer Intern - Anblicks Cloud Data Engineer Pvt Ltd
V R Siddhartha Engineering College - Bachelor of Technology, Electronics And Communication Engineering
Similar Profiles
Vijay MakwanaVijay Makwana
Associate DevOps Engineer at ANBLICKS CLOUD DATA ENGINEERING PVT LTDAssociate DevOps Engineer at ANBLICKS CLOUD DATA ENGINEERING PVT LTD
Ankita DhargalkarAnkita Dhargalkar
Business Development Executive at Serverwala Cloud data Centre Pvt ltdBusiness Development Executive at Serverwala Cloud data Centre Pvt ltd
Vikas MishraVikas Mishra
Sr Customer Success Manager at Real Time Data Services Pvt Ltd. - Ace CloudSr Customer Success Manager at Real Time Data Services Pvt Ltd. - Ace Cloud
Trinadh KTrinadh K
Administrative Officer at Amneal Oncology Private LimitedAdministrative Officer at Amneal Oncology Private Limited
PANGA SUBBARAYUDUPANGA SUBBARAYUDU
Technical Executive at JLLTechnical Executive at JLL