Murali Naidu Adabala
Chennai
Summary
I am an experienced Data Engineer with expertise in Azure Data Factory, Python, Snowflake, Snowpipe, ETL Processes and Power BI. I am passionate about delivering data-driven insights that help drive business growth. With 3 years of experience in data engineering, I have honed my skills in building robust data pipelines, creating insightful visualizations, integrating diverse data sources, and generating comprehensive reports using Power BI.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Data Engineer
Hexaware Technologies
01.2022 - Current
- Led data sourcing initiatives, collecting data from diverse sources, and ensuring its integrity and quality.
- Designed and implemented ETL processes using Snowflake and Azure Data Factory (ADF) for efficient data transformation and loading.
- Created more than 20 pipelines using Azure Data Factory to load data from different sources such as APIs, SharePoint, and Azure Data Lake Storage (ADLS) into Snowflake.
- Implemented data transformation tasks within ADF pipelines to cleanse, enrich, or format the data as per business requirements before loading it into Snowflake, ensuring data quality and consistency.
- Developed and maintained data models in Snowflake for optimized storage and retrieval of structured and semi-structured data.
- Leveraged various azure services such as azure sql database, Azure data lake storage
- Possess extensive experience in creating data pipelines using Python to extract data from various APIs and load it into Snowflake, ensuring efficient and reliable data integration.
- Proficient in handling both semi-structured and structured data using Python libraries such as NumPy and pandas for efficient data manipulation and analysis.
- Experienced in scheduling Python scripts and azure data factory pipelines using Redwood and Apache workflow management systems to automate and streamline data processing tasks.
- Implemented data governance best practices and security measures to ensure data integrity, confidentiality, and compliance with regulatory requirements.
- Extensive experience in designing, implementing, and optimizing data pipelines using Snowpipe and developed and maintained robust data pipelines using Snowpipe for efficient ingestion of structured and semi-structured data into Snowflake data warehouse..
- Utilized Snowpipe and Snowflake Streams and Snowflake triggered tasks for real-time data ingestion and processing.
- Implemented real-time data streaming solutions with Snowflake Streams and Snowflake triggered tasks to enable instant data availability for analytical and reporting purposes.
- Identified and addressed technical challenges and bottlenecks in data ingestion and streaming processes, applying innovative solutions to optimize performance and reliability.
- Created detailed documentation and runbook outlining the end-to-end process of loading data into Snowflake from various sources using ADF, including configuration settings, dependencies, and troubleshooting guidelines.
- Created comprehensive documentation and best practices guidelines for Snowpipe and Snowflake Streams usage, facilitating knowledge sharing and onboarding of new team members
- Skilled in developing interactive dashboards and reports in Power BI to visualize key business metrics and KPIs, providing actionable insights to stakeholders.
- Designing and implementing data models using Power BI Desktop, optimizing data relationships
for efficient analysis and visualization
Education
Btech - Electronics And Communication Engineering
Gayatri Vidya Parishad College of Engineering
Visakhapatnam, India07-2021
Skills
- Azure Data Factory
- Python
- Snowflake
- Snowpipe
- SQL
- Javascript
- MS Sql Server
- Data Modelling
- OLAP
- Redwood
- Apache Airflow
Websites
Certification
Certifications:
- SnowPro Core Certification
- AZ 900 : Azure Fundamentals
- AWS Certified Cloud Practitioner Certificate
- Oracle Certified Ai Foundational associate
Languages
English
Telugu
Hindi
Personal Information
Personal Details:
- Father Name : Narasimha Rao
- Gender : Male
- Nationality : Indian
- languages Known : English, Telugu
Accomplishments
AWARDS:
- I received the Hall of Fame Award in 2023, which is a direct appreciation from clients for working efficiently and delivering outstanding results.
- Got Rockstar awards in 2024Q2 and 2023Q3
Timeline
Data Engineer
Hexaware Technologies
01.2022 - Current
Btech - Electronics And Communication Engineering
Gayatri Vidya Parishad College of Engineering
Similar Profiles
Monika KumariMonika Kumari
Senior Software Engineer Team Lead at Hexaware TechnologiesSenior Software Engineer Team Lead at Hexaware Technologies
Deveshkumar SinghDeveshkumar Singh
SENIOR PROJECT MANAGER at Hexaware TechnologiesSENIOR PROJECT MANAGER at Hexaware Technologies
Tamilselvan RadhakrishnanTamilselvan Radhakrishnan
Dotnet Core Fullstack Developer at Hexaware TechnologiesDotnet Core Fullstack Developer at Hexaware Technologies