Summary
Overview
Work History
Education
Skills
Disclaimer
Timeline
Generic

SUDEEP KOLLA

Hyderabad

Summary

Associate Data Engineer with expertise in data pipeline development and database management. Proven ability to leverage big data technologies and data manipulation techniques for efficient project execution. Strong problem-solving skills and adaptability drive innovative solutions in complex environments. Experienced in designing and delivering effective database solutions, enhancing data collection procedures to improve reliability and quality.

Overview

4
4
years of professional experience

Work History

Associate Data Engineer

Softic Digitech
Hyderabad
04.2021 - Current
  • Analyzed data trends using SQL to align with project objectives.
  • Developed efficient ETL processes for seamless data integration.
  • Maintained cloud databases to enhance storage solutions and performance.
  • Participated in code reviews to uphold development best practices.
  • Configured replication tasks in MySQL and PostgreSQL for environment synchronization.
  • Optimized databases through indexing and query rewriting techniques.
  • Built dashboards and visualizations with PowerBI and QlikView for stakeholder insights.
  • Collaborated with software engineers to develop APIs for web application access.
  • Created and optimized SQL queries to retrieve large datasets for analysis.
  • Developed and maintained data pipelines to ingest, transform, validate, and store data in a variety of formats.
  • Tested, validated and reformulated models to foster accurate prediction of outcomes.

Azure data engineer

Kaiser Permanente
  • Company Overview: Leading health insurance provider.
  • Leading health insurance provider, reduced costly pre service calls and improved the provider experience with convocational AI. We worked with designing, building, and maintaining robust data pipelines and systems that handle diverse datasets related to medical insurance. These datasets could include claims data, patient demographics, provider information, medical procedures, pharmaceuticals, and more. The goal is to ensure reliable, efficient, and secure data flows throughout the organization.
  • Designing and developing data pipelines using Azure Data Factory to orchestrate the extraction, transformation, and loading (ETL) processes.
  • Configuring and managing ADF pipelines to efficiently move data between various sources and destinations, ensuring data integrity and reliability.
  • Implementing error handling mechanisms and monitoring solutions within ADF pipelines to ensure smooth and reliable data processing.
  • Collaborating with stakeholders to understand requirements and optimize ADF pipelines for performance and scalability.
  • Leveraging Azure Databricks to perform advanced data processing for analytics and machine learning team enhancing the organization's data capabilities.
  • Designing and implementing scalable Spark clusters within Azure Databricks to process large volumes of data efficiently.
  • Developing and optimizing Spark jobs and notebooks in Azure Databricks to perform data transformations, aggregations, and analysis.
  • Architecting and implementing data lake solutions using Azure Data Lake Storage Gen2, providing scalable storage for structured and unstructured data.
  • Integrating Azure Data Lake Storage with Azure services like Azure Data Factory and Azure Databricks to enable seamless data ingestion, processing, and analytics workflows.
  • Leading health insurance provider.

Azure data engineer

Prudential Financial
  • As a Azure Data Engineer contributing to the Fraud Detection and Prevention System project, Implemented a fraud detection and prevention system utilizing machine learning models to identify fraudulent activities such as payment fraud and account takeovers. The system incorporated real-time monitoring and alerting mechanisms to swiftly respond to suspicious activities.
  • Building and deploying fraud detection models by using azure machine learning for this collaborate with data scientists.
  • Implementing azure data bricks can be preprocess and transform the raw data from various sources such as transactional data into a format suitable for fraud detection analysis.
  • And leverage data bricks notebooks to develop and automate ETL pipeline for data cleaning, feature engineering and aggregation tasks.
  • Collaborated with team members to preprocess and analyse data using Azure Databricks.
  • Implemented real-time monitoring and alerting systems to detect and respond to suspicious activities promptly.
  • Optimized large-scale data storage solutions with Azure SQL Database, prioritizing system performance and expandability.
  • We get information related to the processed data and models stored in azure blob storage.
  • Designed the system architecture to ensure scalability, modularity, flexibility and real-time monitoring, leveraging Azure's services for effective fraud detection and prevention.

Education

Bachelor Of Engineering - Computer Science

Sathyabama University
Chennai
08-2020

Intermediate Certificate -

Sri Chaitanya IIT JR College
Guntur , Andhra Pradesh
04-2016

SSC -

Sri Chaitanya Public School
Guntur , Ap
04-2014

Skills

  • Data pipeline development
  • Azure Data Factory
  • ETL process optimization
  • Machine learning integration
  • Cloud database management
  • Data integrity assurance
  • Team collaboration skills
  • Attention to detail
  • Technical documentation creation
  • Real-time monitoring solutions
  • Big data analytics
  • Data pipeline design
  • Data quality assurance
  • Relational databases
  • Real-time processing
  • SQL programming

Disclaimer

Thanks for your kind attention and taking your precious time to review my profile. I Sudeep k, hereby declare that the information furnished above is true and correct to the best of my knowledge.

Timeline

Associate Data Engineer

Softic Digitech
04.2021 - Current

Azure data engineer

Kaiser Permanente

Azure data engineer

Prudential Financial

Bachelor Of Engineering - Computer Science

Sathyabama University

Intermediate Certificate -

Sri Chaitanya IIT JR College

SSC -

Sri Chaitanya Public School
SUDEEP KOLLA