SuneelKumar Reddy Potteti
Bengaluru
Summary
Experienced data engineer with over 4 years in designing, building, optimizing data pipelines and infrastructure. Proficient in leveraging big data technologies to enable data-driven decision-making and improve operational efficiency. Adept at transforming raw data into actionable insights and ensuring data accuracy, integrity, and security. Experienced in collaborating with cross-functional teams to deliver scalable and robust data solutions. Possess a strong background in Azure Cloud Platform and extensive experience in Databricks. Seeking to contribute my expertise to a dynamic organisation focused on harnessing data for strategic growth and innovation.
Overview
6
6
years of professional experience
Work History
Azure Data Engineer
GoldmanSachs
Bengaluru
03.2024 - Current
- Orchestrated complex data workflows with Azure Data Factory, increasing process automation by 45%.
- Implemented dynamic pipeline parameters for multi-environment deployments, reducing deployment time by 30%.
- Created custom connectors and integration runtime configurations, enhancing data source connectivity by 50%.
- Utilized monitoring features to proactively resolve data pipeline issues, decreasing system downtime by 20%.
- Established Delta Lake transactions on Azure Databricks, improving data reliability by 40%.
- Engineered Azure Data Lake Storage solutions, achieving a 35% reduction in data storage costs.
- Developed historical data versioning using Delta Lake's time travel feature, enhancing compliance by 30%.
- Optimized Delta Lake table partitions to reduce query latency by 35%, improving large dataset management.
- Developed Delta Lake-based streaming analytics solutions using Azure Databricks Structured Streaming, yielding a 50% increase in real-time data processing capabilities.
- Engineered scalable data migration solutions into azure data lake, integrating 7 primary data sources using Oracle Tools, effectively accommodating a 50% increase in processing to support growth strategies
- Deployments of data pipelines into different environment using Azure devops git
Azure Data Engineer
Publicis Sapient
Bengaluru
12.2021 - 03.2024
- Utilized Python, PySpark, SQL, and Azure Databricks for data cleansing and transformation to ensure quality and consistency.
- Designed and deployed end-to-end data pipelines on Microsoft Azure using Azure Data Factory and Azure Synapse.
- Implemented ETL processes to ingest structured and unstructured data into Azure data lakes and warehouses.
- Optimized data pipelines for performance, scalability, and cost-efficiency to meet service level agreements.
- Ensured data security and compliance by applying role-based access control and encryption measures.
- Monitored data pipeline health, proactively troubleshooting issues to minimize downtime.
- Integrated Azure Databricks with Azure Synapse Analytics for enhanced data processing capabilities.
- Collaborated with Azure DevOps teams to establish CI/CD pipelines for automated deployment of ADF and notebooks.
Test Automation Engineer
Gyan N Gigs Consulting LLP
Bengaluru
01.2021 - 12.2021
- Analyzed requirements and specifications to ensure comprehensive understanding of application needs.
- Identified and developed feature-specific test cases and scenarios for thorough validation.
- Extracted locators from web pages and organized them into a locator file.
- Prepared test data to support data-driven framework initiatives.
- Designed and developed test automation scripts utilizing Selenium Web Driver.
- Executed automation scripts for regression testing to verify application stability.
- Created feature files and authored step definitions using Cucumber BDD framework.
- Participated in sprint grooming sessions and daily stand-ups with onsite client teams.
Production Support Analyst
TekShapers
Bengaluru
09.2019 - 03.2020
- Provided technical support for production systems and applications.
- Documented processes and procedures for efficient workflow management.
- Evaluated third party tools and services used within the company's IT infrastructure.
- Analyzed system issues and coordinated with development teams for resolutions.
Education
Bachelor of Technology - Mechanical Engineering
Madanapalli Institute of Technology & Science
Madanapalli04-2018
Skills
- Python
- PySpark
- SQL
- Azure Data Factory (ADF)
- Azure DataBricks
- Azure Syanpse Analytics
- Azure SQL Database
- Delta lake
- Azure Datalake storage
- Azure Devops
- ETL / ELT processing
- Hadoop, Hive, Sqoop
Professional Experience
- Publicis Sapient – Data Engineer | December 2021 – Present
- Gyan N Gigs Consulting LLP – Sr Test Automation Engineer | Jan 2021 to Dec 2021
- Tekshapers Software Solutions Pvt. Ltd. - Production Support Analyst. | Sep-2019 to Mar-2020
Timeline
Azure Data Engineer
GoldmanSachs
03.2024 - Current
Azure Data Engineer
Publicis Sapient
12.2021 - 03.2024
Test Automation Engineer
Gyan N Gigs Consulting LLP
01.2021 - 12.2021
Production Support Analyst
TekShapers
09.2019 - 03.2020
Bachelor of Technology - Mechanical Engineering
Madanapalli Institute of Technology & Science