AJU PRADEEP
AZURE DATA ENGINEER
Summary
Experienced Azure Data Engineer specializing in designing and implementing scalable, cloud-based data solutions using Azure Databricks and Azure Data Factory (ADF). With over a decade of combined experience in telecom and IT, brings a wealth of knowledge in data integration, analytics, and cloud technologies. Proficient in Lakehouse architecture, OneLake, and Data Activator to facilitate real-time analytics and seamless data processing. Skilled in PySpark, SQL, Delta Lake, and Dataflows, with hands-on expertise in Azure Data Lake Storage (ADLS), Azure SQL Database, and Power BI for advanced analytics and reporting. Adept at optimizing Spark jobs, orchestrating complex data workflows, and ensuring data integrity across distributed systems. Passionate about leveraging Microsoft Fabric and Azure services to develop high-performance data solutions, financial analytics, and business intelligence.
Overview
10
10
years of professional experience
8
8
years of post-secondary education
6
6
Certifications
Work History
Azure Data Engineer
Corefront Technologies
01.2021 - Current
- Azure Data Architecture & Pipeline Development: Designed and implemented scalable Azure-based data solutions, ensuring alignment with business objectives and stakeholder requirements.
- Azure Databricks & Spark Optimization: Engineered Spark applications in Databricks, leveraging PySpark, Spark SQL, and Delta Lake to enable efficient data extraction, transformation, and aggregation.
- Data Pipeline Performance Enhancement: Developed and optimized Azure Data Factory (ADF) pipelines, reducing execution time by 20% through incremental loading and performance tuning.
- Data Storage Optimization: Transformed Parquet files into Delta format, achieving a 30% reduction in storage costs and a 50% improvement in processing speed.
- Batch Data Ingestion & Processing: Managed data ingestion from databases, APIs, and files into Azure Data Lake Storage (ADLS) and Databricks Delta Tables, ensuring efficient batch processing.
- Workflow Automation & Orchestration: Implemented dynamic source control tables in Databricks to automate pipeline configurations, improving adaptability and parameterization in ADF.
- ADF Components Utilization: Effectively used Pipelines, Linked Services, Lookups, Get Metadata, For Each loops, and If conditionals to orchestrate seamless ETL workflows.
- Logging & Monitoring Enhancements: Established centralized logging within ADF pipelines, improving monitoring, troubleshooting, and execution efficiency.
- Security & Compliance: Integrated Azure Key Vault for securely storing connection strings and certificates, ensuring robust data security and compliance with industry regulations.
RF Optimizer Engineer
Evolve Technologies and services Pvt Ltd
03.2015 - 07.2020
- Company Overview: Deputed to Samsung India Electronics PVT Ltd
- Configured and optimized eNodeB parameters (PCI, TAC, Cell ID, PRACH, and handover thresholds) to enhance LTE network performance.
- Extracted and processed network KPIs (RSRP, SINR, CQI, Handover Success Rate) for RF tuning and capacity optimization.
- Developed ETL workflows to collect and analyze eNodeB configuration, alarms, and performance logs in databases.
- Automated bulk configuration provisioning for eNodeB sites using SQL, and Shell scripting, reducing manual efforts by 60%.
- Integrated eNodeB performance data with OSS/BSS systems for real-time monitoring and troubleshooting.
- Deputed to Samsung India Electronics PVT Ltd
Education
B.Tech - EC
Calicut University
Kozhikode 03.2006 - 03.2010
Diploma - Computer Application
IIE
Ernakulam 09.2010 - 09.2013
CCNA,CCNP - undefined
MAGB TUNES
TRIVANDRUM 12.2013 - 05.2014
Data Engineer - undefined
Udemy
08.2020 - 12.2020
Skills
Azure Data Factory deployment
Azure Data Lake Storage proficiency
Databricks expertise
Azure Monitor expertise
End-to-end pipeline development
Data ingestion, transformation, and orchestration
PySpark development
SQL
Python
Azure DevOps
ETL development
Data pipeline design
Certification
Data bricks certified data engineer associated
Timeline
Azure Data Engineer
Corefront Technologies
01.2021 - Current
Data Engineer - undefined
Udemy
08.2020 - 12.2020
RF Optimizer Engineer
Evolve Technologies and services Pvt Ltd
03.2015 - 07.2020
CCNA,CCNP - undefined
MAGB TUNES
12.2013 - 05.2014
Diploma - Computer Application
IIE
09.2010 - 09.2013
B.Tech - EC
Calicut University
03.2006 - 03.2010
Similar Profiles
Ayyappa NelluriAyyappa Nelluri
Business Analyst at Corefront Technologies Pvt LtdBusiness Analyst at Corefront Technologies Pvt Ltd
VAMSI RAJA KETHAVAMSI RAJA KETHA
Software Quality Assurance Analyst at Corefront Technologies Pvt LtdSoftware Quality Assurance Analyst at Corefront Technologies Pvt Ltd
CHANDRU SCHANDRU S
Automation Test Engineer at Corefront Technologies Pvt. Ltd.Automation Test Engineer at Corefront Technologies Pvt. Ltd.
SIVARANJANI NSIVARANJANI N
DATA ENGINEER, ROLE : Azure Data Engineer at AZUREDATA ENGINEER, ROLE : Azure Data Engineer at AZURE
Keerthika MuthyalaKeerthika Muthyala
Azure Data Engineer in Modern Data Platform at ACCENTUREAzure Data Engineer in Modern Data Platform at ACCENTURE