MD SHAHID
Bengaluru
Summary
Results-driven Data Engineer with 1.5 years of experience in building scalable data pipelines, data modeling, and warehousing. Proficient in Python, SQL, C++, PySpark, and Azure tools including Synapse, Databricks, ADLS, and ADF. Skilled in data migration, pipeline design, and optimizing data solutions for valuable business insights. Detail-oriented, organized, and meticulous employee. Works at fast pace to meet tight deadlines. Enthusiastic team player ready to contribute to company success.
Overview
1
1
year of professional experience
Work History
Software Engineer
Aarmec Technologies
09.2023 - Current
- Used Azure Data Factory (ADF) to perform Incremental Loads from Azure SQL DB to Azure Synapse.
- Extract Transform and Load data from Sources Systems to Azure Data Storage services using combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics.
- Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing data in In Azure Databricks.
- Optimized Azure Data Factory (ADF) Pipelines with Various Partitioning Techniques to decrease budget of project to 20%
- Performed Storage and Analytics Operations using Notebooks with Azure Databricks
- Performed Storage and Analytics Operations using Azure Data Lake Analytics [ADLA]
Education
Bachelor of Engineering - Computer Science
Sir M Visvesvaraya Institute of Technology
Bengaluru, India07-2023
Skills
- Programming Languages
C, SQL, Python, Pyspark, JavaScript
- Technical Stack
- ADLS, ADF, Azure Synapse, Azure SQL, Databrick ,Data Pipeline Design, Data Modeling, Data Warehousing, Data Migration, GIT, MS SQL Server 2017
Accomplishments
- Saved 20% of data engineering project budget
- Won 1 best performance awards for the outstanding work executed on various projects
Projects
1. FreightLINK – Web Portal and FreightVISION Mobile App
Lane Axis is a platform to provide a network of professional Drivers, Carriers and Shippers through the FreightLINK – Web Portal and FreightVISION – Mobile app. The Drivers can use the Mobile app for accepting the loads, navigation for pickup and dropoff, messaging to the Carrier and Shipper on real-time basis. The Carrier and Shipper uses the Web portal to create the shipments and assign them to the Drivers.
Timeline
Software Engineer
Aarmec Technologies
09.2023 - Current
Bachelor of Engineering - Computer Science
Sir M Visvesvaraya Institute of Technology
Similar Profiles
Venkata Nagaraju InakolluVenkata Nagaraju Inakollu
Technical Lead(System Design) at Relysys Technologies Pvt Ltd (now Invendis Technologies pvt ltd)Technical Lead(System Design) at Relysys Technologies Pvt Ltd (now Invendis Technologies pvt ltd)
Sachin HatoleSachin Hatole
Quality Analyst at Mindpool Technologies Pune, Mindpool TechnologiesQuality Analyst at Mindpool Technologies Pune, Mindpool Technologies
Keith LawrenceKeith Lawrence
Material Handler at Casting Technologies TechnologiesMaterial Handler at Casting Technologies Technologies
Lavanya JoshiLavanya Joshi
Program Manager at Amazon Development CentreProgram Manager at Amazon Development Centre
Yaman KalraYaman Kalra
Senior Project Manager at Define LabsSenior Project Manager at Define Labs