Summary
Overview
Skills
Work History
Education
Certification
Latest Skills Projects
Linkedin Profile
Languages
38
Karan Trivedi

Karan Trivedi

Pune,MH

Summary

A qualified IT professional with 9.5 years of experience with PHP and WordPress, transitioning toward Azure Data Engineering, connected to creating processes and converting information into knowledge. Experience building data pipelines and performing ETL with cloud technologies. Experience engineering and orchestration of data workflows at scale utilizing Python, Azure Data Factory, Databricks and SQL. Experience with programming and distributed processing using PySpark, and data integration and analytics using Azure Synapse Analytics to provide end-to-end solutions. Familiar with implementing CI/CD pipelines using GitHub Actions, Power BI, and MS Fabric for interactive reporting and data visualization. Interested in leveraging full stack data engineering concepts to enable scalable, efficient, safe datascapes on Microsoft Azure.

Overview

10
10
years of professional experience
1
1
Certificate

Skills

  • Experienced in PHP development for dynamic web applications and backend logic
  • Skilled in WordPress development, including custom themes, plugins, and CMS management
  • Expert in MySQL for relational database design, optimization, and advanced SQL queries
  • Competent in GitHub CI/CD for version control, continuous integration, and automated deployments
  • Proficient in Microsoft Fabric for unified data integration and analytics across services
  • Skilled in Power BI for creating interactive dashboards and reports with DAX and Power Query
  • Strong command of SQL for data manipulation, reporting, and complex query building
  • Hands-on experience with PySpark for scalable data processing and distributed computing
  • Proficient in Azure Synapse Analytics for data warehousing, SQL queries, and Spark workloads
  • Solid programming skills in Python for scripting, data analysis, and automation
  • Experienced in Azure Data Factory (ADF) for building and orchestrating pipelines
  • Knowledgeable in Databricks for big data processing, collaborative notebooks, and Delta Lake

Work History

Senior Software Engineer

Asentech LLC
05.2024 - 01.2025
  • Developed scalable applications using agile methodologies for timely project delivery.
  • Managed multiple projects simultaneously while maintaining strict deadlines and high-quality standards.
  • Maintained comprehensive documentation of development work, facilitating knowledge sharing among team members.
  • Enhanced software functionality by identifying and resolving complex technical issues.

Senior Software Engineer

HiddenBrains Infotech Pvt Ltd
07.2022 - 09.2023
  • Developed scalable applications using agile methodologies for timely project delivery.
  • Managed multiple projects simultaneously while maintaining strict deadlines and high-quality standards.
  • Maintained comprehensive documentation of development work, facilitating knowledge sharing among team members.

Lead Software Engineer

Bacancy Technology
07.2020 - 02.2022
  • Worked collaboratively with stakeholders to resolve technical roadblocks.
  • Led a team of software engineers to successfully complete projects within deadlines, ensuring high-quality end products.
  • Designed, coded, tested, debugged and documented programs using agile development practices.
  • Implemented and adopted cloud technologies and best practices for automation, configuration, monitoring and platform scalability.

Sr Wordpress Developer

Quark Studios
04.2019 - 01.2020
  • Customized e-commerce solutions for online businesses using WooCommerce plugin integration.
  • Installed required plugins and additional coding to fit final design and functionality requirements.
  • Developed and implemented WordPress sites, themes and plugins.
  • Converted design assets into component-based HTML, CSS and JavaScript.

Sr PHP Developer

AIS Technolabs Pvt Ltd
08.2018 - 04.2019
  • Collaborated with cross-functional teams to develop high-quality software solutions on schedule.
  • Proactively identified opportunities for process improvements, driving increased team productivity and collaboration.
  • Supported the transition from monolithic to microservices-based architecture, contributing significantly to increased system resilience and flexibility in development cycles.
  • Led successful completion of complex projects by coordinating resources effectively and ensuring all milestones were met on time.

Sr Backend Developer

Solulab Inc
08.2017 - 08.2018
  • Developed scalable APIs for seamless integration with front-end applications, improving overall user experience.
  • Increased website responsiveness by identifying and resolving bottlenecks in server-side processes.
  • Mentored junior developers in best practices and coding standards, fostering a collaborative team environment.
  • Troubleshot complex technical issues to identify root causes, developing effective solutions to prevent future occurrences.

Jr PHP Developer

IFlair WebTechnologies Pvt Ltd
12.2015 - 07.2017
  • Utilized version control software such as Git to manage codebase efficiently while collaborating with team members seamlessly.
  • Streamlined data processing tasks for better user experience with well-designed database queries.
  • Actively participated in daily stand-ups within an Agile environment to foster collaboration between team members working on different aspects of the project.
  • Resolved technical issues promptly, ensuring minimal downtime for clients'' websites.

Jr PHP Developer

Iverve Limited
09.2014 - 12.2015
  • Developed and maintained dynamic web applications, resulting in increased user engagement and satisfaction.
  • Maintained clear documentation explaining project specifications and progress updates throughout the development cycle for effective communication among stakeholders.
  • Stayed up-to-date with industry trends and emerging technologies, incorporating them into projects as appropriate for continuous innovation.

Education

Bachelor of Engineering - Electrical, Electronics And Communications Engineering

R C Patel Institute of Technology
Shirpur Maharashtra
07-2011

Diploma - Electrical, Electronics And Communications Engineering

Swami Sachchidanand Polytechnic College, Visnagar
Visnagar, Gujarat
07-2008

SSC -

Ankur School
Ahmedabad , Gujarat
04-2002

Certification

  • Azure Data Engineer Masterclass - The Complete Guide

Latest Skills Projects

Project: Data Lake Ingestion & Processing using ADLS, ADF, Databricks, Spark SQL
  • Developed a scalable data pipeline using Azure Data Factory to ingest data into Azure Data Lake Storage (ADLS).
  • Performed data transformations using Databricks and Spark SQL.
  • Implemented data partitioning and optimized Delta Lake tables for performance.
Project: End-to-End Azure Data Engineering with ADF, ADLS, Azure SQL, Databricks & Power BI
  • Ingested and transformed structured and semi-structured data using ADF pipelines and Databricks notebooks.
  • Stored cleansed data in Azure SQL Database and visualized key insights using Power BI dashboards.
  • Enabled real-time refresh and implemented role-based access in Power BI.
Project: Advanced Analytics on Azure Synapse with ADF, ADLS, Spark SQL
  • Built and orchestrated ETL workflows using Azure Data Factory to move data from ADLS to Synapse.
  • Leveraged Spark pools for transformation and SQL dedicated pools for querying performance.
  • Applied schema management and query optimization.
Project: Data Migration from On-Premise SQL Server to Azure Data Lake
  • Migrated large volumes of historical and transactional data securely to Azure Data Lake using ADF.
  • Ensured data integrity with checksum validations and logging mechanisms.
  • Handled schema mapping and incremental migration.
Project: Incremental Load Data Pipeline with ADF & Databricks
  • Designed and implemented an incremental load strategy using watermarking and change detection logic.
  • Orchestrated the pipeline with Azure Data Factory and processed data via Databricks notebooks.
  • Enabled metadata-driven dynamic pipelines.
Project: Superstore Sales Dashboard in Power BI
  • Developed interactive dashboards to analyze sales, profit, and region-wise performance metrics.
  • Implemented DAX measures and calculated columns to derive insights.
  • Added drill-throughs, bookmarks, and slicers for enhanced UX.
Project: Sales Analysis using Databricks
  • Performed exploratory data analysis and trend discovery on sales data using Databricks.
  • Used PySpark for data cleaning, aggregation, and visualization within notebooks.
  • Generated insights on product-wise performance and seasonal patterns.

Linkedin Profile

https://www.linkedin.com/in/kntade/

Languages

English
Intermediate (B1)
Hindi
Intermediate (B1)
Gujarati
Intermediate (B1)

Similar Profiles

CREATE PROFILE
Karan Trivedi