With over 6+ years of Corporate Exposure , I am currently functioning as a Data Engineer for 4 years .Initial 2+ years worked as a Siebel Administrator. I have proven track record of working in a fast-paced environment and adaptable to last-minute changes.
With over 6 years of experience in the IT industry, I am currently specialized as a Data Engineer for 4 years.
Proven expertise in designing, deploying, and optimizing end-to-end.
Data pipelines, ETL processes, and scalable data storage solutions using cutting-edge cloud and big data.
Initial 2+ years worked as a Siebel Administrator.
Proficient in leveraging Azure Cloud services, such as Azure Data Factory, Azure Databricks, and Azure SQL.
Database, Azure Data Lake Storage (ADLS Gen2), and Azure Synapse Analytics to build robust, scalable,
and cost-effective data solutions.
Extensive experience in designing and orchestrating ETL/ELT pipelines using Azure Data Factory, integrating.
Data from diverse sources, such as Azure SQL, Blob Storage, ADLS, and Azure SQL Data Warehouse,
Ensuring seamless data ingestion, transformation, and loading.
• Skilled in developing and optimizing Spark applications using PySpark and Spark SQL in Azure Databricks
for processing large-scale datasets in formats like CSV, Parquet, and Delta Lake, enabling efficient data analysis
and transformation.
• Expertise in implementing Delta Lake architectures on Azure Data Lake Storage Gen2 for managing
Structured and unstructured data, ensuring ACID compliance, data integrity, and high performance.
• Strong proficiency in Python programming for building scalable data processing solutions, automating
workflows, and performing advanced data transformations.
• Adept at optimizing data pipelines through partitioning, clustering, and indexing strategies, significantly
improving performance and reducing processing times.
• Experienced in securing sensitive data using Azure Key
Vault for managing connection strings, credentials, and secrets within Azure workflows.
• Proficient in CI/CD pipeline implementation using Azure DevOps and GitHub, automating the deployment
of data engineering solutions and ensuring seamless integration across environments.
• Demonstrated ability to design and manage real-time and batch data processing systems, enabling data-
driven decision-making and business intelligence.
• Strong background in Agile methodologies, actively participating in sprint planning, daily stand-ups, and
retrospective meetings to deliver projects on time and within scope.
Collaborative team player with excellent communication skills, adept at working with cross-functional teams.
stakeholders to deliver data-driven solutions that enhance business insights and operational efficiency.
Azure(DataBricks,Data Factory,ADLS,Synapse)
AWS(Anthena,Lambda,S3)
MySQL, PostgresSQL, MongoDB
Above and Beyond Award
Recognized with the prestigious “Above and Beyond” award for professionalism and outstanding contributions to
the company.
Team Excellence Award
Received the "Team Excellence" award twice in a year for my exceptional dedication and unwavering support.