Overview
Work History
Education
Skills
Certification
Volunteer
Timeline
Generic

DEEP PATEL

Pune

Overview

3
3
years of professional experience
1
1
Certification

Work History

Big Data Developer

CREDIT SUISSE
Pune
08.2022 - Current

Part of Finance One F1, a strategic big data platform for the entire CFO business, developed in-house by the FL Engineering team.

  • Managed data accuracy, data completeness, data transformation, and validation across the managed data layer for SWISS and NY.
  • Implemented Jenkins pipelines to automate the build, test, and deployment processes, ensuring seamless and efficient CI/CD workflows.
  • Automated routine tasks using scripting languages such as Shell and Python, reducing manual intervention and operational overhead.
  • Resolved data integrity and quality issues in SIT/UAT/Production, addressing data duplication and missing columns in Parquet/JSON (L2/L3 Support)
  • Enhanced 250+ feeds batch processing stability and performance in Managed Data Layer using Python, Spark, Shell scripting, and CTRLM Job Scheduler.
  • Hands-on experience in ETL/ELT processes involving the transformation of source data as per technical and business rules to comply with user requirements and regulatory standards.
  • Familiar in utilizing REST API, Docker, Containers, and the Kubernetes framework for improved data access and utilization.
  • Contributed in multiple releases in F1 across different work streams.
  • Implemented Data Warehouses, Big Data, and Data Lakes with a strong understanding of Master Data Management and DQ checks.
  • Built mappers and APIs to enable cross-cluster dependency and user access to data.
  • Developed Hive tables, views, mappers, and Linux scripts to process incoming reference data from multiple data hubs.
  • Played a key SME role in data migration and decommissioned multiple job/feeds activities during the Parent Bank Merger phase with UBS, reducing operational costs.
  • Integrated Continuous Integration/Deployment pipelines, code reviews, pull requests, unit/integration/e2e testing.
  • Currently gaining cloud experience with UBS on Azure and Databricks, optimizing workload patterns to achieve a 25% decrease in computational expenses.
  • Optimized data partitioning with PySpark, enhancing Spark job performance in Databricks workspace and achieving a 7% increase in processing efficiency and faster query execution.

Associate Software Engineer

Datametica Solutions Pvt Ltd.
Pune
01.2022 - 07.2022
  • Assisted in the migration project of Teradata Enterprise Data Warehouse to Google Cloud Platform, implementing techniques such as Cloud Composer and Airflow DAGs.
  • Identified and resolved issues, deploying interfaces for a smoother transition process
  • Acquired hands-on experience with various GCP Components such as Big Query, Cloud Storage, Cloud Composer, and Dataflow.

Education

B.Tech. - Computer Science

Vishwakarma Institue Of Technology
Pune, MH
07-2022

Skills

Programming

  • Python , C , SQL , Shell Scripting , Scala , Linux/Unix , OOPS

-

Data Technologies & Tools

  • Jenkins Pipelines , CI/CD , Git , ETL/ELT , MySQL , Docker , Container , Kubernetes , REST API , Apache Hive , Impala , HBase , Splunk , Spark , Hadoop , MapReduce , Kafka , MongoDB , Oracle , Airflow , Azure Cloud , Google Cloud , BigQuery , Cloud Composer , Databricks , Data Warehousing/Analytics , NoSQL , Agile Methodologies
  • IntelliJ , Tectia SSH , PyCharm , VSCode , RDBMS , SDLC , Agile MapReduce , Dataframes , Pandas , NumPy ,GitLab , Odyssey , JIRA , Confluence

Certification

  • DP-203 Azure Data Engineer Associate
  • Databricks Certified Data Engineer Professional
  • Coursera: Managing Big Data in clusters and cloud storage
  • 5+ Google Cloud QwikLabs certifications

Volunteer

  • Big Data CoP Day event Presenter at UBS Tech Conference , 2024
  • 1st Runner up CS Hackathon , 2023
  • Active Volunteer for IT India EEE Cultural work stream - Performance Excellence , 2023
  • Multimedia Design Head - IEEE Club - VIT Pune , 2021

Timeline

Big Data Developer

CREDIT SUISSE
08.2022 - Current

Associate Software Engineer

Datametica Solutions Pvt Ltd.
01.2022 - 07.2022

B.Tech. - Computer Science

Vishwakarma Institue Of Technology
DEEP PATEL