Binit Chowdhary

Client : PowerCo (Volkswagen Company)
Project :

Develop data solutions for operations on the manufacturing side of business.

Key Deliverables :

• Design and develop back end for supporting real time Shopfloor Visualizations for machine status, telemetry and events.
• Design data models for the serving layer.

Skills : Databricks, DLT, Streaming, SQL, PySpark, Python, Azure DevOps etc.

Client : LSEG

Project :

Design and develop solutions for Fintech Data Products leveraging medallion architecture and fabric in collaboration with Microsoft.

Key Deliverables :

• Implemented tool for LDM to PDM conversion for data products. Served the data to Purview team for establishing governance and Data dictionary.
• Implemented XML parsing framework.
• Leveraged prompt engineering using Open AI to create SQLs for data transformation to Data Products.
• Optimized frameworks by adding data partitioning. Reduced processing time from ~15 hrs to ~2 hrs.
• Developed streaming solution for real time report to update investment advice based on market events or customer behavior.

Skills : Microsoft Fabric, SQL, PySpark, Python, Databricks, DLT, Streaming, ETL, Gitlab etc.

Client : Internal

Project :

Worked on developing solution to feed Smart Property Application to be used by Property consultants working on Valuations business of Capital Markets.

Key Deliverables :

• Ingested data from various sources like SFTP, RDBMS, APT etc. Handled csv, json, parquet, avro etc
• Implemented Data Hub for Global vs Regional. Streamlined architecture.
• Tuned performance of Stored procedure, introduced incremental processing. Load time improvement from ~5 hrs to 25-30 mins.
• Optimized performance of pyspark scripts. Brought down processing time from ~11 hrs to less than 2 hrs.
• Migrated Data Hub from Azure SQL server to Delta lake. Decreased processing time by 30%, streamlined architecture.
• Automated test cases and ensured code coverage is per industry standards.

Skills : SQL, PySpark, Python, Databricks, Azure Data Factory(ADF), Azure Data lake(ADLS), Data Warehousing, Azure Synapse, ETL, Azure SQL Server, Azure Functions, Azure DevOps, GitHub, Storage Accounts etc.

Client : JLL( Deployed as Senior Data Engineer @JLL on Contract)

Project : Deployed to JLL as contractor hence, added details under JLL.

Key Deliverables : Deployed to JLL as contractor hence, added details under JLL.

Skills : SQL, PySpark, Python, Databricks, Azure Data Factory( ADF), Azure Datalake(ADLS), Azure Synapse, ETL, Azure Sql Server, Azure Functions, Azure DevOps, GitHub, Storage Accounts etc.

Client : Cerner

Project :

Worked on modernizing project for FSCM reporting data from Informatica & on-premise to Azure Cloud. Was responsible for ingesting, developing end to end solution in cloud by understand the existing logics.

Key Deliverables:

• Implemented logic in pyspark to load incremental data, perform SCD 1 & 2 merge.
• Developed ADF pipeline to read, load data from Oracle OLTP to data lake and orchestrate databricks notebooks.
• Developed function to load data from Databricks to Snowflake.Created required views in Snowflake

Skills : SQL, PySpark, Python, Databricks, Azure Data Factory(ADF), Azure Datalake( ADLS), ETL, Snowflake, Kafka, Azure DevOps, GitHub, Key Vaults, Storage Accounts etc.

Client : North America Truck Manufacturer

Project :

Led team of 10 developers. Was responsible for Requirement analysis, technical design and development.

Key Deliverables:

• Developed Stored Procedures to merge data per business requirements.
• Supported and enhanced Informatica ETL logics.
• Worked on developing integration of data from on-premise to cloud for analytics.
• Ingested Finance data to ADLS, developed pyspark scripts to create dimensions and facts.

Skills : Oracle RDBMS, Informatica, Azure Data Factory, Azure Databricks, Pyspark, Azure Sql Server, SQL etc