SANDEEP KUMAR DAS

• Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
• Compiled, cleaned and manipulated data for proper handling.
• Designed and developed analytical data structures.
• Prepared documentation and analytic reports, delivering summarized results, analysis and conclusions to stakeholders.

• Worked as a Lead Data Engineer for a leading insurance and financial services company.
• Was Involved in re-architecting a data harmonization and curation framework completely built in Spark.
• Helped minimize the number of jobs created by using job bundling and bringing the overall subscription cost down.
• Developed independent data optimization framework to optimize the delta raw tables resulting in faster query execution downstream.
• Developed and configure Splunk dashboards and enable triggers from Splunk dashboards for any deviation.
• Developed and configure ticketing for threshold breach during job run to respective support DLs.
• Gathered client requirement specification and did the requirement grooming, effort estimation and capacity planning.
• Team management from offshore. Maintaining the overall delivery timeline on track. Raising delivery risks on time for mitigation.

Worked briefly as an architect to redesign a product in Azure Data Factory and Azure Databricks

• Worked as a Lead Data Engineer for a leading Consumer Products Clent.
• Worked primarily on Azure Data Factory and Azure Databricks to ingest data from on premise data source to Azure Data Lake.
• Built a Delta Lake for efficient data storage and querying.
• Was elevated soon to work as a lead for one of the functions. Did handle all stake holders request by frequent brainstorming sessions and collaborations.

• Developed a Java utility, removed the dependency on the hard coded direct connection to the Oracle Metadata Tables. Instead teams used the utility using arguments, which inherently called a web service, to fetch data from Oracle MD.
• Also, worked as a Data Engineer to build workflows in Oozie to get data from Teradata to Hadoop.

• Developed a brand new web reporting tool in Apache Spark and Cassandra to replace the legacy system.
• Was involved in the entire software life cycle starting from design, develop, unit test until integration and deployment.
• Had rigorous hands-on Spark and Cassandra. Built a Open Source Spark and Cassandra cluster.
• Prepared reports and technical documentation of day-to-day production processes.
• Oversaw the timeline delivery of sprint deliverables of the entire team.

• Worked for an esteemed Telecom Client to enhance a web-based tool for reporting and accounting/billing purposes. The enhancement included GUI support in Firefox browser, support for new mobility type, data migration code optimization, DB size optimization, additional language support like Hebrew and Arabic.
• Worked as a Data Engineer for a trillion dollars Computer and Consumer Electronics Company. Worked Primarily in Hadoop, Hive and Oozie to build pipelines to load semantic data to HDFS. Also developed a Data Validation tool in Core Java to validate the data at semantic layer.