DEEPAK GOGOI

Project - Wallsteet (Finance Accounting)

• Ingesting data from data sources using combination of MySQL, PySpark
• Report Development - Seller reports for revenue recognition and accounting via
• Translate the business propositions into quantitative queries and collect/clean the necessary data
• Using scheduling tools such as Airflow and Rundeck to run and execute data flows

Automation

• Automating data veracities between multiple source and destination using Python and Spark
• Automating validation reports to ensure data consistency and correctness

Operational

• Working with stakeholders to address any concerns on reports and data related issues
• Ensuring systems are ready for HRD (high revenue days) and performing necessary scale up and scale down
• Ensuring required bug fixes / issues are addressed when OnCall
• Day to day task on MySQL/HiveQL to solve data related concerns.

• Explored new Big Data technologies and approaches to streamline processes.
• Worked in hybrid environment where legacy and data warehouse applications and new big-data applications co-existed.
• Worked on GCP and build data streaming pipeline using DataFlow,BigQuery
• Interacted with customers by phone, email, or in-person to provide information.
• Experienced working on Hadoop, Hive, Sqoop, kafka, Spark, Impala.