V Sai Bharadwaj Chintada

Project-1 # CCN Billing:

• Built a comprehensive pipeline using GCS, Cloud Functions , Cloud Composer , Big Query, Python - Panda's Report Lab.
• Drove complex Data migration from Oracle, TeraData to Big Query using Denodo, BQ Migration Service.
• Extensively used Simba Driver, JDBC Mechanisms, SQL Dumper to connect with heterogenous data Sources to connect with third part tools.
• Automated complex PDF building mechanism using python panda's and Report Lab, CLI's

Project Brief:

The goal of this project is to generate the Carbon emission billing Reports for each customer to offset carbon . We have multiple sources such as (SQL Server, Oracle,MS Access ). We used Denodo,BQMS,SQL Dumper,Sprinter to pull data from most Relational DW Servers.

Project 1.1 # Carbon Calculator Module Migration

Lift and Shift the Whole Billing Module process to Google Cloud

• Developed & Deployed Python Modules on Cloud Run as a job which was previously on linux
• Triggered Python jobs on Cloud Run using cloud Function event triggering Mechanism.
• Enabled Auto Mail Triggering Mechanism on report delivery.

Project-2 # GHG Calculator:

• Created an automatic GHG Emission calculator using large Stored Procedures
• Extremely huge files manual work was automated using Big query.
• Automated logic to load the files automatically to Big Query with no extra cost
• Developed End to End Data Pipeline using Advanced SQL Coding to make the project Cost Effective.
• Automated the GHG reports export to GCS.

Project Brief:

The Source compromises of heterogenous data sources like Oracle,Cloud SQL, .csv files. For external sources like Oracle We converted the tables as csv files and landed them to the GCS bucket. Big Query picks up the data from the GCS Bucket and load them to the associated tables using a meta data table .

Navigational Structured pipeline

Structured data sources of this project include Oracle,SQL Server,MySQL, Graph QL with data of above 4TB all together Ultimate goal is to provide a pipeline to land it to GCS using Denodo Virtualization tool.

Responsibilities

• Extensively used simba driver to connect with the Denodo platform
• REST,SOAP connectivity to publish Denodo
• Caching, Tracebility, Agg Pushdown using Denodo
• Connection of Denodo and Tableau using Tableau Bridge

A complete BI Stack project compromising ETL Using SQL Server,Analytics and Automation on top Apache Spark and data reporting on Tableau 10.3

Responsibilities

• Developed STM's and Historic, Ongoing SP's
• Automated multiple connection establishment using Apache Spark and Scala
• Automation of manual test using Apache Spark and Scala
• Creation of dashboards using Tableau (especially Butterfly charts and Bar plots)