Siva K

· Worked on Creating DAG's and tasks to deploy and run jobs in the Airflow scheduling tool. Used Source code Management (SCM) as GI Hub.

· Responsible for ingesting the data from one dataset to different datasets through BQ.

· Queries as a part of ELT and ETL process. Responsible for SIT walk through to Business to get Sign-off. Responsible for Generating the Test reports through Python Automation framework.

· Responsible for providing Data Quality Assurance.

· Responsible for analyzing the requirements and designing the requirements page.

· Responsible for creating the GCP buckets, Datasets, Big Query tables in different layers of different BQ projects.

· Created Authorized views in BigQuery to provide data to Down Streams.

· Involved in Development of creating Data Pipeline to read the Data from Kafka and data to Big Query.

· Working with terms creates various level metric and supporting data pipelines written GCP stack working with large sets of data and solving difficult analytical problem as per the client requirement on Google cloud platform service Such as big query, cloud pub/sub.

· Used cloud shell SDK in GCP to configure the serving data proc, storage, big query Troubleshooting user’s analysis bugs (JIRA AND IRIS TICKETS).

· Crated ETL pipeline using spark to ingest data from multiple sources.

· Responsible for creating the GCP buckets, Datasets, BigQuery tables in different layers of BQ.

· Participation in review Clients calls.