Experienced Data Engineer with 3 years of industry experience specializing in Google Cloud Platform components such as Big Query, SQL, Google Cloud Storage, Data Procs, Hadoop and Apache Airflow. Proven ability to design and optimize data infrastructure, develop effective ETL pipelines, and ensure data integrity. Strong expertise in building complex SQL queries for in-depth analysis, leveraging Airflow to streamline workflow, and utilizing DataProc and Hadoop for distributed data processing tasks. Made data-driven decisions andcollaborated across teams.
Project 1
Project 2
Helios Project
Optimize banking operations by analyzing real-time data on ATM usage and branch traffic, leading to enhanced
service delivery.
Utilize Google Big Query as the central data warehouse for storing and analyzing real-time financial data, providing
scalable and cost-effective storage and processing capabilities.
Involved in Development of creating Data Pipeline to read the Data from Different sources and load data such as
transaction logs, customer details, and market data feeds to Big Query.
Responsible for creating the GCP buckets, Datasets, Big Query tables in different layers of BQ projects.
Worked on Creating DAG’s and tasks to deploy and run jobs in the Airflow scheduling tool.
Perform data processing and analysis using BigQuery's SQL-based querying capabilities, complex aggregations,
and advanced analytics on large datasets.
To find out root cause of the issue using Airflow logs and applies solution for the particular job.
Created Authorized views in Big Query to provide data to Down Streams (ML/Reporting/Analytics/Dashboards) for
enhancing decision-making capabilities
Collaborative team member with experience in diverse projects, fostering team dynamics and aligning strengths for successful outcomes.
Strong issue-resolution skills, having effectively managed a variety of technical and operational problems in data-driven environments.
Fast learner, adept at adapting to new technologies and standards. Ideal for fast-paced tech environments