A proactive and fast learning Data Engineer with 2 Plus years of experience in a diverse range of technologies seeking an opportunity to work as a dynamic data engineer utilizing analytical, statistical skills and relevant expertise to help the company achieve business goals while sticking to vision, mission and values.
• Based on Client requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
• Designed and developed job for extraction,transformation and loading data from on-premise to GCS.
• Creating files in Github(Json) and deploying files into GCS using Harness.
• Written the SQL Scripts to fix the data in the Production Environment and developed the code as per the Client requirement.
• Migration of data from On-premise to Cloud and other Use cases.
• Worked on data validation using BITS Tool.
• Worked on Informatica Powercenter for Analyzing the source and target data.
• Created DAGs in Cloud Composer using Apache Airflow
• Working knowledge of JIRA and Confluence page.
I have learned about GCP tools and how we can deploy and secure our application and also learned about Planning and configuring data storage options( Cloud SQL, BigQuery, Firestore,Cloud Spanner, Cloud Bigtable).
TechTip24