Detail-focused Data Analyst with knowledge in data warehousing, process validation and business needs analysis. Proven to understand customer requirements and translate into actionable project plans. Dedicated and hard-working with passion for Big Data.
1.File Format Converter Handout
Overview
The objective of this project is to develop solutions based on the design provided. In this case, the source data was obtained in the form of CSV files from a MySQL DB.
To improve the efficiency of our data engineering pipelines, we need to convert these CSV files into JSON files, since JSON is better to use in downstream applications than CSV files. The scope of this project involves converting CSV files into JSON files.
Technologies Used
Programming Language – Python
Pandas – For Converting CSV to Dataframe and then Dataframe into JSON.
2.Files To Database Loader Handout
Overview
The objective of this project is to develop solutions based on the design provided. In this case, the source data was obtained in the form of files from a MySQL DB.
We require the data to be loaded into PostgreSQL, which is a common scenario in companies who want to change underlying database technologies, in which case the data from one DB needs to be migrated into another DB. The Project scope is to migrate file-based data to PostgreSQL tables
Technologies Used
Programming Language – Python
Pandas – For Converting CSV to Dataframe and then load the Dataframe into Postgres Database