Hardik Kaneriya

Client: NIKE

Project: MSM big file

• Designed and developed end to end data flow (Big file solution) for NIKE material domain to replace legacy way of material price negotiation with vendors worldwide for future material demand which further reduced manual work by 80 % and increased efficiency by 2 folds.
• Analyzed current complex data inputs/ data cadence, and prepared High level logical and physical model.
• Created Airflow DAGs and pyspark scripts to process and collect 500 millions+ data from various databases and files to get forecast volume for material colour-wise.
• Migrated 40+ old airflow DAGS and pyspark scripts to the new design which includes python 2 to python 3 transformation.
• Guided freshers on data engineering ecosystem and technologies

SKILLS: AWS ( EMR, S3 ), Apache Airflow, Hadoop, HIVE, Spark, Pyspark, Jenkins, GIT

• Design various AWS resource creation pipeline automation with necessary alert monitoring, auto-scaling, password rotation, vpc, security configuration and IAM policies and federated roles using clouformation template.
• Implemented AWS file transfer family(SFTP-FTPS) and data sync to store various data files in S3 using API Gateway based access authorization.
• Designed pipeline by creation of airflow DAGs and deployment.

SKILLS: S3, EMR, SNS, SQS, PYTHON, AWS Lambda, API Gateway, IAM, VPC, Cloudfomation, SQL, RDBMS

• Performed end to end data solution working closely with product development team and clients of TrueValue Retail Company for store conversion which helped them to reduce 40% of actual store conversion time.
• Built AWS serverless micro-services and API's which helped customers to decide on selecting exact match, similar match and no match criteria for all items in store.
• Designed ETL Logic using Spark and python on AWS Glue and stored that data into AWS S3 which was then fed as input to Machine learning model for item Matching.
• Performed Data analysis for machine learning model and suggested client to improve ML model matching capability.

SKILLS: Python, SQL, Spark, AWS S3, AWS Gateway, AWS Glue, AWS S3, AWS RDS, Code commit, Jenkins

• Integrated Various kind of Validation and Prepared Analytical data for Swiss-global health-care company project which helped them to improve their business by 10 % and adhere to FDA and NDA guidelines .
• Developed complex SQL queries to prepare data for analyst to perform various analysis which helped clients to increase business by focusing on highlighted insights.
• Build and implement data fixes and validations through oracle database programming language (SQL,PL/SQL).

SKILLS : SQL , PL-SQL , Python , SQL Developer , Bit-Bucket