Summary
Education
Skills
project 1
project 2
PERSONAL INFORMATION
Timeline
Generic

Pankaj Kumar Pandey

Summary


  • Total 3 Years of experience in Data Engineer and Software Development at Creative Softech Pvt. Ltd. Bangalore [March 2021 – till today]
  • Have 2+ years of experience in Data Engineer with Python, Pandas and SQL for Banking Fraud Detection and AWS IMDB Data exchange service
  • Have 1+ years of experience in Core Python Development.
  • Analyzed and Optimized fraud scenarios with historic data using Pandas and Numpy and also SQL
  • Used Matplotlib, Google Looker for the Data –Visualization
  • Have Knowledge of Banking Procedures
  • AWS IMDB Data exchange service into our S3 bucket.

Education

Bachelor of Engineering Technology - Computer Science

Sri Siddhartha Institute Of Technology
Tumkuru Karnataka
08.2011

Skills

  • Windows
  • Linux
  • AWS
  • AWS Glue
  • Python
  • SQL
  • Pandas
  • Numpy
  • Pyspark
  • Snowflake
  • Matplotlib
  • Google Looker

project 1

Client: Warner Bro's

Skill Set Used: AWS, Python, Pandas, Numpy, SQL, PL/SQL

Roles and Responsibilities :

  • Objective of the project is to Flatten the huge Json zip files to csv files using AWS glue pyspark & compare the results with Athena csv files,
  • Convert flattened json files to csv files & store them into s3 bucket, Worked on Aws Services like Aws glue, Athena, Cloud storage, API Services, Cloud watch & Aws lambda
  • Lead application migration from SQL Server to Snowflake
  • Extensive experience in flattening Complex nested JSON files using AWS glue, AWS Athena and Snowflake
  • Design framework in Python to execute Snowflake Jobs
  • Design the framework to ingest the data from AWS IMDB Data exchange service into our S3 bucket
  • Expertise in using AWS Glue for ETL
  • Extensive experience in AWS Glue like crawler, catalog, python shell, triggers, workflow, Dev endpoint & notebook
  • Design complex data ingestion pipelines using several AWS cloud services like Lambda, step function
  • Cloud Watch event, SNS notifications, S3, EC2, python boto3 SDK, Athena query, IAM roles, policies


project 2


Client: Syndicate Bank

Skill Set Used: Python, Pandas, SQL, Microsoft Excel

Roles and Responsibilities :

  • Understanding the Scenarios contributing to Fraud
  • Fetching and Analyzing the data with SQL
  • Performing Data validation and data cleaning and data pivoting
  • Analyzing the Frequencies of factors using Numpy and pandas
  • Creating dashboards, reports using Google Looker, Microsoft Excel
  • Making Predictions and suggesting better scenario approach



PERSONAL INFORMATION

Name : Pankaj Kumar Pandey

Nationality : Indian

Language Known : English, Hindi

Marital Status : Married.

Timeline

Bachelor of Engineering Technology - Computer Science

Sri Siddhartha Institute Of Technology
Pankaj Kumar Pandey