JAYADEERAJ Peela

Project: ERP Application

• Performed Import and Export of remote data to AWS s3.
• Performed data reading from amazon s3 using spark.
• Developed spark code and deployed in EMR.
• Involved in delivering the resultant data to RDS and Redshift.
• Ran necessary containers in AWS to run docker files.
• Scheduled necessary scripts in EC2 to integration with other servers.
• Created Lambda functions in AWS to run ECS containers.
• Involved in handling team for a softened project delivery.
• Worked on file formats such as Text,csv,parquet,JSON,XML,Avro.
• Creating Pyspark code to read the dat from the web API and HDFS to create data frames.
• Involved in working on Data Analysis,Data Quality and Data profiling for handling the business that helped the Business team.
• Loaded and transformed large sets of semi structured data likes XML,JSON,AVRO and Parquet.
• Code and peer review of assigned task.Unit testing and Bug Fixing.

Project Name: BDF (Big Data Fabric) an Anthem project:

• Worked as Module Lead to read multiple files (csv ) from Amazon s3.
• Proceed the files using Pyspark transformations to make a data frame.
• Loaded the data into RDBMS using python and handled to creation of Restful APIs using Flask.
• Performed Import and Export of data into HDFS and Hive using Swoop and managed data within the environment.
• Involved in creating Hive tables,Data Loading and writing hive queries.

Project Name: SQR and ADPR

• The responsibilities cary from gathering requirement to deployment.
• Giving support on Functional requirement for the project by coordinating with BA.
• Prepared design documents in Design phase.
• Generating reports and notifying to BA'S.
• Served as a point of contact for several projects for both off shore and onshore.