Swetank Anand

Project Details: WARP (Worldwide Analytics and Reporting Platform) Platform is used to analyze the data of endurance testing. Endurance testing is a pre-production testing phase through which all cars, ECUs (electronic control units), motors, gears and other features must go through. In worldwide 26 sites, cars instrumented with logger devices of the company CAETEC are driven by professional drives in several shifts around the clock.

AQUA (Advance Quality Analysis) it is an analytical System that enables Mercedes Benz employees to analyze After Sales Quality Data (Process and events after Our Product is sold to customer). It consists of Product Quality data, warranty data, test data etc

• Currently I am working as Module Core Developer which was responsible for building and technically helping colleague to build scalable distributed data solutions on Azure
• Developed and optimized the Spark job
• I have done scripting in Python for ad hoc task and worked on the existing python notebook also
• Well-versed in writing the user story, design the solution and help in implementation on azure
• Redesign the existing data pipeline to reduce the operating cost of the platform which is running on azure
• Developed the pipeline with the help of azure data factory that helping us to move data more consistent, reliable, and reduced the infra cost
• Developed data bricks notebook for the ATFX file extraction and use as an integration to trigger converter to convert the data which can be analyzed further
• Worked on extensively on project bug fixes and enhancement in most of the area of project
• Developed Azure Function to read data from the queue, transform it and write the data to another queue for further processing
• Well-versed in working with agile methodology
• Develop the glue job for different data product for Aqua project and after the data transformation in Pyspark stored the details in Athena

Product Name: mPACT2WO (https://mpact2wo.com)

It accelerate the digital industrial transformation with IIOT (Industrial Internet of Things) 2.0 solution based on real time data (Generated from sensors) industry can take the decision anytime, anywhere. With our product (Sensor, Software, Data and Analytics) enable 24x7 monitoring and alert. Alert is triggered with email/text with full situational info like leak level, location.

• I have joined the company as Data Engineer which was responsible for building scalable distributed data solutions using spark
• Worked on loading and transforming of large sets of structured and semi structured data
• Refactored and optimized the existing spark job to accommodate the forecasted load on spark job
• It helped to expand the business with lower operational cost
• Rewrite the spark read and write operation to accommodate the schema changes
• It helped in terms of reducing the storage cost and job performance is also improved
• Developed the spark job (More than 10) to migrate the historical data (Several TB) to accommodate the new schema changes
• It helped to use historical data for all the customers without using any specific data migration tool/framework and training or resources (Helped in saving cost to company)
• Developed the spark job based on business requirement (For the fence line monitoring and backfilling the missing data)
• Written the spark job to produce the huge data used to do load testing of the existing spark job
• Implemented the logger for the spark job so that easy debugging is possible and integrated with AWS cloud watch
• Mentored colleagues and new joiners on business and technical functionalities
• Developed a unit test case framework and write the unit test case for the spark job with the help of team

Product Name: ACSC (Advance Casino System Corporation) Our product provides big data solution to casino and it will increase the bottom-line by deriving pertinent intelligence on the casino players by leveraging predictive analytics, machine-learning and external data sources

• Responsible for building scalable distributed data solutions using spark
• Experienced on loading and transforming of large sets of structured, semi structured and unstructured data
• I was a part of development team who has developed spark job to calculate the wallet score of casino players and then giving offers and promotions to targeted players
• Created HBase table (Managed by Hive) to store the data of spark job, so that other application can consume
• I was a part of team who has setup the Hadoop cluster on Amazon EC2 for POC
• We have also developed automatic data flows for accumulating historic data/incremental data on daily basis using Apache Airflow
• Exported the analyzed data to the relational databases using Sqoop for visualization and to generate report
• Created Hive table and done the analysis of casino and slot accounting report
• During onsite travel, my role and responsibility include giving training to casino system user, understanding their need and provide the solution to make their operation easy and smooth
• It also includes understanding of requirement/business problem, creating test cases/ writing automation scripts accordingly and end to end testing of work flow
• The zest of learning new technology and functionality has helped me to get good opportunity and recognition in the team and the passion and attitude towards work are helping me to achieve good quality deliverables in time

The project aims at enhancing the existing incentives program with the major to a revamped Incentive. System capable of providing precise information to dealers and customers on the incentive applied when a vehicle is bought and its status in addition to other enhancements

• It includes understanding of functional and non-functional requirement
• Have logical understanding of MapReduce job which help in Sqoop and hive
• Imported data using Sqoop to load data from MySQL to HDFS on regular basis
• Create Hive tables and working on them using HQL
• Written Hive queries for data analysis to meet the business requirements
• Got good experience with NOSQL databases like HBase
• Coordinating with onshore counterparts to keep the deliveries on time
• Being the key resource of my team, I have to take care of all the team level deliverables and goals which includes enabling new joiners and grooming peers
• This helped me to fetch client best employee award (Diamond in the rough)