Prakash Mani
Data Engineer
Namakkal
Summary
Experienced and an innovative Data Engineer with a demonstrated history of working in the information technology and services industry. Strong technology professional skilled in Big Data Analytics, Hadoop, Hive, Spark, Apache Airflow, Apache NiFi, DataBricks, FastAPI, Apache Superset, Tableau, Microsoft SQL Server, PostgreSQL, MySQL, Presto SQL, MongoDB, SSIS, SSRS and business requirements analysis.
Overview
4
4
years of professional experience
4
4
years of post-secondary education
Work History
Data Engineer
Ansio Solution Pvt Ltd
Chennai
11.2021 - Current
- Analyzed complex data and identified anomalies, trends and risks to provide useful insights to improve internal controls.
- Developed, implemented and maintained big data analytics protocols, standards and documentation.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Developed database architectural strategies at modeling, design and implementation stages to address business or industry requirements.
- Designed compliance frameworks for multi-site data warehousing efforts to verify conformity with state and federal data security guidelines.
- Build a Data Lake using DataBricks in AWS ecosystem and maintain the data versioning pipeline with delta tables.
- Designed and implemented the data lake for farmer application to feed satellite data from Google Earth Engine.
SYSTEM ENGINEER
TATA Consultancy Services
Chennai
07.2018 - 10.2021
- Build a web application using Django framework to query the ITSM data/status using vendor API, which helps unlicensed users to query data on demand and that brings Client to save $850 per user per year for about ~100 users
- Received STAR OF THE MONTH Award from TATA Consultancy Services for Process Automation
- Optimized SQL procedures to improve performance which is part of batch job in the application and that results in time consumption reduced from 298 Minutes to less than 60 Minutes which is about 80% of time consumption is drastically reduced to complete the entire batch job and also ~90 hours per month SQL Server usage is reduced
- Configured Power BI Report Services to view the reports in Web iframes with customized domain and URL’s instead of migrating to Power BI Report Server to do these customizations which is costlier in-terms of licensing
- This approach helped Client to save $15,000 per year additional licensing fee., Responsible of developing and maintaining the SSIS packages to retrieving the data from various source systems into the Data Warehouse via batch jobs
- Developed a web application using Python - Django to pull the ITSM data from vendor ecosystem
- Analyzing various data models by extracting the data from SQL Server using advanced SQL query techniques
- Involve in production deployment schedules and handling production issues by reverse engineering.
Education
BACHELOR OF ENGINEERING - Automobile Engineering
SRM Easwari Engineering College
08.2014 - 04.2018
Skills
DataBricks - PySpark, Hive, Delta Tables
DBMS: SQL Server, MySQL, PostgreSQL, PrestoSQL
CLOUD: AWS - S3, Glue, EMR, QuickSight, EC2, ECS, Lamda, RDS
OS: Windows, Linux (Ubuntu)ETL: MSBI-SSIS, Apache Airflow, Apache Nifi
Analytics: Tableau, Apache Superset, AWS QuickSight
Python, FastAPI, Django
Accomplishments
- Achieved Coder award by completing satellite integration to web application with accuracy and efficiency.
- Supervised a team of 6 members.
- Achieved Innovator by introducing Apache Airflow for complex ETL tasks.
Timeline
Data Engineer
Ansio Solution Pvt Ltd
11.2021 - Current
SYSTEM ENGINEER
TATA Consultancy Services
07.2018 - 10.2021
BACHELOR OF ENGINEERING - Automobile Engineering
SRM Easwari Engineering College
08.2014 - 04.2018