Prakash Mani
Data Engineer
Namakkal
Summary
Experienced and an innovative Data Engineer with a demonstrated history of working in the information technology and services industry. Strong technology professional skilled in Big Data Analytics, Hadoop, Hive, Spark, Apache Airflow, Apache NiFi, DataBricks, FastAPI, Apache Superset, Tableau, Microsoft SQL Server, PostgreSQL, MySQL, Presto SQL, MongoDB, SSIS, SSRS and business requirements analysis.
Overview
4
4
years of professional experience
4
4
years of post-secondary education
Work History
Data Engineer
Ansio Solution Pvt Ltd
Chennai
11.2021 - Current
- Analyzed complex data and identified anomalies, trends and risks to provide useful insights to improve internal controls.
- Developed, implemented and maintained big data analytics protocols, standards and documentation.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Developed database architectural strategies at modeling, design and implementation stages to address business or industry requirements.
- Designed compliance frameworks for multi-site data warehousing efforts to verify conformity with state and federal data security guidelines.
- Build a Data Lake using DataBricks in AWS ecosystem and maintain the data versioning pipeline with delta tables.
- Designed and implemented the data lake for farmer application to feed satellite data from Google Earth Engine.
SYSTEM ENGINEER
TATA Consultancy Services
Chennai
07.2018 - 10.2021
- Build a web application using Django framework to query the ITSM data/status using vendor API, which helps unlicensed users to query data on demand and that brings Client to save $850 per user per year for about ~100 users
- Received STAR OF THE MONTH Award from TATA Consultancy Services for Process Automation
- Optimized SQL procedures to improve performance which is part of batch job in the application and that results in time consumption reduced from 298 Minutes to less than 60 Minutes which is about 80% of time consumption is drastically reduced to complete the entire batch job and also ~90 hours per month SQL Server usage is reduced
- Configured Power BI Report Services to view the reports in Web iframes with customized domain and URL’s instead of migrating to Power BI Report Server to do these customizations which is costlier in-terms of licensing
- This approach helped Client to save $15,000 per year additional licensing fee., Responsible of developing and maintaining the SSIS packages to retrieving the data from various source systems into the Data Warehouse via batch jobs
- Developed a web application using Python - Django to pull the ITSM data from vendor ecosystem
- Analyzing various data models by extracting the data from SQL Server using advanced SQL query techniques
- Involve in production deployment schedules and handling production issues by reverse engineering.
Education
BACHELOR OF ENGINEERING - Automobile Engineering
SRM Easwari Engineering College
08.2014 - 04.2018
Skills
DataBricks - PySpark, Hive, Delta Tables
undefinedAccomplishments
- Achieved Coder award by completing satellite integration to web application with accuracy and efficiency.
- Supervised a team of 6 members.
- Achieved Innovator by introducing Apache Airflow for complex ETL tasks.
Timeline
Data Engineer
Ansio Solution Pvt Ltd
11.2021 - Current
SYSTEM ENGINEER
TATA Consultancy Services
07.2018 - 10.2021
BACHELOR OF ENGINEERING - Automobile Engineering
SRM Easwari Engineering College
08.2014 - 04.2018
Similar Profiles
Swapna ASwapna A
E-commerce Sales Executive at Ansio Solutions Pvt LtdE-commerce Sales Executive at Ansio Solutions Pvt Ltd
Harshavardhan N PadakiHarshavardhan N Padaki
Manager MSSQL Database Administrator at IBM India Pvt Ltd\Kyndryl Solution Pvt LtdManager MSSQL Database Administrator at IBM India Pvt Ltd\Kyndryl Solution Pvt Ltd
AMRITESH KUMARAMRITESH KUMAR
Team Leader - Project Management at Huawei Technologies Ind Pvt Ltd, Manpower :Avacend Solution Pvt Ltd.Team Leader - Project Management at Huawei Technologies Ind Pvt Ltd, Manpower :Avacend Solution Pvt Ltd.
Jacindha RagunathanJacindha Ragunathan
Web Development, Implant Trainee at IDM Tech ParkWeb Development, Implant Trainee at IDM Tech Park
Brindha CBrindha C
Senior Test Engineer at Teamware SolutionsSenior Test Engineer at Teamware Solutions