Aki Manohar Viswanath
Hyderabad
Summary
Dynamic Module Lead Software Engineer at Impetus Technologies with a proven track record in developing robust data pipelines and enhancing data quality. Skilled in PySpark and AWS, I excel in mentoring teams and driving innovative solutions that optimize performance and ensure data integrity. Passionate about leveraging technology to deliver impactful results.
Overview
8
8
years of professional experience
1
1
Certification
Work History
Module Lead Software Engineer
Impetus Technologies Pvt Ltd
04.2024 - Current
- Developed and implemented a comprehensive unit testing framework using Robot Framework, enhancing testing efficiency and ensuring code quality across the project team
- Designed and deployed a recommendation API within the Titan AI application using Flask and Docker, with continuous enhancement efforts to optimize functionality and performance
- Currently leading the development of IPDR and CDR data pipelines utilizing PySpark SQL on the Gathr platform, focusing on anomaly detection and data integrity
- Client: Clear Trail
- Platform & Skills: PySpark, Spark SQL, Python, Gathr, AWS, Solr, Kafka, Yuga Byte
- Brief: We developed an end to end data pipeline which consumes the raw data of Titan AI Application and these pipeline transforms the data by extracting the important features and converting the data into a consumable format that is used by analysts to provide monthly reports and which enhance by the UI and backend teams to place on the UI
Senior Software Engineer
Impetus Technologies Pvt Ltd
04.2022 - 03.2024
- Developed datasets metadata store and updated to UI with ref Open Source Datahub
- Created End to End Data Quality Pipeline
- Unit testing and Optimizing the spark jobs
- Created Unzip Processor & UCID for the files for the Pipeline
- Completely involved in the requirement analysis phase
- Monitoring the new team members to explain the relevant technologies
- Client: Optum
- Platform & Skills: PySpark, Spark SQL, Python, PyCharm, AWS
- Brief: We have worked for metadata store of CHC on the reference of Open Source Datahub and worked for adding the datasets into the metadata store CHC App
- We developed an end to end data pipeline which consumes the raw data of different Tenants which do data quality checks using an open source Great Expectations and using the cloud services and generates a report on top of data
Senior Engineer
L&T Construction Limited
10.2017 - 02.2022
- Developed Spark SQL ETL jobs as per the given requirement
- Created project specific directories into HDFS location as part of placing the extracts generated in our boundary directories
- Unit testing and Optimizing the spark jobs
- Migrating Spark1.6 to Spark2.4
- Created views on top of Hive tables to provide ad-hoc reports to business team
- Completely involved in the requirement analysis phase
- Mentoring the new team members to explain the relevant technologies
- Platform & Skills: Apache Spark Core, Spark SQL, Apache Hive, IntelliJ IDE, Shell Scripting
- Brief: We developed an end to end data pipeline which consumes the raw data of construction engineers daily progress
- The pipeline transforms the data by extracting the important features and converting the data into a consumable format that is used by analysts to provide monthly reports, employee performance and resource management to the business executives
Education
Bachelor of Technology -
Sardar Vallabhbhai National Institute of Technology
Surat05-2017
Skills
- HDFS
- Hive
- Python programming
- Spark
- Spark SQL
- Data pipeline development
- Data quality assurance
- AWS services
- Airflow
- Databricks
- RDBMS
- MySQL
- PyCharm
- VS Code
- GIT
Certification
- Databricks Certified Data Engineer Professional
Languages
Telugu
First Language
English
Advanced (C1)
C1
Tamil
Intermediate (B1)
B1
Kannada
Elementary (A2)
A2
Timeline
Module Lead Software Engineer
Impetus Technologies Pvt Ltd
04.2024 - Current
Senior Software Engineer
Impetus Technologies Pvt Ltd
04.2022 - 03.2024
Senior Engineer
L&T Construction Limited
10.2017 - 02.2022
Bachelor of Technology -
Sardar Vallabhbhai National Institute of Technology
Similar Profiles
Ashish JoshiAshish Joshi
Engineering Manager at Impetus technologies Pvt LtdEngineering Manager at Impetus technologies Pvt Ltd
Samyak JainSamyak Jain
Module Lead at Impetus Technologies Pvt. Ltd.Module Lead at Impetus Technologies Pvt. Ltd.
B. Durga Prasad YadavB. Durga Prasad Yadav
Software Engineer at Impetus Technologies (India) Pvt. Ltd.Software Engineer at Impetus Technologies (India) Pvt. Ltd.