Mohana Krishnan. V
Data Engineer
Bengaluru,India
Summary
An astute Data Engineer working with vast data sets to break down information, gather relevant points and solve advanced business problems. Detail-oriented, methodical and enterprising with a strong focus on devising and running effective processes. Skilled in data analysis, data warehousing and data transformation using streaming and batch processing
Overview
8
8
years of professional experience
4
4
years of post-secondary education
2
2
Languages
Work History
Data Engineer
Adobe
Bengaluru, Karnataka
06.2019 - Current
- Envisioned, architected and implemented a generic data pipeline and Spark based model for batch processing of enterprise level complex data, resulting in saving $5000 per month. This pipeline reduced the effort by 70% of previous architecture for all loads.
- Sourced, analyzed, processed, validated, transformed, aggregated and distributed data from more than 9+ sources, using generic data pipeline which reduced 60% analyst effort to generate report on orders placed in Adobe.
- Performed large-scale data conversions, transferring data into standardized formats for integration into Adobe Analytics.
- Analyzed complex data and identified anomalies, trends and risks to provide useful insights to improve internal controls.
- Developed, implemented, supported and maintained data analytics protocols, standards and documentation.
- Mentored, documented and maintained best practices of Git usage in data engineering project.
Senior Software Engineer in Big Data
Reni Analytics
Bengaluru, Karnataka
06.2018 - 06.2019
- Involved in design, implemented shipment tracking and alerting product called ‘Dice-Platform' using Scala Spark, Hadoop and Kafka, improving operating efficiency by 80%.
- Built an algorithm to match vendor delivery quotation and shipment tracking and alert deviation with 100% accurate results.
- Engaged with business representatives, business analysts and developers and delivered comprehensive business-facing analytics solutions.
- Designed and built an end-to-end user configurable CICD pipeline that was adopted by more than 5+ projects in the company.
- Implemented a ‘Log Analyzer' using Spark framework, Elasticsearch and Kibana.
Big Data Developer
Aline consulting
Chennai, Tamil Nadu
11.2017 - 05.2018
- Tested and validated models for accuracy of predictions in outcomes of interest.
- Compiled, cleaned and manipulated data for proper handling.
- Conducted research, gathered information from multiple sources and presented results.
- Proved successful working within tight deadlines and fast-paced atmosphere.
Software Test Engineer in Big Data
Yume India Pvt Ltd
Chennai, Tamil Nadu
12.2015 - 11.2017
- Worked closely with other business analysts, development teams and infrastructure specialists to deliver high availability solutions for mission-critical applications.
- Performed system analysis, documentation, testing, implementation and support for data pipelines.
- Wrote and optimized test cases to maximize success of manual software testing with consistent, thorough approaches.
- Gathered requirements and performed gap analysis with business analyst and stakeholders.
- Identified and resolved problems through root cause analysis and research.
Associate Software Engineer
Accenture Service Pvt Ltd
Chennai, Tamil Nadu
09.2013 - 11.2015
- Debugged code and located root causes of problems by reviewing configuration files and logs.
- Led software development initiative as subject matter expert and primary point-of-contact for project management staff.
- Identified, tracked defects and supported developers in resolving problems by completing additional tests.
- Gathered requirements and performed gap analysis with business analyst and stakeholders.
- Identified and resolved problems through root cause analysis and research.
- Developed flowcharts and diagrams to describe and lay out logical operational steps.
Education
Post Graduate Diploma - Data Mining
Annamalai University
06.2018 - 05.2019
Bachelor of Engineering - Electronics And Communication Engineering
Anna University
09.2009 - 04.2013
Skills
Programming Skills - Python, Scala, SQL, UNIX
Big Data Framework - Spark, DataBricks, Hadoop, SnowFlake, Kafka
DataWarehouse - Hive, SnowFlake
Big Data Filesystems - HDFS, S3, Azure Blob3
RDBMS - MySQL, Postgress
NoSQL - Redis, MongoDB, Cosmos DB, Cassandra
CICD Tools - Docker, Git, Jenkins
Scheduler - Oozie, Airflow, Databricks job scheduler
Timeline
Data Engineer
Adobe
06.2019 - Current
Senior Software Engineer in Big Data
Reni Analytics
06.2018 - 06.2019
Post Graduate Diploma - Data Mining
Annamalai University
06.2018 - 05.2019
Big Data Developer
Aline consulting
11.2017 - 05.2018
Software Test Engineer in Big Data
Yume India Pvt Ltd
12.2015 - 11.2017
Associate Software Engineer
Accenture Service Pvt Ltd
09.2013 - 11.2015
Bachelor of Engineering - Electronics And Communication Engineering
Anna University
09.2009 - 04.2013