With over 10 years of extensive experience in data-tech spectrum including data analytics and data engineering, data warehousing, process validation using ETL and CloudTechnologies.
Proven leadership abilities with a successful track record of leading multiple teams in both India and the USA.
Recognized as a hands-on and proactive trouble-shooter with proven leadership skills, robust problem solving and analytical skills and who is totally committed to the organization's goals.
Overview
17
17
years of professional experience
1
1
Certification
Work History
Data Engineer
Sevael Technologies
09.2021 - Current
Revolutionized the availability of D-Mart Marketing data for seamless business user consumption, enabling advanced analytics and reporting capabilities
Successfully migrated over 50+ core certified marketing datasets from on-perm to Databricks Lakehouse on Azure.
Engage with business users to gather requirements, design visualizations and resolved issues regarding integrity of data flow into databases.
Architect implement medium-scale BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory,HDInsight/Databricks etc)
Extract -Transform-Load data from Sources Systems to Azure Data Storage services using a combination of Azure Data Factory, Spark SQL and Azure Data Lake Analytics.
Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage) and processing the data in In Azure Databricks.
Unified CI/CD Framework Architect - Designed, developed, and implemented a robust CI/CD framework using Vela for implementing both infrastructure and pipeline changes
Propose architectures considering cost/spend in Azure and develop recommendations to right-size data infrastructure.
Developed the conceptual solutions, created the proof-of-concepts(PoC) to demonstrate viability of solutions.
Technically guided the projects through to completion within target timeframes.
Created dashboards with client data related to regional preferences of customers via PowerBI for visualization, identified business rules, documented methods for data extraction, manipulated data with Python libraries, and performed complex SQL queries.
Presented actionable insights to executive leadership, driving informed decision-making on critical business issues.
ETL Informatica Developer
Sevael Technologies
02.2016 - 04.2020
Design, implement, and continuously enhance data pipelines through extraction, transformation, and loading processes.
Reduced processing time for ETL tasks through the implementation of parallel execution strategies.
Examined source data to pinpoint quality issues and created strategies to resolve them, leading to a 30% decrease in data errors and inconsistencies.
Enhanced ETL processes by optimizing complex SQL queries and streamlining data extraction procedures.
Designed integration tools to combine data from multiple, varied data sources such as RDBMS, SQL and big data installations.
Migrated data flows for 2K client accounts from an outdated system, reducing end-user wait times by over 60%.
IT Analyst
Target Corporation
05.2009 - 09.2014
Interaction with Business analysts and managers regularly and collecting insights on business requirements.
Sharing proposal on technical solutions, data visualization and fine-tuning the schema with all stakeholders.
Responsible for end-to-end software development including analysis, design, implementation, release migration, and support.
Preparing high-level requirement document and finding suitable technologies to implement the business requirements.
Developed suitable Data extraction queries using SQL
Responsible for fixing minor bugs, performance enhancement to the core data engine tool Axsys Created unique shell scripts which interact with Tandem Database
Responsible for performance tuning and optimization
Code review and configuration build management for the application
Co-ordination with Offshore team, Coding, review, monitoring the team progress Implementation and post-implementation support
Collaboration with support team Perform estimation, task allocation, code review, and PMR activities
Assistant System Engineer
Tata Consultancy Services (TCS)
06.2007 - 04.2009
Proper app maintenance and deployment
Created automation routines via BASH scripting which improves prompt response thus greater customer satisfaction
Interaction with development and business teams to predicted emerging customer needs and developed innovative solutions to meet them
Involved in writing complex multi-table joins and conditional queries in Database.
Analyzed security logs to determine and alleviate network threats.
Responsible for application support on 24/5 basis and monitoring application efficiency includes Change management, Project management, Weekly reports, Cluster management.
Creating appropriate reports for business needs.
Regular customer interaction, co-ordination with other support and development teams Perform estimation, task allocation, code review, and PMR activities
Maintained regular communications with external stakeholders, improving overall uptime.
Education
Bachelor of Engineering -
Anna University
Chennai, India
05.2006
Skills
Languages: Python,R, Hive Query Language (HQL),SQL,Unix Shell Script
Client Partnership Manager at Tyroo Technologies Ltd (Divison of Smile Internet Technologies Ltd)Client Partnership Manager at Tyroo Technologies Ltd (Divison of Smile Internet Technologies Ltd)