Engineering leader with 13+ years of experience in building highly scalable software and data products using distributed systems and big data technologies
6+ years of managing multiple teams of managers and team leads focusing on data engineering, data science, data analytics, and machine learning
Strong technical background in data acquisition, integration, quality assurance, and data governance
Proven ability to translate business requirements into data-driven solutions using machine learning algorithms like NLP, Logistic Regression, SVM, and Neural Networks
Solid understanding of large scale distributed systems with experience in processing huge volumes of data using Kafka, Spark, and NoSQL databases on AWS and Azure
Experience in data analytics and business intelligence using Python and SQL
Strong experience in managing, hiring, and mentoring engineers and data scientists in a fast-paced environment
Overview
13
13
years of professional experience
Work History
Director of Engineering, Data
Spekit Inc
06.2022 - Current
Established the Data Engineering org at Spekit and managed 3 teams of 12 engineers, and engineering managers responsible for developing data products to enable value-driven insights
Formulated engineering processes including CI/CD, TDD framework, Data Observability, and Data Governance to achieve regulatory compliance per GDPR and CCPA
Partner and work cross-functionally with Product, Sales, Marketing, and Customer Success teams to build, enhance, and support Spekit's resilient, scalable, customer-centric data mesh platform
Implemented Data as a Product for various internal stakeholders using Databricks on AWS
Developed ETL pipelines and analytics data warehouse using dbt and customer-facing analytics platforms using Tableau and Explo
Designed and implemented company-wide real-time event tracking system using Segment to gain insights into product usage and customer behavior to drive retention and minimize churn
Built a summarizer to facilitate real-time learning using LLMs to reduce content generation time by 50%
Hired and mentored high-caliber managers and engineers with diverse technical strengths and backgrounds across geographically dispersed teams
Engineering Manager
Pattern Energy
03.2019 - 06.2022
Managed 3 teams of data engineers, data scientists, and technical leads that developed and maintained data products supporting Geotechnical, Finance, and Accounting teams
Developed real-time data processing solutions to process extensive volume data from SCADA systems in globally located wind turbines to power analytics dashboard and provide executive management with metrics like MWh production and revenue generation using Kafka, Apache Flink, and Cassandra
Built prediction models in Python using Logistic Regression, Random Forest, and Neural Networks to predict probability of wind generation for specific regions with varying wind conditions
Improved forecasting methods to predict net megawatts generated across all wind farms by 10% using SVM best tuning and Quantile Regression Forest
Implemented data infrastructure required to manage components in AWS using services like Terraform, EC2, EMR, ECS, and S3
Supported Accounting and FP&A teams with financial data for their monthly and quarterly planning, close process, variance analysis, and reporting in Tableau and Power BI
Lead Software Engineer
Pattern Energy
03.2017 - 03.2019
Designed and implemented a batch data pipeline to process IoT data from SCADA systems using Azure Data Factory, resulting in a 50% reduction in processing time
Built multiple ETL jobs from ERP and CRM systems to power data warehouse in Snowflake using Airflow
Developed a self-service dashboard in Power BI for the Geotechnical teams resulting in a 25% increase in data-driven decision making
Built text mining frameworks using NLP from incident logs to analyze failure conditions for wind turbines
Actively mentored junior engineers on the team and built a strong engineering culture focusing on agile methodologies and engineering best practices
Senior Software Engineer
Pattern Energy
07.2014 - 03.2017
Designed and developed an analytics engine to process financial events using Java, Hadoop, and MapReduce
Implemented automation for financial reporting using Power Automate and Power BI that saved around 5,000hours annually for end users
Completed SOX process documentation to comply with internal and external data governance guidelines
Software Engineer
Cisco Systems
02.2012 - 07.2014
Automated ETL processes, making it easier to wrangle data and reducing latency between systems
Formulated approaches for automation and optimization of data reporting workflows, resulting in 80% reduction in manual data input
Created SQL scripts to extract and reshape data in alignment with business needs, leading to a remarkable 95% enhancement in accuracy
Developed dashboards to provide crucial performance trends and insights using Tableau
Software Engineer
Sempra Energy
09.2011 - 12.2011
Created analytics dashboards in OBIEE by translating business requirements into technical solutions
Education
Master of Science - Computer Science
Southern Polytechnic State University
Atlanta, GA
07.2011
Bachelor of Engineering - Electrical & Electronics Engineering
CMR Institute of Technology (VTU)
Bangalore, India
05.2009
Skills
Languages: Python, Java
Data Frameworks: Spark, Kafka, Flink, Hadoop, Hive
Data Warehouse: Databricks, Snowflake
Databases: Cassandra, HBase, Postgres, MySQL
Cloud Technologies: AWS, Azure
Tools: Terraform, CloudFormation, Ansible
Platforms: Kubernetes, Docker
ML Framework: Keras, PyTorch, TensorFlow, AutoViML
Timeline
Director of Engineering, Data
Spekit Inc
06.2022 - Current
Engineering Manager
Pattern Energy
03.2019 - 06.2022
Lead Software Engineer
Pattern Energy
03.2017 - 03.2019
Senior Software Engineer
Pattern Energy
07.2014 - 03.2017
Software Engineer
Cisco Systems
02.2012 - 07.2014
Software Engineer
Sempra Energy
09.2011 - 12.2011
Master of Science - Computer Science
Southern Polytechnic State University
Bachelor of Engineering - Electrical & Electronics Engineering