Amiable Data Engineering Manager with 16 years leading creation of exemplary products by fostering enthusiastic and cohesive teams. Maintains strict adherence to prescribed development milestones and quality assurance levels. Expert at leveraging diverse teams to produce revolutionary and successful products.
Overview
16
16
years of professional experience
Work History
Data Engineering Manager/Staff Data Engineer
Walmart India Pvt Ltd India
Jul.2020 - Current
Currently leading multiple technical teams, with a total strength of 10 building a data platform and data governance suite.
Drove high-level strategic planning of development efforts across multiple projects to optimize resource utilization and shorten development times.
Interviewed, hired and trained staff, leading performance reviews and offering constructive feedback.
Contributed to internal activities for overall process improvements, efficiencies and innovation.
Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
Built Data Quality tool, this has saved 40% to 60% man hours for the Teradata to BigQuery migration initiative of the Sams club. This tool reduced the migration time from 1 months to 1 week
Innovated the Hashing algorithm to compare the datasets and filled for the patent through Walmart.
Designed the data pipelines for the Sam’s Membership Data end to end, and enabled the Sam’s Data availability for the business, data scientists, 3rd party vendors
Initiated and implemented organization wide CI/CD pipelines with unit testing on the data pipelines, resulted in better satisfaction of the customers of the data.
Principal Software Engineer
Oracle India Private Limited
Oct.2016 - Feb.2020
Built outstanding and dynamic team of software engineers and developers which significantly boosted overall success of organization.
Teamed with business analysts to deliver high-availability solutions for mission-critical applications.
Used critical thinking to break down problems, evaluate solutions and make decisions.
Employed Data-as-a-Service (DaaS) products to enable faster availability of data with in the orgnization and with partners
Collaborated with Product, Business, Program Manager and others to understand business requirements.
Designed the scalable systems for data processing in the complex ETL pipeline.
Proactively look for opportunities to align technology as an enabler for business needs and capabilities (e.g., identify need for enterprise data warehouse, advanced analytics, etc)
Developed and implemented performance improvement strategies and plans to promote continuous improvement.
Collaborated on hiring, retention and promotion of junior engineers.
Associate Architect
Insideview India Private Limited
07.2015 - 10.2016
Played a major role in reducing the expenditure and meeting the budget criteria defined company management.
Designed the Data platform based on Big data tools
Helped the analytics to team to implement the best practices like compression, partition tables in Hive.
Migrated numerous legacy systems to newer technologies, reducing costs and enhancing efficiency of computing tasks.
Suggested the optimal cluster size for the Kafka, Hadoop Clusters.
Resolved the scalability issues for the Data engineering, Data science, Buisness analytics team by moving the Hadoop cluster to Quoble services, and resulted in 40% cost reduction.
Senior Lead Engineer
Qualcomm India Private Limited
01.2008 - 06.2015
Designed & developed the REST API with HBase as database.
Designed & developed a caching mechanism with Memcached for High Availability in mission critical call flows.
Performance benchmarking using Spark SQL. Evaluate Spark for replacing MapReduce for performance bottleneck. Explore and POCs with Spark
Responsible for providing architectural directions and design recommendations.
Helped the test, development team in maintaining the HBase database for Test, Dev, Staging environment.
Developed multiple MapReduce jobs in java for data cleaning and preprocessing
Redesigned OMCQC component by replacing the RDBMS with HBase for scalability.
Continuous monitoring and managing the Hadoop cluster through Cloudera Manager.
Attend daily Agile Scrum meeting, Sprint planning, Sprint Retrospective; Use JIRA and Version One for creating, updating stories and reviews.
Software Engineer
Motorola India Private Limited
01.2006 - 12.2007
Development of test plans, scenarios, and cases and executed the test plans per iteration.
Involved in design and development of Site Admin Module
Used XML’s for the backup data and restore.
Involved in development of JUnit test cases.
Understanding of the EMS, NMS completely
Software Developer Intern
Motorola India Private Limited
07.2005 - 12.2005
Developed User Interface using Swing.
Designed the data model
Involved in development of the application.
Development of Test plans, cases and scenarios and executed the test plans.
Education
Advanced Certification in AI And ML - Computer And Information Sciences
IIIT
HYDERBAD
09.2018
B.Tech - undefined
S.E
2005
Skills
Team work and Collaboration
Product Development
Technical Design Review
Planning and Coordination
Team Building
Cloud (AWS, GCP, Azure)
Spark, Flink, Kafka, Elastic Search
Spring Boot, Microservices
Oracle, MySQL, Postgres
HBase, Cassandra, MongoDB
Java, Python, Scala
SAFe, Agile Methodlogies
JIRA
Timeline
Data Engineering Manager/Staff Data Engineer
Walmart India Pvt Ltd India
Jul.2020 - Current
Principal Software Engineer
Oracle India Private Limited
Oct.2016 - Feb.2020
Associate Architect
Insideview India Private Limited
07.2015 - 10.2016
Senior Lead Engineer
Qualcomm India Private Limited
01.2008 - 06.2015
Software Engineer
Motorola India Private Limited
01.2006 - 12.2007
Software Developer Intern
Motorola India Private Limited
07.2005 - 12.2005
Advanced Certification in AI And ML - Computer And Information Sciences
IIIT
B.Tech - undefined
S.E
Similar Profiles
Kanduri YedukondaluKanduri Yedukondalu
Assistant Manager at Walmart India Pvt LtdAssistant Manager at Walmart India Pvt Ltd
Asst. Manager Facilities at Flipkart Wholesale Formally Name Walmart India Pvt Ltd)Asst. Manager Facilities at Flipkart Wholesale Formally Name Walmart India Pvt Ltd)