Bhavitavaya Shrivastava
Indore
Summary
Highly competent data engineer with background in designing, testing, and maintaining data management systems. Possess strong skills in database design and data mining, coupled with adeptness at using machine learning to improve business decision-making. Previous work resulted in optimizing data retrieval processes and improving system efficiency.
Overview
25
25
years of professional experience
Work History
Data Engineer / Sr Analytics Engineer
The modern Data Company
Indore
10.2021 - 07.2024
- Team lead handled group of four(4) members and implemented Fiori Algorithm in Trino SQL to generate insights for clients .
- Designed and managed scalable data pipelines for real-time data ingestion into a data lake, utilizing Apache Benthos for efficient streaming and transformation. Ensured data integrity and optimized pipeline performance for seamless integration and processing
- Developed and implemented Apache Spark jobs to perform data transformation and processing, efficiently storing the resulting datasets in a data lake for downstream analytics and business intelligence. Enhanced data accessibility and supported decision-making processes through optimized data pipelines
- Developed and deployed CI/CD pipelines for seamless data migration from on-premises systems to AWS cloud infrastructure. Leveraged tools such as GitLab to automate workflows, ensure continuous integration and delivery, and enhance migration efficiency and reliability
- Enhanced database performance by optimizing SQL queries and schema design using Trino SQL. Implemented advanced query tuning and indexing strategies to improve query execution speed and overall system efficiency, resulting in reduced latency and improved data retrieval times.
- Optimized data cubes for effective data modeling within the semantic layer to integrate and unify disparate data silos. Leveraged advanced modeling techniques to enhance data accessibility and consistency, supporting comprehensive business intelligence and analytics
Data Analyst ~ Spark Developer
2U Technologies
Bengaluru
01.2019 - 03.2020
- Leveraged SQL queries to extract, transform and load data into databases .
- Translated raw data into meaningful information using statistical techniques.
- Monitored job progress through Ambari UI or command line interface tools like yarn, spark2-submit, spark-shell .
- Maintained documentation of all the processes related to Data Analysis.
- Optimized Spark jobs for improved performance, scalability, and reliability thereby reducing processing time by 25%
Data Analyst
AUV Technology
Nagpur
11.2017 - 01.2019
- Conducted comprehensive analysis of large datasets using tools such as Python, R, or SQL to uncover trends, patterns, and correlations. Delivered actionable business insights that informed strategic decision-making and improved operational efficiency
- Developed and maintained comprehensive documentation for data analysis processes, including methodologies, workflows, and data sources. Ensured clarity and accessibility of documentation to support team collaboration, knowledge transfer, and process standardization.
SAP ABAP Consultant
Integra System
Nagpur
04.2011 - 12.2016
- Implemented Application Link Enabling (ALE) and Intermediate Documents (IDOCs) for efficient transfer of master data from legacy systems to the SAP R/3 environment. Streamlined data integration processes to ensure seamless migration, improved data accuracy, and supported system interoperability
- Customized SAP standard transactions and developed new ones to meet specific customer requirements by leveraging transaction variants, screen exits, and menu exits. Enhanced user experience and streamlined business processes by tailoring functionality and interface elements to better align with client needs.
- Designed, developed, and tested custom SAP ABAP programs to address specific client requirements. Implemented features such as data processing, report generation, and user interfaces, ensuring alignment with business needs and enhancing system functionality. Conducted thorough testing to validate performance and accuracy, resulting in improved operational efficiency and client satisfaction.
SAP ABAP Developer
Chester Informatics
Nagpur
01.2007 - 03.2011
- Performed data migration activities using BAPI, IDOCs, and LSMW.
- Created complex ALV reports with different functionalities such as sorting, subtotaling, and filtering.
Software Engineer
Edas Software Solutions
Nagpur
01.2004 - 12.2006
- Developed, tested, debugged, and documented software programs using Java, JavaScript, HTML, and CSS.
- Researched new technologies and methodologies to propose innovative software solutions.
Junior Software Developer
Jagson Inc.
Nagpur
02.2002 - 01.2005
- Resolved coding problems by working closely with senior developers.
- Tested code modules to ensure they were bug free before release.
Network Marketing Professional
Network 21
Nagpur
01.2000 - 01.2002
- Promoted products or services through public relations initiatives, promotional events, trade shows, direct mail campaigns, telemarketing, email campaigns, and other creative tactics.
Education
B.E - Computer Technology
Priyadarshini College of Engineering And Architect
06-2000
Skills
- Hadoop, HDFS, and Hive
- Apache Spark and Apache Benthos
- TrinoSQL , MySQL, and PostgreSQL
- Hive , MongoDB,
- Docker , Docker swarm, Docker-compose
- AWS (EC2,S3,EMR)
- Azure (Azure Data Factory,Azure Databricks, Delta Tables)
- GCP (Big Query , Pub-Sub,Dataproc)
- DBT , Cubedev
- Snowflake
Affiliations
- Active practitioner of Art of Living, incorporating mindfulness, stress management, and leadership principles into personal and professional life. Applied techniques from the program enhance focus, resilience, and team collaboration, contributing to improved work performance and well-being
- Passionate about cooking, with a strong interest in exploring diverse cuisines and culinary techniques.
Accomplishments
- Consistently received positive feedback from clients for my exceptional performance and dedication.
Timeline
Data Engineer / Sr Analytics Engineer
The modern Data Company
10.2021 - 07.2024
Data Analyst ~ Spark Developer
2U Technologies
01.2019 - 03.2020
Data Analyst
AUV Technology
11.2017 - 01.2019
SAP ABAP Consultant
Integra System
04.2011 - 12.2016
SAP ABAP Developer
Chester Informatics
01.2007 - 03.2011
Software Engineer
Edas Software Solutions
01.2004 - 12.2006
Junior Software Developer
Jagson Inc.
02.2002 - 01.2005
Network Marketing Professional
Network 21
01.2000 - 01.2002
B.E - Computer Technology
Priyadarshini College of Engineering And Architect
Similar Profiles
Bhavitavaya ShrivastavaBhavitavaya Shrivastava
Data Engineer / Sr Analytics Engineer at The Modern Data companyData Engineer / Sr Analytics Engineer at The Modern Data company
Deenkar MahulkarDeenkar Mahulkar
Senior Engineering Manager at The Modern Data CompanySenior Engineering Manager at The Modern Data Company
Xavier Sathya SeelanXavier Sathya Seelan
Full Stack Web Developer at Modern Infotech Data ServicesFull Stack Web Developer at Modern Infotech Data Services