Vikas Goyal
Bangalore
Summary
I am a highly skilled and experienced engineer with a total of8+ years of experience with a strong background in data engineering for4+ and4+ years in Backend Technologies and a proven track record of scaling systems and increasing efficiency. I have demonstrated the ability to lead and manage multi-disciplinary teams across various technologies and have expertise in building and maintaining infrastructure using tools such as Elasticsearch, Prometheus, and Kubernetes. My experience in implementing microservices architecture and leveraging technologies such as GraphQL and Kafka has greatly enhanced the speed and flexibility of development. I have strong communication skills and the ability to work with multiple stakeholders, and am passionate about mentoring and coaching.
Overview
1820
1820
years of professional experience
1
1
Certification
Work History
Lead Data Engineer
Dealshare
05.2021 - Current
- Led the establishment of the Data Engineering vertical from the ground up, growing the team to4-6 skilled professionals
- Successfully delivered a range of projects across AI, Data Engineering, and DBA domains, enhancing technical capabilities while significantly reducing costs throughout project lifecycles
- Key Contributions:
- ETL Pipeline Development: Designed and implemented end-to-end ETL pipelines, integrating data from various sources into Redshift
- Data Warehouse Migration: Managed the migration of the data warehouse from Redshift to BigQuery (BQ), optimizing performance and scalability
- Cross-functional Collaboration: Partnered with Product and Data Analyst teams to drive dashboard creation, on-chain analytics, and company-wide metrics, ensuring data-driven decision-making across the organization
Engineering - Lead
Dealshare
10.209 - Current
- Managed multiple teams across engineering to scale operations and improve performance
- Leadership: Managed 15-20 team members across multiple teams in engineering, ensuring seamless coordination and effective project delivery
- Scalability: Led efforts to scale both the technology stack and team capacity, resulting in a10x increase in DAU
- Key Roles & Responsibilities:
- Backend Development: Worked with Java Spring Boot, Python, and PHP to build robust backend systems
- Cross-functional Leadership: Collaborated closely with Mobile Leads (Android & iOS), Frontend Lead, and QA Lead to ensure cohesive and timely project execution
- Architecture & Design: Oversaw the architecture and management of key services, including Pricing Service and User Service, ensuring scalability and optimal performance
SDE2
Simply Social Pvt Ltd
11.2017 - 08.2019
- Worked with various clients, including Shopulix, Cars24, handling projects from inception to successful delivery
- Primarily worked with Spring Boot, PHP, and provided end-to-end project management
- Shopulix: Developed a platform that aggregates product data from Flipkart, Amazon, Snapdeal, and other e-commerce sites, presenting the best deals to customers
- Moodle: Contributed to the development of an internal tool for promoting employees through internal testing and evaluations
- HR Management Tool: Developed a comprehensive HR management system that handled payroll, attendance, and other employee-related functions
SDE2
Appshoppy
06.206 - 06.2017
- Core Infrastructure
- Centralized logging infrastructure using Elasticsearch, Kibana
- Centralized metrics monitoring infrastructure using Prometheus, Influx, Grafana, Telegraf
- Added Kong API Gateway for ingress traffic resulting in only single use of static IP for all public access
- Self-motivated, with a strong sense of personal responsibility.
- Worked effectively in fast-paced environments.
SDE1
Cardekho
07.2015 - 07.2016
- Worked on developing and optimizing internal panels to improve usability and efficiency across various teams
- Tech Stack: MySQL, Redis, PHP, REST APIs
- Self-motivated, with a strong sense of personal responsibility.
Education
B.Tech. - CSE
RTU
BIKANER01.2013
HSC -
SSE Rajasthan
Alwar01.2009
SSC -
SE Rajasthan
01.2007
Skills
- Languages - Python, Go, C, Java, JavaScript, PHP, Regular Expressions, SQL
- Markup languages - HTML, CSS, JSON, YAML, GraphQL, Protobuf
- Frameworks -, Spring, Angular, React, CodeIgniter, Spring,Jupyter, Cakephp,Yii
- Tools - Kubernetes, Docker, Git, Jenkins, Terraform, Kubernetes Operator, ChatGPT
- Technologies - Kafka, Elasticsearch, Prometheus, Airflow, Mage AI
- Databases - MySQL, Postgres, Redis, InfluxDB, MongoDB
- Data Warehouses - BigQuery, Databricks, Redshift, Clickhouse
- Data Science - Tensorflow, Keras, scikit-learn, OpenCV, NLTK, Pandas, Numpy, Scipy, Spark
- Analytics - Tableau, Powerbi, QuickSight, MS Excel, Metabase, Redash, Matplotlib
- AI - LLM, RAG, Prompt Engineering, LangChain, LlamaIndex, LLM Agents, HuggingFace, Bedrock, VertexAI
- Others - Distributed Systems, Data Structures, Algorithms, Networking, AWS, Google Cloud, Azure, IoT
- Data pipeline design
- Python programming
- Spark development
- ETL development
- Data quality assurance
- Java programming
- Big data processing
- Data modeling
- Data warehousing
Certification
- PG Diploma of AI/ML from Deakin University May2022
- Architecting on AWS (Hands on training)12-14 Aug2022
- 365 Data Science Courses19 Mar2020 -14 Apr2020
- Credit Risk Modeling
- Time Series Analysis
- Customer Analytics
- Coursera - Algorithms Part1 and Part2 Dec2017 - Apr2018
Timeline
Lead Data Engineer
Dealshare
05.2021 - Current
SDE2
Simply Social Pvt Ltd
11.2017 - 08.2019
SDE1
Cardekho
07.2015 - 07.2016
B.Tech. - CSE
RTU
HSC -
SSE Rajasthan
SSC -
SE Rajasthan
Engineering - Lead
Dealshare
10.209 - Current
SDE2
Appshoppy
06.206 - 06.2017
Similar Profiles
Nagaraj DevarajNagaraj Devaraj
Head of Operations at DealShareHead of Operations at DealShare
BABITA KUMARIBABITA KUMARI
Social Media ( Assistant manager) at DealShareSocial Media ( Assistant manager) at DealShare
MANISH JHAMANISH JHA
Executive at DealshareExecutive at Dealshare