Summary
Overview
Work History
Education
Skills
Certification
Work Availability
Quote
Timeline
Hi, I’m

Dipal Prajapati

Technical Lead
Ahmedabad
Dipal Prajapati

Summary

A highly motivated big data professional having total 10+ years of experience designing and executing solutions for complex business problems using Java, Scala, Big Data, and cloud technologies. Good knowledge of Big Data, Apache Hadoop, and Spark framework. Hands-on experience in Map/Reduce programs. Experienced in designing and managing data warehousing solutions using Hive. Proficient in developing intricate ETL pipelines to convert raw data into structured datasets, ensuring data accuracy and consistency. Proficient across all software development life cycle phases. Consistently met project deadlines and delivered results on schedule. Possess strong communication and interpersonal abilities, adaptable team player, and individual contributor with robust analytical and problem-solving skills.

Overview

11
years of professional experience
1
Certificate
6
years of post-secondary education

Work History

Guavus a Thales company
Ahmedabad

Technical Lead
09.2018 - Current

Job overview

Verizon Tethering

Modules:

  • MIDM - Subscriber data analytics platform
  • XMDN - Network-based authentication solution
  • BDR - Traffic analysis collector system consuming IPFIX records
  • PMS - VZW Prometheus mediation system processing Ericsson and Nokia stat files (XML)
  • Tethering -Tethering detection service
  • VCP - Deploy MIDM and XMDN components on Verizon Cloud Platform using OpenStack.
  • EIS - EIS ingests Ericsson and Cisco EDR files writing desired fields in Avro encoded form to Kafka.
  • MIS - MIDM Ingestion Service (MIS) is SQLStream application, and as name suggests it ingests data into Kafka.

Responsibilities:

  • Designing & implementing Subscriber Analytics Platform using Spark Streaming
  • Involved in Development of Ansible Deployment code pertaining to products.
  • Developing some of modules in Go
  • Worked with customer in Production Environment to de-bug issues (if any)
  • Building Jenkins Job of CICD (Deployment through automation code)
  • Building and Creating RPMs pertaining to product requirement
  • Used: Spark, HDFS, Python, GoLang, Ansible, Kafka, GitLab, Jenkins, Docker, Make, Prometheus: DMA

DMA

Service-IQ Device Management Analytics (DMA) enables multiple CSP stakeholders with real-time insights to understand capabilities and behaviors of devices connected to network.

  • Client: VIVO, Libyana, Mobifone, Entel Bolivia
  • Developed Clickhouse database architectural strategies at modeling, design, clustering and implementation stages to address business requirements.
  • Implemented identification logic of device change event and new users in system.
  • Implementing S3 read and write.
  • Migrated to AWS cloud.
  • Tools/Technology Used: Clickhouse, SQLStream , Kafka, AWS S3, EKS: Marketing Reflex (MRX) & SIQ

Marketing Reflex (MRX)

Description

  • Client: Bell, Cisco
  • MRX Marketing Insights is intended to deliver valuable insights to Telecom domain customers and help them in analyzing near real-time insights into traffic patterns on their networks.
  • It provides visibility into each subscriber's behavior and usage.
  • It enables CSPs to understand connected subscriber and device footprint and their corresponding digital behaviors.
  • CSPs can fully capitalize on their network data assets to grow revenue, increase profitability, and support customer experience (CX) initiatives.

Responsibilities:

  • 600 KFPS of EDR data processing
  • Data Ingestion in Talend
  • Implementation & tuning of Spark streaming jobs.
  • Aggregation & reporting
  • Implemented Device and other enrichments in SQLStream
  • Writing aggregated data to S3 in SQLStream
  • AWS deployment

Infodesk India Pvt. Ltd
Vadodara

Software Developer
12.2015 - 09.2018

Job overview

InfoDesk specializes in information management solutions that help organizations integrate, deliver and share actionable intelligence enterprise-wide.

Spark Transformers

  • InfoDesk receives large data every day so to analyze it, was involved in writing Spark transformers to transform one form of input to desired output parallel.
  • Processing XML files, splitting each sentence into words, and emitting word's lemmas.

IREPORT

  • Making changes in business view model(metadata.xmi) in Pentaho metadata editor
  • Creating reports in Pentaho report designer and deploying them on BI-Server
  • Modifying ETLs jobs and transformations in data integration tool Spoon to load data in warehouse.

Solr Taxonomy Indexer

  • Designed multithreaded tool in Spring Boot using Java and SolrJ API to fetch large data from Taxonomy Manager Tool and index data on Apache Solr on various collections to make other applications' searches faster.

XSLT

  • Writing XSLT for transforming raw feeds to NewsML G2 XMLs for more than 200 sources like RSS, Thomson Reuters, Clinical Trials etc. Using Java method in XSLT for complex XML format.

Guavus Network Systems Pvt. Ltd
Ahmedabad

Software Engineer
06.2012 - 10.2015

Job overview

Guavus is a big data analytics company that combines big data technologies, data science, and unrivaled domain expertise into customer-centric solutions with an emphasis on addressing specific business problems for network operations, marketing, security, and customer care.

Projects: Telstra Media Analytics CRUX, Cisco, CHEP, Telstra Media Analytics, Comcast Care Reflex, SingTel

  • Worked on various aspects in multiple projects beginning with aggregation of raw data as required using java collections followed by designing web services to fetch data from database and send it to UI in prescribed format using XML or using Blaze DS.
  • Analysis of raw data
  • Database Design
  • Extracting/Processing and aggregation of data
  • Designing and developing web services with Servlets or Blaze DS to interact with front-end and back-end.
  • Optimizing data aggregation process, web service performance (Implemented Caching), and database queries.
  • Unit and integration testing of application
  • Deploying and maintaining application on server environment.

Telstra Media Reflex

  • It's media analytics measuring QoE and correlating it to geo PoP, DSLAM & Subscriber Segment, Demonstrating key measures like a number of subscribers, transactions, tonnage, bit rates (Peak/Avg), Peak hour, etc.
  • Responsibilities:
  • Making Replayers to generate dummy data because data was not availed out of office premises of Telstra (Australia) Office
  • Worked on Log/Ref Data Pulling mechanism and Annotation.
  • Caching, by Implementing it user experience was improved.
  • Testing End to End Workflow, Observing Blaze DS Code, Changing web services according to requirements, Documentation on Data Pull and Caching
  • Onsite Support to team for deployment

Telstra Media Reflex (CRUX)

Telstra Media Reflex was migrated to the crux platform (Spark Framework) which was previously developed in Java and Hadoop

  • Migrated project on Guavus' Crux platform.
  • Coding in Scala for processing Radius file
  • Creating IP sessions
  • Writing Oozie jobs to schedule execution of Spark jobs.

Comcast Care Reflex

  • Achieved to have this project in production. Performed PoC version and production version.
  • Guavus Comcast CareReflex introduces scalable, interactive solution to address fusion of network events and customer care data.
  • It was consisting of four modules: Care Events, Care Events Drivers, Outage Events, and Alerts
  • Responsibilities:
  • Implemented Servlets to communicate with Netezza (was used to excel queries on large data)
  • Worked on Netezza, modifying tables and stored procedures.
  • Deploying and testing web app
  • Involved in Knowledge Transfer to US team.

Cisco

The application was for Cisco Service Assurance

  • Responsibilities:
  • DB Schema Creation
  • Implementation of Blaze DS Web Services & Testing

SingTel

  • SingTel is leading telecommunications company based in Singapore that provides both fixed as well as wireless communication services.
  • It provides analytics on mobile usage data.

CHEP

CHEP Is a leading provider of pallet and container pooling services for the Aerospace, Automotive, Chemical, Consumer Goods, and Fresh Food and Manufacturing industries. So, application was about to track pallets over map, find damaged pallets, and find total quantity transferred monthly and quarterly & comparing both.

  • Blaze DS Web Services for faster response to UI
  • Updating pallet damage data in DB
  • Testing
  • Onsite Support to team for deployment

Education

L. D. College of Engineering
Ahmedabad, Gujarat

Bachelor of Engineering from Information Technology
06.2008 - 05.2012

University Overview

GPA: 8.05

  • Received Bharti Airtel Scholarship
  • Completed professional development for Electrotherm as an Academic Project @ElectroTherm: Dealer Management System for YO bikes dealer (Aug 2011- April 2012)

Sheth C M, Kadi Serve Vidyalaya
Gandhinagar

HSC
06.2007 - 03.2008

University Overview

GPA: 82.40%

SMT R C Patel, Kadi Serve Vidyalaya
Gandhinagar

SSC
01.2005 - 01.2006

University Overview

GPA: 88.14%

Skills

Java, Python, Scala, Go

undefined

Certification

AWS Certified Solutions Architect – Associate

Availability
See my work availability
Not Available
Available
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse

Quote

The way to get started is to quit talking and begin doing.
Walt Disney

Timeline

AWS Certified Solutions Architect – Associate

03-2023
Technical Lead
Guavus a Thales company
09.2018 - Current
Software Developer
Infodesk India Pvt. Ltd
12.2015 - 09.2018
Software Engineer
Guavus Network Systems Pvt. Ltd
06.2012 - 10.2015
L. D. College of Engineering
Bachelor of Engineering from Information Technology
06.2008 - 05.2012
Sheth C M, Kadi Serve Vidyalaya
HSC
06.2007 - 03.2008
SMT R C Patel, Kadi Serve Vidyalaya
SSC
01.2005 - 01.2006
Dipal PrajapatiTechnical Lead