Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Dipal Prajapati

Ahmedabad

Summary

A highly motivated big data professional having total 10+ years of experience designing and executing solutions for complex business problems using Java, Scala, Big Data, and cloud technologies. Good knowledge of Big Data, Apache Hadoop, and Spark framework. Hands-on experience in Map/Reduce programs. Experienced in designing and managing data warehousing solutions using Hive. Proficient in developing intricate ETL pipelines to convert raw data into structured datasets, ensuring data accuracy and consistency. Proficient across all software development life cycle phases. Consistently met project deadlines and delivered results on schedule. Possess strong communication and interpersonal abilities, adaptable team player, and individual contributor with robust analytical and problem-solving skills.

Overview

11
11
years of professional experience
1
1
Certification

Work History

Technical Lead

Guavus a Thales company
Ahmedabad
09.2018 - Current

Verizon Tethering

Modules:

  • MIDM - Subscriber data analytics platform
  • XMDN - Network-based authentication solution
  • BDR - Traffic analysis collector system consuming IPFIX records
  • PMS - VZW Prometheus mediation system processing Ericsson and Nokia stat files (XML)
  • Tethering -Tethering detection service
  • VCP - Deploy MIDM and XMDN components on Verizon Cloud Platform using OpenStack.
  • EIS - EIS ingests Ericsson and Cisco EDR files writing desired fields in Avro encoded form to Kafka.
  • MIS - MIDM Ingestion Service (MIS) is SQLStream application, and as name suggests it ingests data into Kafka.

Responsibilities:

  • Designing & implementing Subscriber Analytics Platform using Spark Streaming
  • Involved in Development of Ansible Deployment code pertaining to products.
  • Developing some of modules in Go
  • Worked with customer in Production Environment to de-bug issues (if any)
  • Building Jenkins Job of CICD (Deployment through automation code)
  • Building and Creating RPMs pertaining to product requirement
  • Used: Spark, HDFS, Python, GoLang, Ansible, Kafka, GitLab, Jenkins, Docker, Make, Prometheus: DMA

DMA

Service-IQ Device Management Analytics (DMA) enables multiple CSP stakeholders with real-time insights to understand capabilities and behaviors of devices connected to network.

  • Client: VIVO, Libyana, Mobifone, Entel Bolivia
  • Developed Clickhouse database architectural strategies at modeling, design, clustering and implementation stages to address business requirements.
  • Implemented identification logic of device change event and new users in system.
  • Implementing S3 read and write.
  • Migrated to AWS cloud.
  • Tools/Technology Used: Clickhouse, SQLStream , Kafka, AWS S3, EKS: Marketing Reflex (MRX) & SIQ

Marketing Reflex (MRX)

Description

  • Client: Bell, Cisco
  • MRX Marketing Insights is intended to deliver valuable insights to Telecom domain customers and help them in analyzing near real-time insights into traffic patterns on their networks.
  • It provides visibility into each subscriber's behavior and usage.
  • It enables CSPs to understand connected subscriber and device footprint and their corresponding digital behaviors.
  • CSPs can fully capitalize on their network data assets to grow revenue, increase profitability, and support customer experience (CX) initiatives.

Responsibilities:

  • 600 KFPS of EDR data processing
  • Data Ingestion in Talend
  • Implementation & tuning of Spark streaming jobs.
  • Aggregation & reporting
  • Implemented Device and other enrichments in SQLStream
  • Writing aggregated data to S3 in SQLStream
  • AWS deployment

Software Developer

Infodesk India Pvt. Ltd
Vadodara
12.2015 - 09.2018

InfoDesk specializes in information management solutions that help organizations integrate, deliver and share actionable intelligence enterprise-wide.

Spark Transformers

  • InfoDesk receives large data every day so to analyze it, was involved in writing Spark transformers to transform one form of input to desired output parallel.
  • Processing XML files, splitting each sentence into words, and emitting word's lemmas.

IREPORT

  • Making changes in business view model(metadata.xmi) in Pentaho metadata editor
  • Creating reports in Pentaho report designer and deploying them on BI-Server
  • Modifying ETLs jobs and transformations in data integration tool Spoon to load data in warehouse.

Solr Taxonomy Indexer

  • Designed multithreaded tool in Spring Boot using Java and SolrJ API to fetch large data from Taxonomy Manager Tool and index data on Apache Solr on various collections to make other applications' searches faster.

XSLT

  • Writing XSLT for transforming raw feeds to NewsML G2 XMLs for more than 200 sources like RSS, Thomson Reuters, Clinical Trials etc. Using Java method in XSLT for complex XML format.

Software Engineer

Guavus Network Systems Pvt. Ltd
Ahmedabad
06.2012 - 10.2015

Guavus is a big data analytics company that combines big data technologies, data science, and unrivaled domain expertise into customer-centric solutions with an emphasis on addressing specific business problems for network operations, marketing, security, and customer care.

Projects: Telstra Media Analytics CRUX, Cisco, CHEP, Telstra Media Analytics, Comcast Care Reflex, SingTel

  • Worked on various aspects in multiple projects beginning with aggregation of raw data as required using java collections followed by designing web services to fetch data from database and send it to UI in prescribed format using XML or using Blaze DS.
  • Analysis of raw data
  • Database Design
  • Extracting/Processing and aggregation of data
  • Designing and developing web services with Servlets or Blaze DS to interact with front-end and back-end.
  • Optimizing data aggregation process, web service performance (Implemented Caching), and database queries.
  • Unit and integration testing of application
  • Deploying and maintaining application on server environment.

Telstra Media Reflex

  • It's media analytics measuring QoE and correlating it to geo PoP, DSLAM & Subscriber Segment, Demonstrating key measures like a number of subscribers, transactions, tonnage, bit rates (Peak/Avg), Peak hour, etc.
  • Responsibilities:
  • Making Replayers to generate dummy data because data was not availed out of office premises of Telstra (Australia) Office
  • Worked on Log/Ref Data Pulling mechanism and Annotation.
  • Caching, by Implementing it user experience was improved.
  • Testing End to End Workflow, Observing Blaze DS Code, Changing web services according to requirements, Documentation on Data Pull and Caching
  • Onsite Support to team for deployment

Telstra Media Reflex (CRUX)

Telstra Media Reflex was migrated to the crux platform (Spark Framework) which was previously developed in Java and Hadoop

  • Migrated project on Guavus' Crux platform.
  • Coding in Scala for processing Radius file
  • Creating IP sessions
  • Writing Oozie jobs to schedule execution of Spark jobs.

Comcast Care Reflex

  • Achieved to have this project in production. Performed PoC version and production version.
  • Guavus Comcast CareReflex introduces scalable, interactive solution to address fusion of network events and customer care data.
  • It was consisting of four modules: Care Events, Care Events Drivers, Outage Events, and Alerts
  • Responsibilities:
  • Implemented Servlets to communicate with Netezza (was used to excel queries on large data)
  • Worked on Netezza, modifying tables and stored procedures.
  • Deploying and testing web app
  • Involved in Knowledge Transfer to US team.

Cisco

The application was for Cisco Service Assurance

  • Responsibilities:
  • DB Schema Creation
  • Implementation of Blaze DS Web Services & Testing

SingTel

  • SingTel is leading telecommunications company based in Singapore that provides both fixed as well as wireless communication services.
  • It provides analytics on mobile usage data.

CHEP

CHEP Is a leading provider of pallet and container pooling services for the Aerospace, Automotive, Chemical, Consumer Goods, and Fresh Food and Manufacturing industries. So, application was about to track pallets over map, find damaged pallets, and find total quantity transferred monthly and quarterly & comparing both.

  • Blaze DS Web Services for faster response to UI
  • Updating pallet damage data in DB
  • Testing
  • Onsite Support to team for deployment

Education

Bachelor of Engineering - Information Technology

L. D. College of Engineering
Ahmedabad, Gujarat
05-2012

HSC -

Sheth C M, Kadi Serve Vidyalaya
Gandhinagar
03-2008

SSC -

SMT R C Patel, Kadi Serve Vidyalaya
Gandhinagar
01-2006

Skills

  • P>Java, Python, Scala, Go
  • P>Apache Spark, Hadoop, Hive, HBase
  • P>Hive, Clickhouse, PostgreSQL, MySQL, Netezza
  • P>Tableau, Pentaho, Talend, Tableau, GIT, IntelliJ
  • P>Docker, Kubernetes, Helm, Ansible
  • P>AWS
  • P>Agile Methodology & SDLC

Certification

AWS Certified Solutions Architect – Associate

Timeline

AWS Certified Solutions Architect – Associate

03-2023

Technical Lead

Guavus a Thales company
09.2018 - Current

Software Developer

Infodesk India Pvt. Ltd
12.2015 - 09.2018

Software Engineer

Guavus Network Systems Pvt. Ltd
06.2012 - 10.2015

Bachelor of Engineering - Information Technology

L. D. College of Engineering

HSC -

Sheth C M, Kadi Serve Vidyalaya

SSC -

SMT R C Patel, Kadi Serve Vidyalaya
Dipal Prajapati