Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Payal Pokale

Technical Product Manager - Big Data,AWS
Pune

Summary

Data engineer Manager with 10 years of IT experience, including 4 years leading big data products. I excel in product lifecycle management, from ideation to deployment, with expertise in Hadoop ecosystem tools. Proficient in AWS services like EC2, EMR, CloudFormation, and AWS Glue for product development and migration, as well as Azure cloud services such as ADF. Experienced in managing big data products on Apache Spark, ensuring seamless integration and performance. Adept at integrating cutting-edge technologies like OpenAI's ChatGPT to automate user functionalities, enhance efficiency, and boost engagement. With over 4 years in product role, I have a proven track record of driving product strategy and leading cross-functional teams to deliver impactful solutions that align with business goals. Recognized as one of the top 21 leaders in the company’s Trailblazer Club.


Overview

2025
2025
years of professional experience
6
6
years of post-secondary education
1
1
Certification
3
3
Languages

Work History

Manager

RateGain
3 2022 - Current
  • Led the development and strategic deployment of a Data Lake for social media content, leveraging AWS Redshift to enhance data accessibility and support product innovation. Collaborated with stakeholders to ensure the solution met business objectives.
  • Driving cross-functional teams, including data science, backend, and data engineering, to implement key product features. Demonstrated a deep understanding of business needs, translating them into actionable product strategies and ensuring alignment across teams.
  • Strategically integrated OpenAI's ChatGPT into the product to enhance user functionalities through automation. Oversaw the end-to-end implementation, from prompt engineering to the deployment of large language models (LLMs), ensuring that the integration aligned with product objectives and improved overall product efficiency and user engagement.
  • Managing the end-to-end development of ETL pipelines, coordinating with cross-functional teams to extract, transform, and load data from sources such as PostgreSQL, S3, and Redshift. Utilized AWS Glue and Athena to drive efficient data processing aligned with product goals.
  • Directed the integration of data sources into Redshift schemas via Data Migration Service (DMS), working closely with data engineers to ensure seamless data flow and accuracy, critical for product scalability and reliability.
  • Oversaw the development and execution of a comprehensive data flow process, from extraction to visualization in Tableau. Ensured that product features met business requirements and facilitated high-impact data insights for stakeholders.
  • Delivering and leading the adoption of tailored data reporting solutions using Tableau Desktop and Tableau Online. Enhanced product features based on user feedback and data-driven insights, enabling better decision-making and user engagement through advanced data visualization and actionable insights. Collaborated with clients and internal teams to ensure alignment with business needs.
  • Spearheading multiple POCs for social media data reporting, collaborating with data scientists and analysts to leveraging Machine learning, data science and Tableau for product improvement. Using POCs to validate and refine product strategies.
  • Managed the integration of Meta API, Instagram, and Twitter data into a social media analytics platform, improving customer feedback processes and boosting satisfaction scores by 30%. Used Airtable to streamline data management and team collaboration.
  • Directed the go-to-market strategy for the content publishing platform, increasing user adoption by 25%. Conducted competitive analysis to enhance product features and market positioning.
  • Enhanced team collaboration, implementing agile methodologies for more effective project management.
  • Mentored junior team members, fostering growth in their technical knowledge and project management skills.

Product Tech Lead

LTI
03.2020 - 03.2022
  • Defined and prioritized product requirements for end-to-end data pipeline development, ensuring alignment with client needs and regional specifications.
  • Developed and maintained a product roadmap for data integration solutions, coordinating with stakeholders to set milestones and deliverables that met business objectives.
  • Designed and implemented Azure Data Factory (ADF) pipelines for data extraction from various sources and integration into systems such as Cosmos DB and SQL Server, ensuring seamless data flow and accessibility.
  • Monitored and analyzed pipeline performance and data accuracy, leveraging feedback to iterate on product features and enhance overall system efficiency.
  • Collaborated with clients to integrate data from their systems into Azure Cloud, developed APIs for downstream applications, and ensured effective data connectivity and utilization.
  • Managed and mentored a team of four, overseeing project execution and fostering collaboration to deliver high-quality technical solutions.
  • Implemented self-hosted runtime integration in ADF, optimizing pipeline performance and enhancing system reliability.
  • Utilized a range of Azure services, including Azure Blob Storage, Data Pipelines, ADFS, SSIS integration, Function Apps, and Azure Cosmos DB, to build and support comprehensive data solutions.
  • Implemented data governance and security protocols within Azure services to ensure compliance with industry standards and protect sensitive information.
  • Developed comprehensive documentation and training materials for end-users and technical teams, ensuring smooth adoption and utilization of data integration solutions.
  • Led user acceptance testing (UAT) and gathered feedback to refine data pipeline functionalities, enhancing user satisfaction and product effectiveness.
  • Facilitated cross-functional meetings to align technical teams, clients, and other stakeholders on project goals, ensuring timely delivery and integration of data solutions.
  • Led a Proof of Concept (POC) to evaluate Snowflake as an alternative to SQL Server Management Studio (SSMS), assessing its scalability and performance benefits. Developed a migration strategy and provided actionable insights for integrating Snowflake into the data architecture, aligning with product goals and enhancing overall data solution efficiency.

Senior Executive

Nielsen
11.2017 - 03.2020
  • Involved in different products development and deployment.
  • Involved in setting up warehouse system using apache hive for collecting data from collection system. It involved creating and managing various databases and tables using apache hive.
  • Have written multiple aggregation templates for various reports generation on client's demands.
  • Created and scheduled different oozie workflows for report generation in timely manner also monitored coordinators jobs in oozie on daily basis.
  • Migrated multiple existing big data on-prem products deployment to AWS using various AWS services.
  • Experience in writing different lambda functions.
  • Also have automated the deployment of the products
    by using cloud Formation templates and the multiple shell scripts for creation of long running/transient EMR clusters and other AWS resources.
  • Experience in working with AWS data pipeline in order to schedule production workload.
  • Involve in different POC's on AWS services.
  • Collaborated on all stages of products development
    lifecycle, from requirement gathering to production releases.

Software Engineer

Atos India Pvt Ltd
12.2014 - 10.2017
  • Worked on a live Hadoop production CDH4 cluster with 10 nodes for processing semi structured data.
  • Good experience in benchmarking Hadoop cluster.
  • Used sqoop to import data from Mysql system in to hdfs.
  • Designed and developed Pig data transformation
    scripts to work against unstructured data from various data points and created a base line.
  • Configured SQL database to store Hive metadata.
  • Worked on creating and optimizing hive queries for data analysts based on the requirements.
  • Exported the analyzed data to the relational databases using sqoop for visualization and to generate reports for the BI team.
  • Worked with infrastructure and admin teams to set up
    monitoring probes to track the health of the nodes.
  • Created and maintained technical documentation for
    launching Hadoop cluster and for executing Hive queries and other tools.

Education

Bachelor Of Engineering In Computer Science & Tech -

PRMIT&R
06.2011 - 04.2014

Diploma: Computer Science -

Government Polytechnic, Amravati - With 86.13 %
08.2008 - 04.2011

Skills

    Tools : Asana,JIRA,Git,Other CICD tools- JIRA,Git,Tableau bitbucket,Jenkins ,Cloudera,Confluence,slack,airtable,ProductPlan, etc

    Databases: SQL Server,RDS,DynamoDB, Cosmos DB

    AWS Services: EC2,S3,EMR,Redshift,Lambda,Data Pipeline,RDS,SNS,CloudWatch,cloudformation etc

    Azure services: ADF, Blob,SSIS,IR,Function Apps,Cosmos DB

    Operating System : Unix/ Windows/MAC

    Data Visualization: Tableau, Microsoft Excel, spitfire

    Programming: Java, Python

Certification

AWS Certified Solutions Architect

Timeline

Product Tech Lead

LTI
03.2020 - 03.2022

Senior Executive

Nielsen
11.2017 - 03.2020

Software Engineer

Atos India Pvt Ltd
12.2014 - 10.2017

Bachelor Of Engineering In Computer Science & Tech -

PRMIT&R
06.2011 - 04.2014

Diploma: Computer Science -

Government Polytechnic, Amravati - With 86.13 %
08.2008 - 04.2011

Manager

RateGain
3 2022 - Current

Similar Profiles

CREATE PROFILE
Payal PokaleTechnical Product Manager - Big Data,AWS