Jyoti Malik
Hisar
Summary
Data Engineer Lead with 2+ years of experience in engineering and analytics, awarded a Gold Medal in Computer Science. Expert in ETL pipeline design, data extraction, preprocessing, and statistical analysis. Proven success in managing large-scale projects, like the Odisha General Election, optimizing data processes, and delivering actionable insights using Python, SQL, AWS, and Google Cloud Platform. Skilled in translating client needs into strategic reports and automating tasks to boost productivity.
Overview
2
2
years of professional experience
Work History
Data Engineer Lead
Varahe Analytics Pvt. Ltd.
07.2023 - Current
- Managed the Odisha General Election project by generating 20+ daily and weekly Python reports and conducting daily ad-hoc analyses from mongoDB
- Gather client requirements and translate them into insightful, actionable reports to support decision-making and strategic planning.
- Developed an ETL pipeline for extracting and preprocessing voter roll data from multiple states' Election Commissions using computer vision and Tesseract for OCR.
- Stored data in S3 bucket and performed data cleaning and preprocessing to enhance its utility for survey analysis.
- Applied statistical techniques to booth and village-level data, providing initial insights that guided the commencement of survey efforts.
- Automated report delivery with AWS cron jobs, reducing manual effort by 90% and streamlining the reporting process.
Data Engineer
Varahe Analytics Pvt. Ltd.
07.2022 - 06.2023
- Developed an ETL pipeline using Supermetrics, Tweepy, and Selenium, reducing extraction time by 20%.
- Achieved 95% data accuracy and ensured 99% reliability in BigQuery storage.
- Conducted comprehensive data analysis and developed KPIs from the extracted data.
- Automated PDF report generation using ReportLab for the Political Intelligence team, resulting in a 50% reduction in report creation time and a 95% decrease in human error rate, significantly improving overall efficiency.
- Developed an ETL pipeline for extracting election result data from the Election Commission and set up a PostgreSQL database for storage.
- Created views for repeated access and implemented indexing to enhance performance.
- Automated spreadsheets, Google Docs, and Google Drive using Google Cloud Platform.
- Utilized GitHub for version control of all Python code, ensuring effective management and collaboration on coding projects.
Education
B.Sc. Computer Science -
RNLK Women’s College
West Bengal12th -
Army Public School
Hisar, Haryana10th -
Army Public School
Hisar, HaryanaSkills
- Python
- SQL and Databases
- Data Mining
- Git
- AWS
- Excel
- Data Analysis
- Database Design
- NoSQL Databases
- Google Dashboard
- Jira
- Slack
- Requirements Gathering
- Team Collaboration
- Report Generation
- Analytical Skills
- Key Performance Indicators
- Decision-Making
- Problem-solving abilities
Accomplishments
- Achieved the prestigious honor of being awarded the Gold Medal for Excellence in Computer Science.
- Distinguished as a top-performing Computer Science Question & Answer expert at Chegg.
Coursescertifications
- C programming - NPTEL (IIT Kanpur)
- Diploma in Computer Application and Programming - Electronic Service and Training Centre
Languages
Hindi
First Language
English
Proficient (C2)
C2
Timeline
Data Engineer Lead
Varahe Analytics Pvt. Ltd.
07.2023 - Current
Data Engineer
Varahe Analytics Pvt. Ltd.
07.2022 - 06.2023
B.Sc. Computer Science -
RNLK Women’s College
12th -
Army Public School
10th -
Army Public School
Similar Profiles
Chaitanya SharmaChaitanya Sharma
Senior Consultant at Varahe Analytics Pvt. Ltd.Senior Consultant at Varahe Analytics Pvt. Ltd.
Surabhi SrivastavaSurabhi Srivastava
Campaign Consultant at Varahe Analytics Pvt LtdCampaign Consultant at Varahe Analytics Pvt Ltd
Barun KumarBarun Kumar
Travel Consultant- Corporate Leisure at Varahe Analytics Pvt LtdTravel Consultant- Corporate Leisure at Varahe Analytics Pvt Ltd