EKTA PAWAR
Bengaluru
Summary
Data Engineer with 3.5+ years of experience across finance and CPG domains, proficient in designing scalable data pipelines, cloud solutions, and managing large datasets. Hands-on experience with Python, PostgreSQL, Azure cloud, and data engineering tools. Skilled in building end-to-end data processing solutions and collaborating on product development to drive business outcomes.
Overview
3
3
years of professional experience
Work History
Associate Data Engineer
QI-Cap Investment
Bengaluru
04.2024 - Current
- Developed robust pipelines to handle data extraction and transformation across multiple platforms including more than ten websites.
- Implemented web scraping solutions to efficiently gather required information from websites.
- Dimensional Modeling: Designed efficient database schemas, ensuring data integrity, security, and quality compliance.
- Crafted and fine-tuned SQL queries to pull vast datasets for review.
- Managed and organized structured, semi-structured, unstructured data , and databases such as PostgreSQL and MongoDB .
- Leadership and Analysis: Lead the data engineering team, and perform financial data analysis for stocks.
- Developed and maintained data pipelines to ingest, transform, validate, and store data in a variety of formats using Airflow.
- Maintained version control systems like GitLab and GitHub for tracking code changes.
- Generated reports using PowerBI and Excel to provide meaningful insights into the data.
- Created web dashboard using Streamlit in python to validate and monitor the data.
Data Engineer
Fractal Analytics
Bengaluru
09.2021 - 03.2024
- Data Pipeline Development: Designed and implemented event-driven architectures and data pipelines, ensuring real-time data availability for trading and debt market products.
- Python Pipelines: Engineered Python-based pipelines to extract and process unstructured news data, storing insights in MongoDB.
- Analyzed correlation between news sentiment and stock price shifts post key events.
- Executed prototyping and backtesting of factors, generating insights for stock market forecasting.
- Created detailed analyses and presentations for the bond market that attracted significant client investment.
- Directed data migration project for CPG client, moving 50 GB of store and customer data to Azure.
- Employed Azure tools for comprehensive data processing and workflow automation.
- BI Dashboard Development: Developed a dynamic BI Dashboard with KPI metrics, resulting in a 4% increase in client revenue.
- Big Data Expertise: Extensive hands-on experience with Spark, Hadoop, Hive, and Streaming, enhancing Big Data skills, and working with Spark APIs.
Education
Bachelor's Degree - Computer Science
SRM Institute Of Science & Technology
05.2021
Skills
- Python
- SQL
- Data Management
- Airflow
- Data engineering
- Data warehousing
- Data modeling
- Web scraping
- Data analytics
- Financial Analysis
- Azure Databricks
- Data Transformation and ETL (Azure)
- Cloud Knowledge (Azure/AWS basics)
- Spark
- Hadoop
- Hive
- Linux
- Git
- Data Science ML (basics)
- Excel
- PowerBI
Timeline
Associate Data Engineer
QI-Cap Investment
04.2024 - Current
Data Engineer
Fractal Analytics
09.2021 - 03.2024
Bachelor's Degree - Computer Science
SRM Institute Of Science & Technology
Similar Profiles
Maisha BrownMaisha Brown
Volunteer-Event Team Member at Body And Brain Yoga Tai Qi And Qi Gong CenterVolunteer-Event Team Member at Body And Brain Yoga Tai Qi And Qi Gong Center
Dr. Durva MoreDr. Durva More
Senior Clinical Expert at Qi Spine ClinicSenior Clinical Expert at Qi Spine Clinic
Selena Yueran LaySelena Yueran Lay
Massage Therapist at Qi Healing MassageMassage Therapist at Qi Healing Massage