Aayushi Jha

Experienced Data Engineer with 7 years of expertise in developing scalable data pipelines, crawling, and web scraping systems. Proficient in Python (Scrapy, Selenium, Playwright), AWS (ECS, Lambda, S3), and relational databases, with hands-on experience in designing and optimizing data processing workflows. Skilled in automating data workflows, building efficient data pipelines, and implementing CI/CD pipelines to streamline testing, deployment, and data transformation. Proven ability to deliver high-quality, data-driven solutions that enhance operational efficiency and support real-time analytics.

• Designed and implemented a robust web scraping system to track product prices, descriptions, and availability across leading e-commerce platforms, enabling real-time competitive analysis.
• Leveraged Python libraries (BeautifulSoup, Scrapy, Selenium) to extract dynamic product data, overcoming JavaScript-rendered content and anti-scraping measures.
• Developed an end-to-end data pipeline to clean, store, and analyze data for real-time pricing trends and competitor strategies.
• Created PowerBI dashboards to visualize historical trends, seasonal fluctuations, and competitor pricing strategies, empowering data-driven decision-making for market positioning.

• Led a project to analyze customer sentiment across social media platforms by extracting and processing user-generated content.
• Automated data collection with custom bots, ensuring a steady flow of real-time data for sentiment analysis.
• Applied NLP techniques to classify feedback into sentiment categories, uncovering actionable insights to enhance customer engagement.
• Integrated predictive insights into an interactive PowerBI dashboard, enabling teams to track sentiment trends and improve customer-centric decision-making.