Summary
Overview
Work History
Education
Skills
Info - Github
Recentprojects
Timeline
Generic
AMARDEEP SINGH

AMARDEEP SINGH

D.E. Shaw
Gurgaon

Summary

I specialize in transforming investment analysis and stakeholder investment theses into actionable insights through the power of alternative data. At DE Shaw, I work closely with the Fundamental Equity team to identify, analyze, and leverage the best alternative datasets to generate alpha. My role encompasses understanding complex investment strategies, extracting relevant alternative data, and seamlessly connecting these data points to unlock hidden opportunities.

Overview

6
6
years of professional experience
14
14
years of post-secondary education

Work History

Lead Data Engineer

D.E. Shaw
04.2024 - Current

Lead Data Engineer – Fundamental Equity Team

  • Collaborate with stakeholders to identify and source the best alternative datasets aligned with investment theses, ensuring actionable insights for strategic decision-making.
  • Develop highly optimized data scrapers to extract alternative data from diverse sources, including websites, PDFs, and APIs, while implementing robust scheduling pipelines for seamless data flow.
  • Design and enforce rigorous data quality checks to deliver reliable and accurate datasets to stakeholders, maintaining high standards of integrity.
  • Create insightful data visualization reports to identify trends and support stakeholder analysis, enabling data-driven decisions.
  • Efficiently manage large-scale data storage, optimizing data structures and implementing alert systems to proactively address data gaps and ensure continuity.

Associate Data Engineer

BlackRock
12.2021 - 04.2024

Associate Data Engineer – Data Strategy & Solutions Team, Portfolio Management Group

  • Contributed to the Data Strategy & Solutions team, delivering alternative data solutions to support all investment teams.
  • Designed and developed Scrapy spiders for data extraction, along with pipeline modules to ingest, process, and store data in BigQuery after applying filtration and validation rules.
  • Analyzed datasets to identify alpha-generating opportunities and presented data insights to stakeholders, driving informed investment decisions.
  • Led a team of data engineers focused on data extraction, ensuring efficient processes and high-quality outputs.
  • Built and automated ETL workflows, enhancing data pipeline efficiency and scalability.

Senior Data Analyst

Eclerx
10.2020 - 12.2021

Senior Data Analyst – Competitive Intelligence (Center of Excellence) Team

  • Designed and developed a web harvesting tool to automate the end-to-end process of large-scale data extraction, including individual module development and seamless integration.
  • Built tool capabilities to handle dynamic scenarios, accept user inputs, extract data from multiple websites, and generate crawler scripts for various use cases.
  • Automated repetitive manual tasks by developing robust scripts, improving productivity and accuracy across processes.

Software Developer

PE Analytics Pvt Ltd
04.2019 - 10.2020
  • Designed and developed over 200+ data scraping bots with advanced capabilities to bypass anti-bot security measures and captchas, ensuring efficient and reliable data extraction.
  • Extracted and transformed unstructured data from images and PDFs into structured formats using advanced data structures and logic-based algorithms
  • Conducted in-depth analysis of real estate data to generate actionable insights and deliver value to clients.

Education

Bachelor of Engineering - Computer Science

JSSATE
Noida
04.2001 - 05.2015

Skills

Python

Web Scraping

ETL

Data quality assurance

Data cleansing techniques

SQL and databases

Project management

Pattern recognition

Cloud computing

API development

Data analysis

Info - Github

https://github.com/kharkwal

Recentprojects

  • Chatbot for Realestate data assistant, Which is made up in Python using chatterbot framework and NLP
  • Unstructured Image data extraction, Which is done using of NLP and OCR
  • Automated Ticketbooking bot desktop application, Which can book 100+ tickets within a minute from ticketmaster.com website. It is made up in python using requests and UI is made up in Pyqt
  • Automated data extraction applications, Build various automated data extraction Bots for 200+ websites and solved various types of Captchas like image captchas and google recaptcha v3 and securities like distil, etc

Timeline

Lead Data Engineer

D.E. Shaw
04.2024 - Current

Associate Data Engineer

BlackRock
12.2021 - 04.2024

Senior Data Analyst

Eclerx
10.2020 - 12.2021

Software Developer

PE Analytics Pvt Ltd
04.2019 - 10.2020

Bachelor of Engineering - Computer Science

JSSATE
04.2001 - 05.2015
AMARDEEP SINGHD.E. Shaw