Sourav Sengupta
Hyderabad
Summary
Dynamic and results-driven Data Engineer with over 5 years of hands-on experience in designing, optimizing, and maintaining robust data pipelines and models. Adept at leveraging advanced technologies and tools, including Python, Pandas, GraphQL, and AWS (S3, EC2), to transform raw data into actionable insights that drive informed decisionmaking.
Overview
6
6
years of professional experience
Work History
DATA SOLUTION ENGINEER
FactSet
Hyderabad
12.2022 - Current
- Facilitate communication between data engineering teams and stakeholders to gather requirements, define deliverables, and establish project timelines.
- Develop and maintain robust ETL pipelines to integrate data from various sources into FactSet's data ecosystem.
- Automate data collection, transformation, and loading processes using Python and relevant technologies.
- Implement data modeling practices using the Snowflake schema to design scalable and efficient database structures while ensuring data integrity and quality.
- Create and optimize GraphQL APIs for efficient data access, ensuring comprehensive documentation and performance optimization.
- Manage and optimize data storage solutions using AWS S3 buckets.
- Use Teradata connectors available in popular ETL platforms to streamline data integration and enable efficient loading to Teradata warehouses.
- Create scripts and tools to automate data parsing and pre-processing tasks.
- Utilize tools such as Pandas for effective data manipulation and transformation.
ANALYST
Global Data Plc
Hyderabad
01.2020 - 12.2022
- Installed, configured, managed, monitored, and troubleshot SQL Server versions from 2005 to 2019.
- Developed complex SQL queries to transform database reporting requirements into meaningful data reports.
- Performed data loads and routine updates using Python for ongoing database maintenance.
- Automated processes and integrated projects using a Selenium-based Python data-driven framework.
- Wrote Python code to build an ETL program that efficiently scraped and processed 50 million records.
Education
B. Tech - Electrical Engineer
WBUT
M. Tech - Electrical Engineer
Jalpaiguri govt Engineering college
Skills
Python
Pandas
NumPy
Matplotlib
Beautiful Soup
Scikit-Learn
SQL Alchemy
PyODBC
PySpark
AWS(s3, redshift, lamda, glue,Emr)
Scrappy
Selenium
Seaborn
Bcp
Plotly
Hadoop-Py
Apache Airflow
Luigi
Teradata
Timeline
DATA SOLUTION ENGINEER
FactSet
12.2022 - Current
ANALYST
Global Data Plc
01.2020 - 12.2022
M. Tech - Electrical Engineer
Jalpaiguri govt Engineering college
B. Tech - Electrical Engineer
WBUT