Md Farhan
Kolkata
Summary
Experienced Data Engineer with a strong background in designing and implementing ETL solutions using Snowflake, Python, PySpark, AWS, and Databricks. Skilled in optimizing data workflows, ensuring efficient data processing and transformation. Demonstrated expertise in end-to-end data solutions, data migration, and creating robust data pipelines. Proven ability to enhance operational efficiency and scalability through advanced data engineering practices. Certified in SnowPro Core and AWS Cloud Practitioner, with a successful track record in delivering high-quality, reliable data systems aligned with business objectives.
Overview
3
3
years of professional experience
1
1
Certification
Work History
Data Engineer
Invesco India Pvt. Ltd.
Hyderabad
05.2021 - Current
- Created and executed ETL processes utilizing a combination of Snowflake, Python, PySpark, AWS, and Databricks to ensure efficient data integration and transformation.
- Utilized AWS Lambda functions to automate data workflows and ensure timely and accurate data delivery.
- Tuned database performance and optimized Snowflake queries, leading to faster query response times and greater system efficiency.
- Collaborated with cross-functional teams to understand business requirements and translate them into technical solutions.
- Played an active role in enhancing the design and maintenance of data pipelines and warehouses, prioritizing reliability and scalability.
Education
Bachelor of Technology - Information Technology
Techno India, Saltlake
Kolkata, India08-2020
Skills
- ETL Development: Python, PySpark
- AWS Services: Lambda, S3, etc
- Snowflake Query Optimization
- DBT (Data Build Tool)
- Data Warehousing
- Data Modeling
- Performance Tuning of Queries
- Databricks: ETL and Data Engineering
- SnowPro Core Certified
Certification
- Certified SnowPro Core: Demonstrated advanced proficiency in Snowflake data warehousing solutions, ensuring optimized query performance and efficient data processing.
- AWS Cloud Practitioner Certification: Validated foundational knowledge and skills in AWS cloud services, enabling effective utilization of AWS Lambda functions and other cloud-based tools for scalable data solutions.
Timeline
Data Engineer
Invesco India Pvt. Ltd.
05.2021 - Current
Bachelor of Technology - Information Technology
Techno India, Saltlake