Saurabh More
Mumbai
Summary
Experienced Professional Data Engineer with 8+ years of expertise in developing and implementing big data analytics solutions. Skilled in designing and executing dynamic data pipeline solutions for diverse business domains.
Overview
9
9
years of professional experience
Work History
Data Engineer
Blenheim Chalcot
04.2023 - Current
- Designed and maintained scalable, fault-tolerant data pipelines leveraging GCP Pub/Sub, Cloud Storage, and Snowflake, ensuring efficient data ingestion and processing.
- Reduced data ingestion latency by 99% through Snowflake Snowpipe streaming, Streams, and Tasks, enabling near real-time updates with automated CDC processes.
- Migrated post-load transformations to dbt, creating modular SQL models, custom macros, and dynamic templates to improve pipeline efficiency and maintainability.
- Enhanced Snowflake query performance by 40% through optimized partitioning, clustering, and materialized views, supporting high-concurrency workloads with multi-cluster warehouses.
- Developed robust pipelines for parsing XML files from third party applications to JSON and integrating data into MongoDB, ensuring seamless updates and efficient management.
- Secured sensitive data using Snowflake Dynamic Data Masking, Row Access Policies, and implemented Time Travel for reliable data recovery and audit compliance.
- Key Skills: Python, SQL, Snowflake, GCP, DBT, Airbyte, Docker, Data Modeling, ETL, MongoDB, etc.
Consultant Data Engineer
ZS Associates
09.2022 - 03.2023
- Worked for one of the top pharmacy clients in transitioning their data warehouse ecosystem from Teradata to Snowflake. My involvement not only upgraded their infrastructure but also fine-tuned data processing for optimal performance.
- Key Skills: Python, SQL, PySpark ,AWS Services (S3, IAM, EMR, Glue, Athena), etc.
Sr. Data Engineer
GXO/XPO Logistics, Mumbai, Maharashtra
07.2021 - 08.2022
- Worked with the Operational Analytics team, driving the design, testing, and maintenance of an agile and precise end-to-end ETL data management system.
- Developed robust data pipelines on Hortonworks Data Platform (HDP) 2.0, directly empowering the pre-sales analytics team to uncover compelling, data-driven insights.
- Key Skills: Python, Presto SQL(SQL), Airflow, MinIO S3 Bucket, PostgreSQL database, MongoDB, Docker, Kubernetes, Putty, HDP 2.0, HiveQL, Tableau, Pentaho Data Integration, etc.
Software Consultant
Quinnox Consultancy Services
08.2015 - 12.2017
- Delivered a sophisticated data warehousing solution for a premier banking client, pushing the boundaries of modern big data technologies.
- Key Skills: Distributed Computing - HDFS, Map-Reduce Framework, YARN, HiveQL, RDBMS Systems, Sqoop, etc.
Education
Bachelor of Computer Engineering -
University of Mumbai
Postgraduate Degree - IT Project Management
Welingkar Institute of Management
03-2021
Skills
- Programming Languages: Python3(Pandas, NumPy, etc)
- Databases: PostgresSQL, MySQL, MongoDB
- Experienced working with Snowflake, Databricks platforms
- Big Data Technologies: Apache Spark (RDD, DataFrame, SparkSQL using PySpark), Hive, etc
- Data warehousing, Data modeling, Delta lake, ETL, etc
- Cloud Platforms: GCP, AWS services
- File formats: Parquet, ORC, Avro, JSON, CSV, Iceberg, etc
- Data Orchestration: Airflow, Airbyte
- CI/CD: GitHub Actions
- Version Control: GitHub
- Deployment: Docker, K8s, Terraform
- Data Viz Tools: Tableau, Metabase
Personal Information
www.linkedin.com/in/saurabhmore7
Education
- Postgraduate Degree, IT Project Management (2020-2021) - Welingkar Institute of Management
- Bachelors of Computer Engineering (2011-2015) - University of Mumbai
Certifications
- Academy Accreditation - Databricks Lakehouse Fundamentals
- Astronomer Certification DAG Authoring for Apache Airflow
- Astronomer Certification for Apache Airflow Fundamentals
Timeline
Data Engineer
Blenheim Chalcot
04.2023 - Current
Consultant Data Engineer
ZS Associates
09.2022 - 03.2023
Sr. Data Engineer
GXO/XPO Logistics, Mumbai, Maharashtra
07.2021 - 08.2022
Software Consultant
Quinnox Consultancy Services
08.2015 - 12.2017
Postgraduate Degree - IT Project Management
Welingkar Institute of Management
Bachelor of Computer Engineering -
University of Mumbai
Similar Profiles
Kushal DeyKushal Dey
PRODUCT MANAGER, SPECIALIST at Blenheim ChalcotPRODUCT MANAGER, SPECIALIST at Blenheim Chalcot
Sheldon LionelSheldon Lionel
Systems Administrator at Blenheim Chalcot IT Services India PVT LTDSystems Administrator at Blenheim Chalcot IT Services India PVT LTD
Pratyush SinhaPratyush Sinha
Head of Marketing at Blenheim ChalcotHead of Marketing at Blenheim Chalcot