Aman Kumar

Specialist Programmer L2 (Data Engineer)

Infosys Ltd.

06.2022 - Current

Project: Data Center Intelligence (DCI)
Designed and developed ETL pipelines to ingest structured & semi-structured data from APIs, RDBMS, AWS S3 into Snowflake.
Implemented DBT models for data transformations (SCD Type 2, incremental loads, aggregations), improving pipeline modularity and reusability.
Integrated DBT runs with Airflow for end-to-end automation and lineage tracking.
Optimized Snowflake queries and warehouse performance, reducing query execution time by 30% through clustering keys and caching.
Built a generic Python framework for API data extraction with pagination, token handling, multithreading, and logging, reducing development effort by 40%.
Automated CI/CD pipelines using Python and Shell scripts, lowering manual effort by 80% and improving reliability.
Collaborated with BI teams to build data models supporting real-time operational dashboards.
Implemented CDC-based incremental pipelines into Snowflake, reducing data latency and improving reporting efficiency.
Project: MOAE – Marketing Operational Analytical Environment
Migrated legacy ETL workflows from RDBMS/HDFS to Scality S3 using PySpark and Dremio.
Converted Sqoop & Hive queries into Spark SQL & Python-based data pipelines.
Developed Python utilities for Hive table creation and handling file formats (Parquet, JSON, CSV).
Automated Jenkins cleanup jobs via Tivoli scheduler to improve reliability.
Built virtual datasets in Dremio for analytics and reporting, enabling marketing teams with faster insights.
Collaborated with cross-functional teams to streamline processes and enhance project delivery efficiency.
Analyzed business requirements to develop effective solutions aligned with organizational goals.