Komal Singh

Key Responsibilities:
Worked as an experienced Azure and DBT Specialist with a strong background in setting up and managing DBT (Data Build Tool) environments, Azure Repos, and CI/CD pipelines. With hands-on expertise in data modeling, automation, and orchestration using DBT, Azure, CAWA and ADF (Azure Data Factory).

• Set up and configure DBT models and files within Azure Repos, ensuring seamless integration and version control.
• Set up and manage Git repositories while ensuring proper branching, merging strategies, and enforcing commit conventions and code review workflows.
• Design and develop DBT macro templates and build various DBT models to support scalable data solutions.
• Manage and implement CI/CD pipelines to automate the movement of files and ensure efficient deployment in Azure Repos.
• Develop and optimize Docker files within Azure Data Factory (ADF) to schedule and execute DBT workflows efficiently.
• Collaborate with cross-functional teams to integrate and maintain robust data pipelines and workflows.
• Strong problem-solving skills and the ability to work in a fast-paced, collaborative environment.
• Familiarity with modern data stack tools and principles.

Skills:
• DBT
• Snowflake
• Git
• Azure Repo
• CAWA
• ADF

Key Responsibilities:

Worked as Data Engineer with expertise in cloud-based data integration, orchestration, and migration. Along with hands-on experience working with AWS services, DBT, and Azure DevOps to build and maintain robust data pipelines.

• Extract and transform text and CSV data from AWS S3, and load it into Amazon Redshift via AWS Glue in a staging process.
• Configure and manage DBT (Data Build Tool) to load transformed data into Redshift target tables, using Airflow DAGs for orchestration.
• Utilize Azure Repo for version control and collaborative development.
• Lead and execute the migration of data from a legacy Oracle system to a modern cloud environment, ensuring data integrity and performance optimization.
• Optimize and maintain ETL/ELT workflows to support scalable data pipelines.
• Collaborate with cross-functional teams to meet data integration and reporting needs.

Skills:

• DBT
• AWS Glue
• Amazon S3
• Amazon Redshift
• Apache Airflow
• Azure Repo
• SQL/Oracle

Key Responsibilities:

Worked as ETL Developer to design, develop, and enhance data integration solutions. Along with hands-on experience in ETL development, client interaction, and supporting end-to-end data workflows using tools like Informatica, Oracle, and UNIX.

• Collaborate with clients to gather and clarify requirements, ensuring alignment with business needs.
• Prepare detailed understanding documents to outline project scope and technical approach.
• Develop ETL workflows and scripts to meet client requirements using Informatica 9, Oracle, and UNIX.
• Conduct unit testing to ensure data accuracy and quality before delivering the code.
• Provide User Acceptance Testing (UAT) support during delivery, ensuring smooth implementation and successful project completion.
• Participate in post-production support activities to address issues and optimize performance.
• Enhance and modify existing ETL jobs across various applications to accommodate changing client requirements.
• Maintain thorough documentation for processes, workflows, and enhancements to support operational continuity.

Skills:

• Informatica
• SQL/Oracle
• Unix
• Data Warehouse(DWH)
• VL Trader