RAHUL GURJAR
Data Engineer
Rajasthan
Summary
Experienced Data Engineer with 8 years of expertise in Azure's Data ecosystem and ETL development. Currently excelling as a business intelligence professional, handling ETL engineering, testing, and business analysis tasks. Proficient in Informatica Power Center for delivering top-notch results. Utilizes agile development methodologies like Scrum to foster high-performing and self-managing teams.
Overview
8
8
years of professional experience
4
4
years of post-secondary education
2
2
Certifications
3
3
Languages
Work History
Data Engineer
Patona Digital/Teamified
05.2022 - 05.2024
- Data Migration and Integration: Utilized Azure Data Factory to design and implement ETL pipelines, ensuring seamless data migration from legacy systems to Azure SQL Databases.
- Developed SQL stored procedures to facilitate data transformation and loading processes.
- Understand requirements, making an analysis to map the data for migration, build an ADF pipeline to onboard data from blob container to extract tables.
- Loading the data from Extract tables to Landing zone as per business requirements and logics. Applying validation as per standard.
- Setting up migration tables to bring data from different platforms to onboard them to Kolmeo portal via extract, landing, usp procedures and functions to accommodate coding standards.
- Migration of the data to production from deployment process using CI/CD integration of the code.
- Building SQL Stored procedures on day to day basis as well as DDL and DMLs to integrate business process.
- Version control using Git-Bash /SourceTree (GUI) and maintaining the code repositories on Bitbucket.
- Involve in functional testing and regression testing.
- Client interaction as part of daily, weekly and bi-weekly calls to go through daily stand ups to explain JIRA board activities along with Product-showcase to demonstrate the latest features in the code and migrated data.
- Involved in a cloud data warehouse migration to Snowflake, executing Informatica-based ETL workflows targeting Snowflake. Performed post-load validations, data quality checks, and transformation logic testing.
- Participated in a data warehouse migration where the target system was moved from on-prem Oracle to Snowflake. Adapted existing Informatica mappings to point to Snowflake and performed test cycle validations.
- Reporting and Analytics: Led the development and deployment of SSRS reports, providing actionable insights to stakeholders.
- Managed the end-to-end reporting lifecycle, from requirements gathering to deployment, ensuring data accuracy and relevance.
- Deployment of test environments on Azure DevOps to run end to end UAT tasks.
- Building a strong understanding around Prop-tech project to gain expertise on the business model and how Property, Tenant and Owners corelates and comprise of a fully functional ecosystem to work towards streamlined business.
Senior Consultant
KoinWorx BV / TCS (Rabobank -BFSI Project)
09.2021 - 05.2022
- Understand requirements, building codes, and guide other developers in the course of development activities to develop high-standard stable codes within the limits of Confidential and client processes, standards, and guidelines.
- Experience in implementing Azure data solutions, provisioning storage accounts, Azure Data Factory, SQL server, SQL Databases, SQL pool Data warehouse/Synapse DWH, Azure Data Bricks - Implementation of data movements from on-premises to cloud in Azure.
- Develop batch processing solutions by using Data Factory and Azure Data bricks.
- Implement Azure Data bricks clusters, notebooks, jobs, and auto-scaling.
- Design relational and non-relational data stores on Azure.
- Involve in functional testing and regression testing.
- Creating ETL test scenarios and test cases and plans to execute test cases.
- Interacting with business users and understanding their requirements.
- Participate in KT sessions conducted by customers/ other business teams and provide feedback on requirements.
- Good understanding of data warehouse concepts.
- Proficient in SQL and other relational databases.
- Good exposure to Microsoft Power BI.
- Good Understanding of the implementation of data frames in Databricks using Python and Scala in Azure.
- Implement Azure Data Factory operations and deployment into Azure for moving data from on-premise into the cloud.
- Monitoring end-to-end integration using Azure monitor.
- Deploying ADLS accounts and SQL Databases.
- Create pipelines in ADF using linked services to extract, transform, and load data from multiple sources like Azure SQL, Blob storage, and Azure SQL Data warehouse.
Associate Consultant
Stratacent India Pvt ltd (Invesco - BFSI Project)
01.2020 - 09.2021
- Being part of retrospective discussions and scrums to determine task deliveries and planning.
- Supporting all 4 environments (DEV, QA, UAT, and PROD) in divided groups i.e. Marketing, CRM.
- Analyzing Customer requirements and creating mappings accordingly.
- Status reporting daily as per cycle runs scheduled on Autosys.
- Finding and providing RCAs for stuck jobs or issues.
- Knowledge about Data Warehouse concepts and various schemas involved, Transactional database and Dimensional Database.
- Involved in ongoing migration activities and analysis, responsible for gathering all Informatica data and making sure of required tasks to be done from a developer's end on the admin level.
- Fine-tuning the existing codes to enhance the performance.
- Developed Informatica mappings for complex business requirements.
- Have given technical proposals for CRs to implement the necessary changes requested from the business.
- Prepared ETL mapping documents for Data Migration for smooth transfer of project from development to production environment.
- Version control using Git-Bash /SourceTree (GUI) and maintaining the code repositories on Bitbucket.
Associate Software Engineer
Conduent Business Services LLP
03.2018 - 12.2019
- Having a good understanding of SQL, Informatica, Unix, and PL/SQL.
- Analyzing Customer requirements and creating mappings accordingly.
- Validating / Design Informatica mapping and testing data.
- Design Mapping as per Business Logic for exchanging Data with various Upstream/downstream applications.
- Knowledge about Data Warehouse concepts and various schemas.
- Involved in transactional database and Dimensional Database.
- Create Mapping and Worked with various types of transformations like Lookup (connected and unconnected).
- Joiner, Expression, Filter, Router, Sorter, Aggregator, Normalizer, Sequence Generator, Update Strategy, Stored procedure transformation of Informatica Power Center using mapplets as templates.
- Developing new Informatica mappings based on the requirement using Informatica Power Center 9.6 and 10.2.
- Modifying the existing mappings based on the new requirements to improve the performance.
Education
Bachelor of Engineering - Computer Science
Rajasthan Technical University
Jaipur, Rajasthan 05.2010 - 06.2014
Skills
Azure Data Factory
Azure Synapse
Azure SQL
Azure Data Lake
Informatica PowerCenter
Data Warehouse
SQL
Recent Projects
- Kolmeo – Property Management Business, Cloud Data Migration & On-premise ETL (06/2024 – Present), Kolmeo is property management software designed to drive success for real estate agencies, property owners and tenants. Kolmeo is an end-to-end system for managing properties, tenancies, contacts and workflows that supports all types of payments in renting. Kolmeo is built using the latest payment technology, with primarily direct digital payments between tenant and owner, and the option to use trust accounts when necessary. This reduces manual work for real estate agencies and improves the payment flow of rent between tenants and owners.
- Rabobank – Global Financial System & Global Data Platform, Rabo Financial Risk & Analysis (05/2022 – 05/2024), Utrecht, NL, Working with millions of datasets, experiencing an unparalleled view of the Dutch economy. As part of a team of over 1,000 Finance Risk co-workers, contributing to a tribe of a challenging environment driven by innovation to ensure a smooth data transformation in this digital era.
- Invesco-Salespage Application, Invesco Salespage – CRM, Marketing (01/2020 - 10/2021), Denver, USA, Invesco is a US-based Sales project dealing with the stock market sales report. it’s a blend of development and support projects wherein we have to Monitor the Production, QA, and Development jobs in Autosys as well as we need to Develop and deploy the new codes and enhance the previously designed codes using the power center.
Passions
- Building Efficient Data Systems
- Teaching Data Engineering Principles
Certification
Microsoft Azure Data Engineer Associate (DP-203)
Timeline
Microsoft Azure Data Engineer Associate (DP-203)
06-2024
Microsoft Azure Data Fundamentals(DP-900)
05-2024
Data Engineer
Patona Digital/Teamified
05.2022 - 05.2024
Senior Consultant
KoinWorx BV / TCS (Rabobank -BFSI Project)
09.2021 - 05.2022
Associate Consultant
Stratacent India Pvt ltd (Invesco - BFSI Project)
01.2020 - 09.2021
Associate Software Engineer
Conduent Business Services LLP
03.2018 - 12.2019
Bachelor of Engineering - Computer Science
Rajasthan Technical University
05.2010 - 06.2014