Versatile Senior Software Engineer, successful at completing simultaneous development and update projects. Decisive leader and reliable team builder with a results-focused and motivated approach. Develops software solutions for a variety of client needs and experimentation platforms.
Overview
8
8
years of professional experience
1
1
Certification
Work History
Senior Software Engineer
Q3 Technologies
Gurugaram
11.2024 - Current
Design and build ETL workflows to extract data from various sources (databases, APIs, flat files, etc.), transform it according to business rules, and load it into the target data warehouse or data lake.
Develop and implement complex ETL processes, ensuring data accuracy, consistency, and timeliness.
Lead a team of ETL developers, providing guidance on technical solutions, troubleshooting, and best practices.
Mentor junior team members and help them grow in their ETL development skills.
Optimize ETL queries and scripts for better performance, particularly in the extraction and transformation stages.
Implement parallel processing and incremental loading where applicable to improve ETL processing time and resource usage.
Data Engineer
Australia RedCross Society
Sydney
03.2022 - 04.2024
Developed pipelines to integrate data sources with Azure storage containers.
Streamlined data transfer process by creating a link between PowerApps and Azure Blob Storage using Azure Synapse.
Configured Azure Data Factory triggers for pipeline execution.
Established alerts in ADF to monitor pipeline failures.
Implemented ETL processes with PySpark.
Implemented data fetching processes using pyspark and Azure storage.
Performed data manipulation within the developed SSIS packages.
Built SQL queries to fetch all the relevant information of the users.
Set up email alerts in SSIS package to inform user and developer that data is delivered.
Create M-Query script to connect Rest API to the power bi and fetch the data into the Power Bi data model.
ETL Developer
R1RCM Pvt limited
Noida
06.2019 - 02.2020
Created SSIS package for loading the data and used multiple transformations in SSIS to extract data from various sources.
Prepare status reports and performance metrics related to ETL jobs for management and stakeholders.
Optimize complex sql quries and refine schema of the existing database
Works with large datasets in various formats, integrity/QA checks, and reconciliation for accounting systems.
Optimize ETL queries and scripts for better performance, particularly in the extraction and transformation stages.
Monitor ETL processes to ensure they are running smoothly and on time.
SQL Developer
Conduent Business service LLP
Noida
08.2018 - 06.2019
Created SQL Server objects such as tables, views, stored procedures, functions, and triggers.
Designed Logical and Physical models of Relational Database.
Created indexes and views, stored procedures to enhance database/application performance.
Created stored procedures to extract data and stored in the data warehouse.
Involved in Performance Optimization of Queries & Stored Procedures by analyzing Query Plans, blocking queries, Identifying missing indexes etc.
Monitored query using query analyzer and tuned queries and procedures to boost database performance.
Business Technology Analyst
Technodata analytics services Pvt limited
Noida
02.2017 - 08.2018
Designed and developed (ETL) packages to perform extract, transform and load data from different sources.
Build SSIS packages to match users' information and then extract their primary information and secondary information from the system.
Proposed solutions to improve efficiency and reduce expenses. Applied transformation rules to change the data types of the fields.
Configured Send Mail Task in SSIS to send email during failure using SMTP Connection Manager.
Configure FTP task component to collect the data from shared file location and provide the latest file to the stakeholder.
Created stored procedures, user defined functions, views, and TSQL scripts for implementing business logic.
Analysed Data Base and Data Warehouse for optimal performance by creating appropriate indexing strategies, partitions, and SQL code optimization.
Use Zappysys component in the SSIS to connect SSIS to the rest api.
Education
Master of Science - Data Science
Macquarie University
Sydney, NSW
12.2021
Bachelor of Technology - Information Technology
Guru Gobind Singh Indraprastha University
Delhi, India
06.2016
Skills
TSQL
Python
Pyspark
Machine learning
JIRA
Agile
GitHub
Data warehousing
ETL Development
Data analysis
Data Architect
Data Modelling
SQL Server Integeration Service
Certification
Certified application development, IBM hackethon, 2020
Github
https://github.com/NSoni25
Linkedin
https://www.linkedin.com/in/nakul-soni-5a7420bb/
Timeline
Senior Software Engineer
Q3 Technologies
11.2024 - Current
Data Engineer
Australia RedCross Society
03.2022 - 04.2024
ETL Developer
R1RCM Pvt limited
06.2019 - 02.2020
SQL Developer
Conduent Business service LLP
08.2018 - 06.2019
Business Technology Analyst
Technodata analytics services Pvt limited
02.2017 - 08.2018
Master of Science - Data Science
Macquarie University
Bachelor of Technology - Information Technology
Guru Gobind Singh Indraprastha University
Similar Profiles
Sandip VishwakarmaSandip Vishwakarma
Test Automation Engineer at Q3 TECHNOLOGIESTest Automation Engineer at Q3 TECHNOLOGIES