
Data & DevOps Engineer with expertise in Azure, Pyspark and Jenkins, successfully enhanced deployment processes at Citicorp Services India. Proven ability to foster collaboration across teams, streamline CI/CD pipelines, and implement data integration solutions. Adept at leveraging Pyspark and GIT for efficient project delivery while maintaining strong communication skills.
Implemented the model to pull the data from different sources and load the same to lower data streams.
Deployed DC, PRB’s from Dev environment to PROD Environment.
Involved in Extractracting,Transforming data and loading clean data to downstream data sources
· Deploying Dev team pushed specified builds to UAT, PT, Training, Preprod & PROD environments thru Jenkins Dashboard.
· Deploying CI/CD system using Azure DevOps on Kubernetes container environment and for runtime environment of CI/CD system to build, test and deployment using docker and Kubernetes.
· Creation of new users, roles & group permissions-based access in GitLab & Jenkins.
· Coordinating with Developers, Testers & Network admin's during deployments issues and checking URL's connectivity after deployment.
· Worked with team for GIT version control to manage source code and integration GIT with Jenkins to support build automation and integrate with jira.
· Configured CI/CD Jenkins to deploy the generated artifacts to QA Environment Severs
· Coordinating the Change Requests from Registration to Close
· Trouble shooting Rational Team Concert issues related to repository & Build level
· Creating Infrastructure IAC using Terraform
· Promoting builds from Dev to UAT & PROD Environments thru RLM & Service Now
· Coordinating DBA & Infra Teams during version Upgrades & Configuring them.
· Coordinating the Change Requests from Registration to Close
Trouble shooting Rational Team Concert issues related to repository & Build level
Pyspark
DP-700