Summary
Overview
Work History
Education
Skills
Disclaimer
Languages
Personal Information
Certification
Affiliations
Timeline
Generic

Prem Sagar

Bengaluru

Summary

14+ Year experience in IT having exposure as Senior Cloud Data Engineer/Architect with extensive experience in multiple technology, specializing in GCP and Azure cloud infrastructures. Proven track record in leveraging Python and SQL for data migration and analytics. Adept at collaborating with cross-functional teams to drive project success, ensuring high-quality deliverables and compliance with industry standards.

Overview

15
15
years of professional experience
1
1
Certification

Work History

Sr. Cloud Data Engg/Architect

TATA Consultancy Services
Bengaluru
01.2023 - Current
  • Project#1:The Marketing Data Platform(MDP) is a centralized system designed to integrate ,manage and analyze marketing data across all the Line of Business(LOBs), it enables consolidates Marketing Data from multiple sources, including digital media platforms, campaign performance metrics it also facilitate advanced segmentation, automates and optimizes campaign execution
  • Technology: Databricks ,Delta Table, MySQL Database, Azure Data Factory(ADF),SQL,Python,Power BI
  • Role and Responsibility:Exported data from on-prem SFTP server to Azure cloud storage using ADF pipeline.
  • Curated and cleaned raw data using a Databricks notebook and stored it into the L1/L2/L3 Tables.
  • Connected to multiple SORs and fetched the records as per the customer's needs, and created and developed the code and dataset as per the new/re-enrollment campaign.
  • Incorporate real time changes and fetch the records from adhoc files changes and integrated into datamodel.
  • Created databricks worflow jobs and schduled to store the output results into Databricks DELTA table and SQL Database as per the business need.
  • Cleaned and Aggregated tables further integrated into downstream process as per business need.
  • Integreted Databricks DELTA Tables and SQL tables with Analytcs tool Power BI.
  • Leveraged Agile methodologies to move development lifecycle rapidly through initial prototyping to enterprise-quality testing and final implementation.
  • Created blueprints, drawings and detailed schematics of proposed structures.
  • Ensured compliance with safety regulations during all phases of design work.
  • Project#2: To leverage GEN AI Capabilities and build a retrieval –based architectures, embedded & chunked the existing knowledge database information and store the chunked data into in memory with high available Google Kubernetes engine and serving scalable traffic, the solution would get the user with additional AI cosign similarity search capability incorporated with hugging face miniLLM and gives relevant top three search results.
  • Technology: Google Cloud Storage, GKE, Hugging Face, FAISS, Python, SSO, Cloud SQL.
  • Roles and Responsibilities: Exported data from the on-premises database and placed the HTML files into the local file share.
  • Transfer the local file into landing Google cloud storage using file transfer Hub.
  • Using Custom python script convert the html file into CSV format over GKE.
  • Preprocessing of data text/csv files converted into embedded & chunked using embedding model (hugging face).
  • FAISS indexed file stored into cloud storage to serve the user request in GKE.
  • User interface integrated with SSO for authentication and authorization for users.
  • Feedback from the users via Q&A stored into Cloud SQL for service improvement.
  • Project#3: Large chunk of Hive data table migration from on-prem to Google BigQuery of banking client which hold multiple on-prem sources data.
  • Technology: Cloud Storage, Distcp, Dataproc, checksum, BigQuery, Cloud composure.
  • Roles and Responsibility: Transfer on-prem data into GCS data lake using storage transfer services.
  • Orchestrate and triggers pyspark jobs using cloud composure.
  • Scheduled Transformation jobs run on dataproc cluster.
  • Load the data into BigQuery for data curated and cleans.
  • Researched building codes and regulations to ensure compliance in designs.
  • Facilitated client meetings to gather requirements and refine project goals.
  • Developed plans and specifications for building projects to meet the needs of clients.
  • Inspected existing structures in order to identify design issues or areas that need improvement.
  • Prepared cost estimates for materials needed in construction projects.

Infra Technology Specialist

Cognizant Technology
08.2019 - 12.2022
  • Experience in Azure/GCP PaaS/IaaS Cloud Services, effectively communicating concerns, issues to team members & client on time.
  • Migration of on-prem Data into Google cloud using Native tools.
  • Experience in migration of on premises ETLs to Google Cloud platform using cloud native tool BigQuery, Dataflow, Cloud Storage.
  • Evaluating data to establish its value and quality for ML model.
  • Statistical data analysis using SPSS tool to get insight data distributions for ML model.
  • Managed CI/CD pipeline using Azure DevOps tool.
  • Managed and deployments of Micro services using Google Kubernet Engine.
  • Creation of azure automation account and integrate with run book via Python/Power shell.
  • Data preparation and data wrangling using DataPrep.
  • Management and configuration of azure Logic apps services.
  • Assessments and analysis of vulnerability scan of the GCP/Azure services.
  • Life cycle management of azure storage account/GCP Bucket.
  • Apps service certificate renewal and key vault management.
  • Configurations and monitoring azure/GCP services through Native Monitoring Mechanism.
  • Increase/decrease pricing model DTU/vCore of azure SQL databases.
  • Restoration /Refresh/Creation azure SQL/MySQL/Maria databases.
  • Backup configuration and movement into elastic pool group database.
  • Restart the web apps services once reached threshold alert limit value.
  • Configurations of scale out/scale in rules as per business requirement.
  • IP whitelisting in web apps services and firewall configuration.
  • Creation and custom domain verification for auto apps certificate renewal.
  • Upsize/downsize pricing tier for azure synapse and SQL databases.
  • Management and monitoring for SendGrid services.
  • Performance tuning for azure/GCP SQL databases services.
  • Migration of azure data factory with their connections.
  • Pulling web apps services logs and analyzed from application insight tool.
  • Configuration and management of AWS Lambda functions.
  • Creation and monitoring of SQS/SNS AWS PaaS services.
  • Design Architectures and update for cloud PaaS services as per requirement.
  • Preparation of HLD /LLD /Run book/KB and updating time to time.
  • Off boarding/Onboarding /Decommissions of cloud PaaS resources.
  • Creating KT plan for new services and Providing to all concern Team and clients.

Senior Operations Professional

IBM India Pvt. Ltd.
07.2015 - 08.2019
  • Experience in several database management and ETL projects.
  • Experience in Google cloud and BigQuery.
  • Data preparations using Google cloud Dataprep.
  • Worked in moving data between GCP and Azure using Azure Data factory.
  • Exporting RDMS data into HDFS and Hive using SQOOP tool.
  • Statistical analysis using SPSS tool.
  • Ingestion data into HDFS from multiple sources and analyzed using Hive.
  • Expansion of IP address rage of azure subnets/GCP subnets.
  • Disaster recovery drills for cloud SQL databases.
  • Management of azure resources and subscriptions.
  • Creations of azure automation and schooled jobs.
  • Management of roles /IAM policy for GCP/Azure services.
  • Analysis of Google project billing cost and resources.
  • Configurations and management of Azure SQL/Mysql/Maria databases.
  • Create custom scripts to automate through azure automation account and monitor and resume/Pause of the SQL resources.
  • Use application insight tool and write a simple KQL query to create Dashboard.
  • Configuring long/short-term retentions archival storage to maintain corporate compliance.
  • Apply and manage tagging on azure resources for billing cost.
  • Performed backup and restore operations by using Azure Backup.
  • Configure and use GCP Monitor for Networks resources metrics.
  • Configure scale in/out settings in an App Service plan for apps services.
  • Co-ordination with Vendor and clients to understand the requirement and achieve it.

Oracle DBA/Admin

PureSoftware Pvt. Ltd.
11.2013 - 05.2015
  • Creating and maintaining logins, synonyms and access privileges using roles, controlling access to the database using operating system and Oracle security features.
  • Performance tuning of the production database towards optimal performance based on the changes in the database storage structures due to application change requirements.
  • Monitoring and optimizing the performance of the Database through Database Tuning – Tuning Applications, Tuning Memory, Tuning Disk Usage, Tuning OS.
  • Installation and configuration of Oracle and application databases on Unix Operating System.
  • Reorganization of table and rebuild indices.
  • Configuration of RMAN backup with database backup policy.
  • Configuration and Managed oracle standby databases.
  • Configure and managed replication of heterogeneous database via Oracle Golden Gate.
  • Configure and managed multi nodes Oracle RAC Environment of database.
  • Analysis prerequisites and apply quarterly releases oracle databases patches and bug fixes.
  • Creating shell script programs as per requirement of Database Monitoring.
  • Oracle Database Administration including planning/implementing backup/recovery strategies using RMAN and without RMAN.
  • Managed Oracle ERP databases and managed front end role responsibility.
  • Manual Cloning/Refreshing of Oracle Databases as per business requirement.
  • Setting permissions, Commissioning, Decommissioning, Balancing, and Managing Databases Nodes.
  • Initiated consulting and collaboration meetings with other departments to provide better service and improve SLA’s.

Technical Specialist(L2)

iYogi Technical Service Pvt. Ltd.
01.2010 - 05.2013
  • Installation and Configuration of Oracle Database 10g/11g and 10g on Linux platform.
  • Implement the automated Hot Backup scripts for the Daily full backup created in Bash Shell.
  • Implementing and maintaining database security (create and maintain users, roles and assign privileges).
  • Managed appropriate use of frees pace within tables paces, reclaimed space whenever possible.
  • Reorganized tables and indexes within databases when needed.
  • Monitored the production Oracle alert logs for database errors and system resource availability and responded to system memory and data issues.
  • Managing the Data files and the Table spaces.
  • Performing export/import for database restoration.
  • Perform ongoing performance tuning and resource optimization as required.
  • Configure CPU, memory, and disk partitions as required.
  • Cloning database using hot and cold backup.
  • Maintained the database in Archive log mode in different destinations.
  • Applied crontab to get scheduled the maintenance jobs.
  • Performance issues of database.
  • Configured Selinux and IPTABLES policy.
  • Managed Linux /DB file system.

Education

B.Tech - IT

UIET
Kanpur, India
06-2009

Skills

  • GCP/Azure Cloud PaaS Infrastructures
  • Databrcks DevOps/Azure DevOps
  • Python,SQL Query,KQL
  • Azure Monitor,Google Cloud operation
  • Cloud SQL, MySQL, Oracle DB, BigQuery,Cloud Storage account
  • PowerShell, Shell Scripting
  • Linux and Windows, Solaris
  • Kanban board,Jira Ticket
  • Git/Github,Notebook,Cloud Scheduler,Dataflow

Disclaimer

I hereby declare that the information given by me is true.

Languages

  • English
  • Hindi
  • Kannad

Personal Information

  • Father's Name: Brij Bihari
  • Gender: Male
  • Marital Status: Married

Certification

Microsoft Certified Azure Administrator Certification (AZ-104)

Microsoft Certified DevOps Engineer Expert (AZ-400)

Microsoft Certified Azure Solutions Architect Expert (AZ-305)

Certified Google Cloud Professional Cloud Architect (PCA)

Certified Google Cloud Associate cloud Engineer (ACE)

Certified Google Cloud Professional Data Engineer

Linux RHCE certified # 130-155-864

Affiliations

  • Cognizant Star Performer Award Q4 2021
  • TCS Contextual Master (CM)

Timeline

Sr. Cloud Data Engg/Architect

TATA Consultancy Services
01.2023 - Current

Infra Technology Specialist

Cognizant Technology
08.2019 - 12.2022

Senior Operations Professional

IBM India Pvt. Ltd.
07.2015 - 08.2019

Oracle DBA/Admin

PureSoftware Pvt. Ltd.
11.2013 - 05.2015

Technical Specialist(L2)

iYogi Technical Service Pvt. Ltd.
01.2010 - 05.2013

B.Tech - IT

UIET

Similar Profiles

  • Vrunda Chindhade

    Vrunda ChindhadeVrunda Chindhade

    HR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services LimitedHR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services Limited

  • Sreya Basu

    Sreya BasuSreya Basu

    Procare Analyst at Tata Steel(Tata Consultancy Services)Procare Analyst at Tata Steel(Tata Consultancy Services)

  • Arun V

    Arun VArun V

    Program Manager at Tata consultancy services | Financial Ombudsman ServicesProgram Manager at Tata consultancy services | Financial Ombudsman Services

  • Naimish Agnihotri

    Naimish AgnihotriNaimish Agnihotri

    Assistant Delivery Manager at Tata Consultancy Services, Global Shared ServicesAssistant Delivery Manager at Tata Consultancy Services, Global Shared Services

  • Sabir Pasha

    Sabir PashaSabir Pasha

    Senior Technical Solutions Engineer at BARRACUDA NETWORKSSenior Technical Solutions Engineer at BARRACUDA NETWORKS

CREATE PROFILE
Prem Sagar