Summary
Overview
Work History
Education
Skills
Disclaimer
Contact
Timeline
Generic

SANDOPU VENKAT NARASIMHULU

Hyderabad

Summary

6+ plus years of experience as data engineer in BFSI Domain. Currently working in HSBC as a Lead Data Engineer. Completed Google Associate Cloud Engineer certification. Looking for opportunities in Data Engineering. Ready to learn and upskill to any new Technologies.

Overview

8
8
years of professional experience

Work History

Consultant Specialist

HSBC Software Development Centre
Hyderabad
10.2022 - Current
  • Working on development of Data Assets using pyspark and scala.
  • Worked on managing end to end pipeline using airflow.
  • Managed Databases and tables in hive and storing data in hdfs.
  • Worked on development of scripts in python and shell for building each and individual stages in pipeline.
  • Managing Data using GCP Bigquery and applying the required queries and optimizing query cost.
  • Worked on various AWS services like Redshift, Glue, S3.
  • Worked on Azure Databricks, Blob Storage, ADF, Azure Synapse.
  • Deploying of models in CDP12 Environment and GCP.
  • Version control using Git and Jenkins as CICD for deployments.
  • Experience on working with DBT and SaaS.
  • Worked on different file formats including parquet, csv, delta and formats.
  • Worked on spark streaming to handle streaming data dynamically and apply transformations using spark streaming and generate data using kafka messaging system.
  • The Hongkong and Shanghai Banking Corporation is a British universal bank and financial services group headquartered in London, England, with historical and business links to east Asia and a multinational footprint.
  • Skills Used: Pyspark, Scala, Pandas, Python, Kafka, Git, SQL, Shell scripting, AWS, Azure Databricks, GCP Bigquery, Dataproc, Dataflow, composer, Pub/sub, AWS Redshift, S3, Lambda, Databricks, DBT, Spark Streaming.

Senior Systems Engineer

Tata Consultancy Services
Hyderabad
08.2018 - 10.2022
  • Working on implementation of scoring models for credit rating system.
  • Worked on development of attributes and deploy them on to online platforms.
  • Develop metadata for models and worked on issues related to existing models.
  • Worked on implementation of a2putils models.
  • Deploying of models in GCP environment. Working with storage buckets.
  • Worked on Kubernetes clusters, pods management.
  • Skills Used: GCP Bigquery, GCS, Python, SQL, Git, Shell scripting.

Systems Engineer

Advanced Micro Devices
Hyderabad
06.2018 - 10.2020
  • Manage and support Linux servers.
  • Write shell scripts to make tasks easier.
  • Use python to create automations where ever possible.
  • Advanced Micro Devices, Inc. (AMD) is an American multinational semiconductor company based in California that develops computer processors and related technologies for business and consumer markets.
  • Skills Used: Linux, Shell scripting, Python, SQL.

Education

B.Tech - CSE

Gokaraju Rangaraju Institute of Engineering and Technology
Telangana
05.2018

Intermediate -

Narayana junior College
Andhra Pradesh
05.2014

X class -

Brilliant Grammar high School
Andhra Pradesh
05.2012

Skills

  • Pyspark
  • Scala
  • Pandas
  • Python
  • Airflow
  • Git
  • SQL
  • Shell scripting
  • AWS service like S3
  • Glue
  • Lambda
  • Redshift
  • Azure Databricks
  • Azure Data Lake Gen2
  • Delta Lake
  • GCP services like GCS
  • BigQuery
  • Dataflow
  • Composer
  • DataProc
  • CDP (Cloud Era Data platform)
  • Kafka
  • Spark Streaming
  • BigQuery
  • Dataflow
  • Composer
  • DataProc
  • CDP (Cloudera Data platform)
  • Kafka
  • Spark Streaming

Disclaimer

I hereby declare that all the information mentioned above are true and correct to the best of my knowledge.

Contact

+91 9063482449, +91 8184862449

Timeline

Consultant Specialist

HSBC Software Development Centre
10.2022 - Current

Senior Systems Engineer

Tata Consultancy Services
08.2018 - 10.2022

Systems Engineer

Advanced Micro Devices
06.2018 - 10.2020

B.Tech - CSE

Gokaraju Rangaraju Institute of Engineering and Technology

Intermediate -

Narayana junior College

X class -

Brilliant Grammar high School
SANDOPU VENKAT NARASIMHULU