SANDOPU VENKAT NARASIMHULU
Hyderabad
Summary
6+ plus years of experience as data engineer in BFSI Domain. Currently working in HSBC as a Lead Data Engineer. Completed Google Associate Cloud Engineer certification. Looking for opportunities in Data Engineering. Ready to learn and upskill to any new Technologies.
Overview
8
8
years of professional experience
Work History
Consultant Specialist
HSBC Software Development Centre
Hyderabad
10.2022 - Current
- Working on development of Data Assets using pyspark and scala.
- Worked on managing end to end pipeline using airflow.
- Managed Databases and tables in hive and storing data in hdfs.
- Worked on development of scripts in python and shell for building each and individual stages in pipeline.
- Managing Data using GCP Bigquery and applying the required queries and optimizing query cost.
- Worked on various AWS services like Redshift, Glue, S3.
- Worked on Azure Databricks, Blob Storage, ADF, Azure Synapse.
- Deploying of models in CDP12 Environment and GCP.
- Version control using Git and Jenkins as CICD for deployments.
- Experience on working with DBT and SaaS.
- Worked on different file formats including parquet, csv, delta and formats.
- Worked on spark streaming to handle streaming data dynamically and apply transformations using spark streaming and generate data using kafka messaging system.
- The Hongkong and Shanghai Banking Corporation is a British universal bank and financial services group headquartered in London, England, with historical and business links to east Asia and a multinational footprint.
- Skills Used: Pyspark, Scala, Pandas, Python, Kafka, Git, SQL, Shell scripting, AWS, Azure Databricks, GCP Bigquery, Dataproc, Dataflow, composer, Pub/sub, AWS Redshift, S3, Lambda, Databricks, DBT, Spark Streaming.
Senior Systems Engineer
Tata Consultancy Services
Hyderabad
08.2018 - 10.2022
- Working on implementation of scoring models for credit rating system.
- Worked on development of attributes and deploy them on to online platforms.
- Develop metadata for models and worked on issues related to existing models.
- Worked on implementation of a2putils models.
- Deploying of models in GCP environment. Working with storage buckets.
- Worked on Kubernetes clusters, pods management.
- Skills Used: GCP Bigquery, GCS, Python, SQL, Git, Shell scripting.
Systems Engineer
Advanced Micro Devices
Hyderabad
06.2018 - 10.2020
- Manage and support Linux servers.
- Write shell scripts to make tasks easier.
- Use python to create automations where ever possible.
- Advanced Micro Devices, Inc. (AMD) is an American multinational semiconductor company based in California that develops computer processors and related technologies for business and consumer markets.
- Skills Used: Linux, Shell scripting, Python, SQL.
Education
B.Tech - CSE
Gokaraju Rangaraju Institute of Engineering and Technology
Telangana05.2018
Intermediate -
Narayana junior College
Andhra Pradesh05.2014
X class -
Brilliant Grammar high School
Andhra Pradesh05.2012
Skills
- Pyspark
- Scala
- Pandas
- Python
- Airflow
- Git
- SQL
- Shell scripting
- AWS service like S3
- Glue
- Lambda
- Redshift
- Azure Databricks
- Azure Data Lake Gen2
- Delta Lake
- GCP services like GCS
- BigQuery
- Dataflow
- Composer
- DataProc
- CDP (Cloud Era Data platform)
- Kafka
- Spark Streaming
- BigQuery
- Dataflow
- Composer
- DataProc
- CDP (Cloudera Data platform)
- Kafka
- Spark Streaming
Disclaimer
I hereby declare that all the information mentioned above are true and correct to the best of my knowledge.
Contact
+91 9063482449, +91 8184862449
Timeline
Consultant Specialist
HSBC Software Development Centre
10.2022 - Current
Senior Systems Engineer
Tata Consultancy Services
08.2018 - 10.2022
Systems Engineer
Advanced Micro Devices
06.2018 - 10.2020
B.Tech - CSE
Gokaraju Rangaraju Institute of Engineering and Technology
Intermediate -
Narayana junior College
X class -
Brilliant Grammar high School