Nanda Kishore Peravali
Bengaluru
Summary
Lead Data Engineer specialized in building large scale data lake pipelines using Spark, Hadoop, Hive and Data migration to cloud, Helping the world's greatest companies solve their data science and machine learning challenges.
Overview
11
11
years of professional experience
1
1
Certification
Work History
Senior Spark Technical Solutions Engineer
Databricks
11.2022 - Current
- Data Engineer specialised in building large-scale data lake pipelines using Spark and Scala
- Helping the world's greatest companies solve their data science and integration challenges.
Project Lead Developer
Standard Chartered Bank
02.2019 - 03.2023
- A Datamart & machine learning application which leverages Big Data capabilities
- Mixture of machine learning technologies and Hadoop-Big Data technologies such as Hive, pyspark, spark & Dataiku are used for application development which enables the system to handle large datasets for FCC users to use data for Legal and compliance related cases.
Technical Team Lead
BNY Mellon
08.2015 - 02.2019
- Worked as Technical lead for Hadoop conversion project, where I got chance to excel in all latest Hadoop tools and industry best class architecture design
- The core part of all financial related data migration from Mainframe to Hadoop By conversion of data, and transmitting and storing in Hive/HBase and provide required data access to Business Users through BI Tools.
Software Engineer
DXC Technology
10.2012 - 08.2015
- Designed high level project plan for FSQ, which is migrating all application & reporting data from Mainframe to Hadoop
- Involved in analysis, designing, coding and testing of all components related to this Mainframe to Hadoop Migration.
Education
Bachelor of Engineering (BE) - Electrical and Electronics Engineering
Anna University
01.2012
Skills
- Hadoop
- Apache Spark
- Big Data
- Hive
- Software Development
- Shell Scripting
- Hdfs
- Scala
- Dataiku
- MapReduce
Certification
- Hadoop Fundamentals - Lynda.com, 07/01/16, 07/01/16, 4F65A7
- Transitioning from Data Warehousing to Big Data - Lynda.com, 07/01/16, 07/01/16, 328EC1
Timeline
Senior Spark Technical Solutions Engineer
Databricks
11.2022 - Current
Project Lead Developer
Standard Chartered Bank
02.2019 - 03.2023
Technical Team Lead
BNY Mellon
08.2015 - 02.2019
Software Engineer
DXC Technology
10.2012 - 08.2015
Bachelor of Engineering (BE) - Electrical and Electronics Engineering
Anna University
Similar Profiles
Shaun R. StoverShaun R. Stover
Manager, Technical Enablement at DatabricksManager, Technical Enablement at Databricks
Brian SanyaoluBrian Sanyaolu
AWS Govcloud Incident Support Engineer at DatabricksAWS Govcloud Incident Support Engineer at Databricks
June TanJune Tan
Senior Marketing Manager at DatabricksSenior Marketing Manager at Databricks