Sudheer Kumar Ponnana

• Experience in Perform Design, Development & Deployment using Azure Services ( Data Factory, Azure Data Lake Storage, Databricks, PySpark, SQL)
• Demonstrated in depth skills with Azure Data Factory, Azure Databricks, PySpark, ADLS (must have) with the ability to configure and administrate all aspects of Azure SQL DB.
• Experience in create the Technical Specification Design, Application Interface Design.
• Develop batch processing, streaming and integration solutions and process Structured and Non-Structured Data.
• Deep understanding of the operational dependencies of applications, networks, systems, security and policy (both on premise and in the cloud; VMs, Networking, VPN (Express Route), Active Directory, Storage (Blob, etc.).
• 
  
• 
  

o Developing Spark applications using Spark-SQL in Azure Databricks for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.

o Migrating SQL Database to Azure data lake, Azure SQL database, Databricks and controlling and granting database access and migrating On-premises databases to Azure data lake store using Azure data factory.

o Analyzed the SQL scripts and designed it by using PySpark SQL for faster performance.

o Used Python for SQL/CRUD operations in DB, file extraction/transformation/generation.

o Database design and development with Business Intelligence using Integration Services (SSIS).

o Processed Data into HDFS by developing solutions, analyzed the Data using MapReduce

o Developed spark applications in python (PySpark) on distributed environment to load huge number of CSV files with different schema in to blob storage.

o Used SQL explain plan in Query, SQL Developer to fine tune the SQL codes which were used to extract the data in database stages.

§ Build Machine Learning Algorithms using PySpark to predict the estimation time for machine failure/maintenance.

§ Create model and run in AWS and Azure cloud to get real time dashboard alerts.

§ Provide alert to PLC devices when the device having any issue like high temperature/pressure, running abnormal condition using PySpark in Databricks.

§ Based on model outcome the action should be take care by Azure gateway device.

§ Read Source data from IoT devices Json data using Kafka ingestion and make computation using PySpark.

§ Aggregation results ingest to another Kafka streaming and store in Redis Storage.

§ Connect Kafka to Web socket component to provide web socket response for real time streaming.

· Provide alerts to mobile when two persons distance is less than 6 feet using Azure cloud.

· Generate unique key in mobile for every 24 hrs. through Bluetooth.

· Gets person details based on mobile key through API management in Azure to Logic app.

· Logic app will check the scenarios when anyone gets affected by covid positive it'll will generate message to nearest surrounded people through mobile notification.

· Also save the details in data lake storage for monitor reports.

· Read data from ADLS and make computation various logics like count and severity of cases using PySpark.

· Provide All information with lambda architecture in Power BI to get history and current data on same screen.

· Used Spark API over Hortonworks Hadoop YARN to perform analytics on data in Hive.

· Migrated data from multiple source systems such as DB2, SQL Server and Oracle to Hadoop distributed file system for data analysis.

· Processed data into HDFS by developing solutions, analyzed the data using MapReduce, Pig, Hive, and produce summary results from Hadoop to downstream systems.

· Involved in the development of real-time interactive dashboards using Tableau.