Summary
Overview
Work History
Education
Skills
Websites
Certification
Selectedprojects
Personal Information
Timeline
Generic

Pradeep Guled

Bangalore

Summary

Software Engineer with extensive experience in Big Data Engineering at Glassbeam Inc. Proficient in developing scalable data solutions using Python, Java, and Scala, and managing databases and data warehouses such as SQL, Vertica, Cassandra, and Snowflake. Experienced with Hadoop, HDFS, Apache Spark (PySpark), and Kafka for real-time processing. Skilled in workflow orchestration with Airflow and cloud solutions using Docker, Azure Databricks, and AWS. Leveraged SPL for data extraction and contributed to ETL processes and data visualization with Tableau and Logi. Dedicated to driving business insights and enhancing operational efficiency.

Overview

3
3
years of professional experience
1
1
Certification

Work History

Software Engineer

Glassbeam, Inc.
01.2022 - Current
  • Developed scalable data solutions, enhancing processing and storage efficiency, and reduced manual work by 65% using Python, Java, and Scala applications.
  • Managed databases such as SQL, Vertica, Cassandra, and Snowflake, ensuring high data integrity and performance.
  • Advanced real-time data processing with Apache Spark (PySpark), Kafka, and Azure Databricks, and automated workflows with Apache Airflow, cutting manual intervention by 70%.
  • Delivered cloud-based solutions with Docker, Azure, and AWS, optimizing ETL processes and resource management.
  • Optimized ETL processes for accurate data transformation and timely loading, utilizing SPL for efficient data extraction and preprocessing.
  • Created actionable visualizations with Tableau and Logi, supporting data-driven decision-making for CLInsights and daily reports.

Intern

Verzeo Edutech
07.2021 - 12.2021

As an Intern, Gained foundational experience in data analysis and programming. During this internship, I focused on learning and applying basic skills in Python and SQL to support data-driven projects and tasks.

Education

Bachelor of Engineering in Information Science and Engineering -

Basaveshwar Engineering College
Bagalkote, Karnataka
01.2021

Skills

  • Programming Languages: Python, Java, Scala
  • ETL Tools: PySpark, Apache Kafka
  • Cloud Solutions: AWS, Azure (including Azure Databricks)
  • Databases/Data Warehousing: SQL, Snowflake, Vertica, Cassandra
  • Big Data Technologies: Hadoop, HDFS
  • Workflow Orchestration: Apache Airflow
  • Data Visualization: Tableau, Logi
  • Devops: Docker, jenkins

Websites

Certification

  • Linux and Bash Scripting, Coursera, 05/2022
  • Big Data with Hadoop and Spark, CloudX Lab, 04/2024
  • Apache Spark with Databricks for Data Engineers, DataVidya, 08/2024

Selectedprojects

  • Independently developed an ETL (Extract, Transform, Load) automation system for performance testing of Tableau dashboards. The project involved using TabJolt for performance testing, AWS S3 for log storage, Python for data extraction and transformation, Vertica for data warehousing, and Matplotlib for performance trend reporting. Implemented automated email notifications for performance deviations.

     Technologies: Python, TabJolt, AWS S3, Vertica, Matplotlib, SQL

     Link: https://github.com/Pradeepguled/Tableau-Dashboard-Performance-ETL-Automation



  • Architected and implemented a scalable data pipeline to automate the ingestion, processing, and transformation of Spotify playlist data : The project involved using AWS Lambda for data retrieval, Apache Spark on AWS Glue for data processing, and AWS S3 for data storage. Developed scripts to extract and transform detailed information about albums, artists, and songs from raw JSON data, and automated the entire process for efficient data management.

     Technologies Used : AWS Lambda, Apache Spark (PySpark), AWS Glue, AWS S3, Python,Snowflake


Personal Information

Title: Software Engineer

Timeline

Software Engineer

Glassbeam, Inc.
01.2022 - Current

Intern

Verzeo Edutech
07.2021 - 12.2021

Bachelor of Engineering in Information Science and Engineering -

Basaveshwar Engineering College

Similar Profiles

CREATE PROFILE
Pradeep Guled