Santhosh Uttarapally
Hyderabad
Summary
Accomplished Principal Consultant with proven expertise in big data solutions and ETL design. Skilled in Pyspark and cloud technologies, driving impactful data processing applications for enhanced analytics.
Overview
18
18
years of professional experience
Work History
Principal Consultant
Genpact India Pvt Ltd
Hyderabad
12.2013 - Current
- Developed data processing applications using Apache Spark for large-scale data analysis.
- Implemented ETL processes using tools like Apache Spark and SQL (Databricks, Snowflake).
- Collaborated with the team to design efficient ETL processes for loading data from various sources into the Hadoop ecosystem.
- Integrated Kafka with Spark Streaming for real-time analytics on streaming data sets.
- Developed Python scripts for extracting data from web services API's and loading into databases.
- Managed version control and deployment of data applications using Git, Docker, and Jenkins.
- Configured and maintained cloud-based data infrastructure on platforms like AWS and Azure to enhance data storage and computation capabilities.
- Integrated third party APIs with existing systems using SQS queues and SNS topics.
- Managed Data Lake architecture based on Apache Parquet files stored in S3 buckets, and queried via Databricks.
- Collaborated with data scientists and analysts to understand data needs and implement appropriate data models and structures.
- Implemented and optimized big data storage solutions, including Hadoop and NoSQL databases (Elasticsearch, MongoDB), to improve data accessibility and efficiency.
- Streamlined data flow from diverse sources using ETL tools, such as Control-M and Airflow.
Software Engineer
Symbiotic Pvt Ltd
Bangalore
02.2011 - 11.2013
- Developed software features using Python programming language and shell scripting.
- Developed and maintained scalable software applications for various platforms.
- Configured and maintained Linux servers for enterprise applications and services.
- Installed, configured and maintained web servers with scripting languages like PHP and Perl.
Software Engineer
Pyro Networks Pvt Ltd
Hyderabad
02.2010 - 03.2011
- Developed Python scripts to automate data processing tasks.
- Optimized database queries using SQLAlchemy ORM library.
- Collaborated with developers to deploy applications in Linux environments.
- Installed and configured Linux operating systems on physical, virtual, and cloud environments.
Associate Software Engineer
Onmobile Global Ltd
Bangalore
01.2008 - 02.2010
- Developed software solutions using PHP, Perl, for client projects.
- Implemented unit tests to improve code reliability and maintainability.
- Implemented code changes according to user requirements.
- Monitored equipment function to verify conformance with specifications.
Education
B-tech -
Vignan Institute Of Technology And Science
Hyderabad05-2007
Skills
- Big data solutions
- ETL design
- Pyspark
- Databricks
- Kafka
- Snowflake
- MongoDB
- Databricks
- AWS
- Azure
Accomplishments
- I got the best performer in 2023
Timeline
Principal Consultant
Genpact India Pvt Ltd
12.2013 - Current
Software Engineer
Symbiotic Pvt Ltd
02.2011 - 11.2013
Software Engineer
Pyro Networks Pvt Ltd
02.2010 - 03.2011
Associate Software Engineer
Onmobile Global Ltd
01.2008 - 02.2010
B-tech -
Vignan Institute Of Technology And Science