Chandu Sikhapalli
Hyderabad
Summary
Highly skilled and results-driven Data Engineer with one year of hands-on experience in designing and implementing robust data pipelines. Proficient in utilizing Python, AWS, SQL, and BigQuery to extract, transform, and load (ETL) large datasets for analysis. Adept at optimizing data architecture for efficiency and scalability, ensuring seamless integration across diverse systems. Seeking a challenging role to leverage expertise in data engineering, contribute to innovative projects, and drive actionable insights through advanced analytics.
Overview
1
1
year of professional experience
Work History
Data Engineer
Nexgile Technologies
Hyderabad
12.2022 - Current
- Led the migration from Google Cloud Bigquery to AWS S3 using AWS Glue and Cron Job, resulting in an annual cost saving and an increase in performance of 14%.
- Designed the data pipeline architecture for a new product that quickly scaled from 0 to 125,000 daily active users.
- Maintained data pipeline up-time of 99.8% while ingesting streaming and transactional data across 8 different primary data sources using Athena,S3, and Python.
- Automated ETL processes across billions of rows of data, which reduced manual workload by 29% monthly.
- Worked with client to understand business needs and translate those business needs into actionable reports.
- Supported implementation and active monitoring of controls and programs for precision and efficacy.
- Ingested data from disparate data sources using a combination of SQL, Hubspot API,Restful APIs using Python to create data views to be used in BI tools like Tableau.
- Communicated with project managers and analysts about data pipelines that drove efficiency KPIs up by 26%.
Data Engineer/Data Science Python Developer
Nexgile Technologies
Hyderabad
12.2022 - Current
- Companies tagging/Data Extraction using OpenAI GPT API:
- Utilized OpenAI GPT API to design and implement automated processes for extracting relevant data from diverse sources.
- Developed effective prompts and chat interactions to interact with the API, ensuring accurate and targeted extraction of company-related information.
- Applied natural language processing techniques to refine and enhance the accuracy of extracted data, demonstrating a deep understanding of linguistic nuances.
- Employed scripting languages, such as Python, to automate data extraction workflows, significantly reducing manual effort and improving efficiency.
- Clearly communicated technical details and findings to non-technical stakeholders, fostering understanding and alignment on data extraction strategies.
- Designed and implemented a serverless architecture using AWS Lambda and API Gateway to efficiently trigger data extraction processes in response to API calls.
- Developed Lambda functions to automatically tag extracted companies based on predefined criteria and seamlessly integrate the information into the organization's database.
- Implemented real-time data processing capabilities by utilizing AWS Lambda, ensuring that extracted company data is promptly tagged and stored in the database upon API invocation.
- Leveraged AWS Lambda's scalability to handle varying workloads, ensuring optimal performance and cost-effectiveness in processing large volumes of company data.
- Configured API Gateway to manage and secure incoming API requests, providing a streamlined interface for developers to trigger data extraction processes.
- Optimized database performance by efficiently tagging and organizing extracted company data, enhancing search capabilities and overall data accessibility.
- Orchestrated the secure storage of tagged company data in AWS S3.
- Collaborated closely with development teams to understand API requirements and ensure seamless integration with AWS services, fostering effective communication and cross-functional alignment.
- Created detailed documentation for the implemented architecture, Lambda functions, and API Gateway configuration, facilitating knowledge sharing and onboarding for team members.
Education
B Tech - Chemical Engineering
Rvr And Jc College of Engineering
Chowdavaram,Guntur05-2022
Intermediate - MPC
Jaggaiahpet Junior College
Jaggaiahpet 04-2018
Skills
- Python,Java, Javascript
- HTML, CSS, React JS, Bootstrap
- VS-Code,Postman
- Jira
- MSSQL,MYSQL
- AWS S3(Simple Storage Service), AWS Lambda, AWS Glue, AWS Athena, Google Cloud Bigquery
Projects
Analysis the user's movement in website's
- The main aim of the project is to increase the sales of the articles which are posted on the website, And analyze the data and gave insights to the investors to increase the sales of articles
- To consolidate the data in AWS, we have moved whole data to the AWS from GCP by creating pipelines using python. And worked on partitions of tables to reduce the cost of querying in the AWS as well as GCP.
Warehouse Management System
- This project is a warehouse management software for e-commerce.Users can keep track of warehouse inventory
- Hands-on experience using ASP.NET Core(WebAPI) to build backend.
- Technologies used : React js, Bootstrap,ASP.NET Core(WebAPI).
Timeline
Data Engineer
Nexgile Technologies
12.2022 - Current
Data Engineer/Data Science Python Developer
Nexgile Technologies
12.2022 - Current
B Tech - Chemical Engineering
Rvr And Jc College of Engineering
Intermediate - MPC
Jaggaiahpet Junior College
Similar Profiles
Dhana Venkata Siva Sai KondapalliDhana Venkata Siva Sai Kondapalli
Senior HR Executive at Nexgile Technologies Pvt LtdSenior HR Executive at Nexgile Technologies Pvt Ltd
Venkata Nagaraju InakolluVenkata Nagaraju Inakollu
Technical Lead(System Design) at Relysys Technologies Pvt Ltd (now Invendis Technologies pvt ltd)Technical Lead(System Design) at Relysys Technologies Pvt Ltd (now Invendis Technologies pvt ltd)
Sachin HatoleSachin Hatole
Quality Analyst at Mindpool Technologies Pune, Mindpool TechnologiesQuality Analyst at Mindpool Technologies Pune, Mindpool Technologies