Aravind R
Associate Data Engineer
Chennai
Summary
Innovative Solution Architect with in-depth understanding of software deployment and system design illustrated over 2 years of experience in similar roles. Excellent communication skills and extensive experience working with clients and partners.
Overview
2
2
years of professional experience
4
4
years of post-secondary education
2
2
Certifications
Work History
Associate Data Engineer & Developer
Kaar Technologies
10.2022 - Current
- Bulk loading from the external stage (AWS S3), internal stage to snowflake cloud using the COPY command.
- Loading data into snowflake tables from the internal stage using snowsql.
- Used COPY, LIST, PUT and GET commands for validating the internal stage files.
- Used import and Export from the internal stage (snowflake) from the external stage (AWS S3).
- Writing complex snowsql scripts in snowflake cloud data warehouse to business analysis and reporting.
- Used FLATTEN table function to produce a lateral view of VARIANT, OBJECT, and ARRAY column.
- Used SNOW PIPE for continuous data ingestion from the S3 bucket.
- Developed snowflake procedures for executing branching and looping
- Created clone objects to maintain zero-copy cloning.
- Data validations have been done through information_schema.
- Performed data quality issue analysis using Snow SQL by building analytical warehouses on Snowflake
- Experience with AWS cloud services: EC2, S3, EMR, RDS, Athena, and Glue
- Cloned Production data for code modifications and testing
- Perform troubleshooting analysis and resolution of critical issues
- Worked with customers or prospective customers to develop integrated solutions and lead detailed architectural dialogues to facilitate delivery of comprehensive solution.
- Guided and influenced existing partners on recommended upgrades and enhancements to integrated solutions.
- Conducted research to evaluate systems design and process efficiency.
- Presented roadmap and technology infrastructure to customers, demonstrating deep familiarity with APIs, platform infrastructure, security and integration capabilities.
- Conducted post-sale requirements gathering, analysis and documentation.
- Managed project scope, schedule, status and documentation.
- Created and implemented innovative business solutions to support corporate objectives.
- Designed and implemented data pipelines using Apache Spark and Apache Kafka to ingest, process, and analyze large-scale datasets for various clients.
- Collaborated with cross-functional teams to understand business requirements and translate them into technical solutions using Cloudera's platform.
- Developed and maintained scalable ETL processes using Cloudera's distribution of Hadoop (CDH) and Apache Hive, ensuring efficient data processing and storage.
- Optimized query performance and data storage strategies to enhance system reliability and reduce latency, resulting in a 20% improvement in processing time.
- Provided technical guidance and mentorship to junior team members, fostering a collaborative and learning-oriented environment within the data engineering team.
- Conducted performance tuning and troubleshooting of production systems to ensure high availability and reliability of data processing workflows.
Data Analyst Intern
Kaar Technologies
12.2021 - 09.2022
- Designed compliance frameworks for multi-site data warehousing efforts to verify conformity with state and federal data security guidelines.
- Generated detailed studies on potential third-party data handling solutions, verifying compliance with internal needs and stakeholder requirements.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Prepared documentation and analytic reports, delivering summarized results, analysis and conclusions to stakeholders.
- Analyzing and identifying best suited model for the given dataset using Machine learning
- Implementation of typical classification / Regression Model based on the use case.
- Sales Forecasting using Prophet and other classical time series algorithms.
Education
Bachelor of Engineering - Computer Science & Engineering
Sri Sai Ram Institute of Technology
Chennai 08.2018 - 03.2022
Skills
AWS
Snowflake
Python
Power BI
Cloudera
Machine Learning
Spark Framework
SQL and Databases
Hadoop Ecosystem
Certification
AWS Certified Solutions Architect - Associate Level
Inhouse Developments
- Developed RAG(Retrieval Augmented Generation) Model integrated with GPT4 using Langchain system to extract content from relevant sources for Q&A.
- Development of 7 ERP Dashboards (Customer, Vendor, Employee, Maintenance, Shop Floor, Quality EHSM) using PowerBI
- Constructed Cloudera private cloud base for Saudi Based Largest Desalination Corporation and Enabled data processing and analytics capabilities.
- Implemented Minutes of Meeting Generating system using GPT for Saudi based top electrical product manufacturing company
Implemented three potential use cases for in the field of Data engineering and Data Science for Saudi based National Oil Corporation - Implemented and Developed CCTV Fraud Analytics System using YOLOV8 to identify potential threats and anomaly in behavior
- Implemented a product assortment application along with inventory management system to track orders, products and use customer segmentation and demand forecasting to draft out space planning and identify best product assortment plan based on geography and time period
Timeline
AWS Certified Solutions Architect - Associate Level
10-2023
AWS Certified cloud practitioner
06-2023
Associate Data Engineer & Developer
Kaar Technologies
10.2022 - Current
Data Analyst Intern
Kaar Technologies
12.2021 - 09.2022
Bachelor of Engineering - Computer Science & Engineering
Sri Sai Ram Institute of Technology
08.2018 - 03.2022