Ayan Nareda
Data Engineer
Jaipur
Summary
With three years of hands-on data engineering experience, I specialize in transforming data into actionable insights. My expertise includes ETL pipeline design, automation of Big Data processes, and proficiency in technologies like Apache Spark and Hadoop. I'm dedicated to creating efficient and scalable data solutions that accelerate decision-making and reduce operational overhead.
Overview
3
3
years of professional experience
7
7
years of post-secondary education
4
4
Certifications
Work History
Data Engineer
KFin Technologies Ltd.
Hyderabad
07.2021 - Current
- Leading two pivotal ETL projects, overseeing the entire data pipeline, from extraction to loading, while engaging in project planning, team coordination, and strategic decision-making.
- Played a crucial role in creating and managing a Data Lake for a client, harnessing the potential of big data for data-driven decision-making.
- Worked on data ingestion, ensuring automated and seamless data flow into the Data Lake by implementing ETL processes to maintain data quality, structure, and consistency.
- Continuous optimization of ETL performance and scalability, including implementing partitioning strategies and data indexing techniques to enhance data retrieval and processing.
- Established a comprehensive data catalog and metadata management system for user-friendly data discovery, understanding, and access within the Data Lake.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
Data Engineer Intern
KFin Technologies Ltd.
Hyderabad
02.2021 - 06.2021
- Worked on critical projects focused on SQL databases, data querying, and business intelligence, with a key role in developing SQL queries to generate business reports.
- Collaborated closely with the business team to design and implement mathematical logics for data analysis, contributing to data-driven decision-making.
- Undertook a challenging project involving the design and development of an audit system between two databases lacking primary keys, utilizing Spark and Scala to create a unique solution.
- Automated the entire process using AWS Elastic MapReduce (EMR), enhancing efficiency and data integrity in the audit system.
Data Science Intern
DSMATICS
Remote
01.2021 - 01.2021
- Spearheaded the development of a specialized web crawler for a dynamic project, focusing on creating a web scraping tool.
- Responsible for designing and implementing a web scraping tool capable of extracting valuable information from various websites using manufacturer names and item numbers.
Machine Learning Intern
Pianalytix
Remote
12.2020 - 12.2020
- Developed and presented a comprehensive series of video lectures aimed at simplifying machine learning algorithms and their practical implementation using Python, tailored to beginners.
- The course encompassed a thorough exploration of essential libraries for machine learning, such as Pandas and Numpy, and provided detailed explanations and examples for 13 different machine learning algorithms using suitable datasets.
Education
Bachelor of Technology - Computer Science
ABV Indian Institute of Information Technology
Gwalior, Madhya Pradesh 07.2017 - 05.2021
High School Diploma -
Lady Anusuya Singhania Educational Academy
Jhalawar, Rajasthan 04.2014 - 03.2017
Skills
Warehousing expertise
undefinedCertification
Apache Spark with Scala - Hands On with Big Data!
Work Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Timeline
Data Engineer
KFin Technologies Ltd.
07.2021 - Current
Apache Spark with Scala - Hands On with Big Data!
05-2021
Data Engineer Intern
KFin Technologies Ltd.
02.2021 - 06.2021
Data Science Intern
DSMATICS
01.2021 - 01.2021
Machine Learning Intern
Pianalytix
12.2020 - 12.2020
Machine Learning, Data Science and Deep Learning with Python
07-2020
Python for Computer Vision with OpenCV a n d Deep Learning
07-2020
Deep Learning and Computer Vision A-ZTM: OpenCV, SSD &GANs
06-2020
Bachelor of Technology - Computer Science
ABV Indian Institute of Information Technology
07.2017 - 05.2021
High School Diploma -
Lady Anusuya Singhania Educational Academy
04.2014 - 03.2017
Similar Profiles
Yamini ChakrabortyYamini Chakraborty
Deputy Manager at Kfin Technologies Ltd.Deputy Manager at Kfin Technologies Ltd.
Sneha DasSneha Das
Executive at Kfin Technologies Ltd.Executive at Kfin Technologies Ltd.
Nalini GautamNalini Gautam
Deputy Manager at Kfin Technologies Public LimitedDeputy Manager at Kfin Technologies Public Limited