PRAKASH R
Coimbatore
Summary
With over 12 years of IT experience, including more than four years specializing in big data engineering, this professional has a proven track record of delivering impactful solutions that drive organizational success. Their expertise lies in advanced web scraping, data cleansing, and ETL automation, enabling them to create high-quality, actionable insights. They are proficient in utilizing cloud technologies and scalable data architectures to enhance data accessibility and efficiency. Their commitment to advancing data-driven decision-making is evident through their innovative engineering practices and optimized workflows, ensuring reliability and accuracy at every stage of data management.
Overview
12
12
years of professional experience
1
1
Certification
Work History
Full Stack Data Engineer - Lead
Aggregate Intelligence
Coimbatore, India
02.2023 - 11.2024
- Full Stack Data Engineer Lead with extensive experience overseeing the delivery of data solutions for projects like Airline Data, Rental Cars, and Hotel Data. Directed the implementation of data extraction processes using advanced web scraping techniques, large-scale data processing with PySpark on GCP Dataproc, and workflow orchestration with Airflow Composer. Ensured pipelines adhered to the Medallion Architecture, transforming data from the bronze to gold layer for high-quality storage in Delta Lake.
- Collaborated on leveraging BigQuery for advanced analytics and PostgreSQL for structured storage to optimize querying and accessibility. Guided the implementation of CI/CD pipelines using Docker and Makefiles for efficient deployment and Pytest for ensuring robust testing. Delivered scalable, reliable, and efficient data workflows aligned with business objectives.
Technical Lead
IntelFount Technologies
Chennai, India
11.2021 - 11.2022
- Led the "IntelCues" project, managing data extraction from sources like RSS feeds, live data, historical data, and JSON dumps, handling over 1.5 TB of data. Used PySpark, Python, SQL, and Hadoop for data cleansing, normalization, and deduplication, applying fuzzy mapping techniques for unique data extraction.
- Developed daily crawlers with Python and Java, and orchestrated data pipelines using Airflow. Employed Hive queries for efficient data storage and used CI/CD processes for streamlined deployment. Delivered a reliable ETL process for transforming and storing data for actionable insights.
Technical Lead
Mobius365 Data Services
Coimbatore, India
07.2017 - 10.2021
- Technical Lead with expertise in data crawling, big data processing, and automation tool development. Led projects related to company data, shipments, mergers, acquisitions, and executive moves.
- Developed production support systems, monitoring tools, and client support bots using open-source technologies.
- Managed a team and ensured timely project delivery. Designed and implemented ETL pipelines, leveraging tools like Python, Java, MySQL, MongoDB, Flask, NER, Lucene, Hadoop, and Spark for efficient data processing and analytics.
Senior Developer
Mobius365 Data Services
Coimbatore, India
07.2014 - 07.2017
- Developed reusable code libraries that streamlined development efforts and improved consistency in software architecture across multiple projects.
- Designed and implemented solutions for deduplication of daily data against historical records using SQL and Java.
- Automated data delivery pipelines by writing SQL queries to generate outputs tailored to client requirements.
- Worked within a team to troubleshoot and resolve complex production issues within tight deadlines.
Junior Developer
365Media Pvt., Ltd.,
Coimbatore, India
06.2012 - 07.2014
- Created custom bots for web scraping and automation, streamlining repetitive tasks and improving operational efficiency.
- Developed automation tools and scripts in Java to collect data from various websites, leveraging regular expressions for data extraction and transformation.
- Extracted and cleaned HTML content using Java and regex, storing processed data into relational databases like MySQL and MSSQL.
Education
Bachelor of Science - Computer Science
CBM College
Coimbatore, India04-2008
Corpn.P.Kamalanathan Hr.Sec.School
Coimbatore, India04-2005
Skills
- Python
- Core Java
- PySpark
- FastApi
- GCP
- DeltaLake
- NoSQL
- SQL
- Airfow
- WebScraping
- Selenium
- Git
- Docker
- Kanban Taiga
Certification
- [BigData Hadoop & Spark Developer] [Simplilearn] [2020 August]
- [Python for Data Science] [Simplilearn] [2020 December]
- [DataEngineering with Hadoop] [Simplilearn] [2021 July]
Languages
Tamil
Telugu
English
Timeline
Full Stack Data Engineer - Lead
Aggregate Intelligence
02.2023 - 11.2024
Technical Lead
IntelFount Technologies
11.2021 - 11.2022
Technical Lead
Mobius365 Data Services
07.2017 - 10.2021
Senior Developer
Mobius365 Data Services
07.2014 - 07.2017
Junior Developer
365Media Pvt., Ltd.,
06.2012 - 07.2014
Bachelor of Science - Computer Science
CBM College
Corpn.P.Kamalanathan Hr.Sec.School