Prem Anand R

Tools/Technologies: AWS Glue, AWS S3, Athena, Redshift, Apache Airflow, Data Build Tool (DBT), PySpark, Python, scikit-learn, pandas, and LLM APIs.

Responsibilities:

• Led the migration of legacy data pipelines and ETL frameworks to AWS Cloud, improving scalability, reliability, and cost efficiency.
• Developed and managed data pipelines for extraction, transformation, and loading using AWS Glue, S3, Athena, and Redshift.
• Automated data extraction from diverse APIs, integrating and orchestrating marketing data pipelines for analytics and insights.
• Advanced data transformation and enrichment using PySpark and Python in distributed environments.
• Managed data pipeline orchestration, scheduling, and data lineage with Apache Airflow and DBT.
• Drove cost optimization by migrating proprietary pipelines to open-source tools (Airflow, DBT).
• Collaborated closely with business and analytics teams to deliver robust data solutions.
• Experience on Working in Microsoft Power BI

Innovation & Machine Learning Initiatives:

• Built an ML-powered Student Progress Predictor, enabling early risk identification using student historical data.
• Developed a RAG (Retrieval-Augmented Generation) SQL Query Builder POC: Leveraged LLM APIs to convert natural language to SQL, empowering non-technical users for self-service analytics.
• Led POCs, integrating LLM APIs, enhancing analytics with advanced prompt engineering, and text retrieval for accelerated insights.

• Organisation: Astrazeneca Pvt Ltd
• Project: Regional Data Warehouse (RDW - Canada)
• Tools Used: Informatica Power Center 10.2, Unix SQL Workbench, Winscp , SAS SQL
• Role: Informatica Developer and Analyst
• Responsibilities:
• The scope of this project is to reduce the effects and complexity for the business user to analyse the sales and market data without any issue.
• We need to design an Informatica mapping to process the data for reporting and to monitor the sales and marketing data of products in different regions of Canada.
• The Business request for altering the existing request by adding a few requirements and demand calculations are developed to stabilize the growth of sales and understand the current status in market.

• Organisation: TATA CONSULTANCY SERVICES
• Client: JC Penney (JCP)
• Project: Direct Order Management (DOM-SOMA)
• Tools Used: Informatica Power Center9.6, Unix, SQL
• Role: Analyst
• Responsibilities:
• The scope of this project is to reduce the effects and complexity for the user to purchase the retail-products without any issue.
• We need to process the data for reporting and to monitor the inventory sync between various interface in order to avoid user complaints
• The Business request for altering the existing request by adding a few requirements and demand calculations are developed to stabilize the growth and understand the current status in market.