Abhijith Varma
Chennai,TN
Summary
Results-driven and innovative Data Engineer with 1.5 years of expertise in data analytics and 1 year in data engineering, adept at implementing end-to-end data management systems. Skilled in creating comprehensive and cost-effective data warehouses and lakes for model-building solutions. Hands-on experience in building customer data platform systems with diverse data sources operating on various sync modes. Proven track record in building metrics pipelines for analytical reporting. Hands on experience in optimizing spark ETL pipeline for increased cost efficiency.
Overview
3
3
years of professional experience
Work History
Junior Data Engineer
Mad Street Den
06.2023 - Current
- Plan, Organize and Execute Data Engineering Roadmap involving creation and maintenance of data pipelines and connectors to various data sources along with cost and performance best practices
- Spearhead creation and execution of data integration procedures, utilizing ETL pipelines to seamlessly gather, transform, and load data on various sync modes
- Incorporation of Data Lineage and Custom Transformation features to cater to analytical, feature and model building pipelines
- Optimizing spark pipelines for better ingestion/processing speeds and making the pipelines cost effective
- Tech Stack - Python, SQL, PySpark, Apache Airflow, AWS [EC2, S3, RDS, Redshift, DynamoDB, EKS], MS Azure [Databricks, Data Lake,Data Factory, Synapse Analytics, Cosmos DB, Blob Storage, VM], Snowflake, Git, BitBucket
Data Analyst Trainee
Mad Street Den
12.2021 - 05.2023
- Built end-to-end analytics process/pipelines for retail automation tool
- Working on bench marking exercise to segment e-commerce websites based on their geography, daily traffic to their website and business model
- Developed Analytics reports for multiple clients - Slicing and dicing data at different levels and deriving insights from data
- Monitoring and setting up of data sanity/integrity of data pipelines
- Collaborated with cross-functional teams to ensure relevant data collection and analysis
- Optimized database queries for faster report generation and real-time access to critical information
- Tech Stack - Python, SQL, Pyspark, AWS[EC2, S3, RDS, Redshift, Databricks], MS Azure[Synapse Analytics, Databricks, Blob Storage, VM, AKS, MS Fabric], Tableau, Excel, Git, BitBucket
Education
MBA with Data Analytics in Business -
Birla Institute of Management Technology
Jaipur, Rajasthan10.2023
PGDM in Data Science -
Great Lakes Institute
Chennai, Tamil Nadu11.2021
Skills
- Languages: Python, SQL
- AWS Tools: EC2, S3, RDS, Redshift, DynamoDB, EKS, EMR, Elastic Search, ElastiCache, Databricks
- MS Azure: Databricks, Data Lake, Data Factory, Synapse Analytics, Cosmos DB, Blob Storage, VM
- DataBases: MySql, SQL Server, PostgreSQL
- Others: Pyspark, Apache Kafka, Apache Airflow, Snowflake, Kubernetes, Git, BitBucket
Timeline
Junior Data Engineer
Mad Street Den
06.2023 - Current
Data Analyst Trainee
Mad Street Den
12.2021 - 05.2023
MBA with Data Analytics in Business -
Birla Institute of Management Technology
PGDM in Data Science -
Great Lakes Institute
Similar Profiles
Rajkiran RRajkiran R
Senior Graphic Designer at Mad street denSenior Graphic Designer at Mad street den
Sohail Ali ShaikSohail Ali Shaik
Machine Learning Engineer at Mad Street DenMachine Learning Engineer at Mad Street Den
Hritick ArunachalamHritick Arunachalam
Cloud Operations Engineer at Mad Street DenCloud Operations Engineer at Mad Street Den