DINAK LAL V
Data Engineer
Bengaluru
Summary
Dynamic and accomplished Data Engineer with over 7 years of experience in designing and implementing robust data solutions. Specialized in Data Engineering and Analytics, adept at leveraging cutting-edge technologies to streamline processes and enhance data-driven decision-making.
Overview
7
7
years of professional experience
2
2
Certificates
6
6
years of post-secondary education
Work History
Data Engineer
HCL Technologies ( Contractor @ Atlassian )
2 2022 - Current
- Working on Databricks based Delta Lake platform
- Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.
- Developing and optimizing custom frameworks leveraging Apache Airflow
- Enhancing Data engineering Framework using in the firm
- Working with various applications handling huge amount of data
- Technologies Used Databricks, Airflow, Kubernetes, AWS, Docker, PySpark, Python, SQL
Data Engineer
Scriptstring Canada
08.2021 - 02.2022
- Data segmentation & Realtime dashboards using D3 and React JS
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Data Lake and ETL creation, Data Modeling
- Large scale web scraping using Selenium & Pyspark
- Data extraction from Documents – PDF, Text, Web, Images etc
- Technologies Used AWS Glue, S3, Parquet, Pyspark , Docker, Athena, Hadoop, GCP , Big Query, Kubernetes, Redshift. Postgres
Data Engineer
FoodHub
07.2020 - 08.2021
- Increased efficiency of data-driven decision making by creating user-friendly dashboards that enable quick access to key metrics
- Created Data Pipelines using PySpark jobs
- Business Intelligence and Data Visualization using AWS Quick sight
- Recommendation Engine using MBA and Graph Database (AWS Neptune)
- Time Series Prediction using ARIMA and SARIMA
- Complex Querying using mysql, Redhsift and Postgres
- Data extraction using S3, Athena and Spectrum
Data Analyst
Cognizant
02.2017 - 07.2020
- Worked in Agile based environment
- Played Onsite Coordinator role by working from Melbourne, Australia
- Collaborated with stakeholders to identify business needs and data sources
- Recommendation Model Design including Data Pipe line creation
- Technologies used: Django , Python, AWS Glue, Lambda , S3 and GCP
Education
Master Of Technology - Computer Science
IIIT Guwahati
Guwahati, Assam 06.2020 - 06.2022
Bachelor of Technology - Computer Science and Engineering
Government Engineering College Wayanad
Wayanad, Kerala 06.2012 - 06.2016
Skills
Data ModelingMachine LearningPython
AWS
DockerDatabricks environmentAirflowApache SparkKinesisSpark StreamingKafkaKubernetesRedshiftSnowflakeTableauGitNoSQL Databases
Hadoop Ecosystem
Big Data Processing
Database Design
Business Intelligence
Data Mining
API Development
Data Pipeline Design
SQL
Scripting Languages
Performance Tuning
Certification
Databricks Data Engineer Professional
Accomplishments
- National level 3rd prize in ISTE Chess Competition held at Thanjavur
- University Chess Runners up team member in 2012 and 2014
Languages
Malayalam (Mother Tongue)
Bilingual or Proficient (C2)
English
Advanced (C1)
Tamil
Upper intermediate (B2)
Hindi
Upper intermediate (B2)
Timeline
Data Engineer
Scriptstring Canada
08.2021 - 02.2022
Data Engineer
FoodHub
07.2020 - 08.2021
Master Of Technology - Computer Science
IIIT Guwahati
06.2020 - 06.2022
Data Analyst
Cognizant
02.2017 - 07.2020
Bachelor of Technology - Computer Science and Engineering
Government Engineering College Wayanad
06.2012 - 06.2016
Data Engineer
HCL Technologies ( Contractor @ Atlassian )
2 2022 - Current