Highly skilled and analytical Data Engineer with an extensive background in designing, implementing, and optimizing large-scale data systems.
Proficient in various programming languages and experienced in data management, ETL processes, and database administration, and proficient in using Hadoop ecosystem tools such as Hive and Spark.
Demonstrated success in creating scalable data pipelines and transforming complex data sets into valuable insights for decision-making.
Overview
3
3
years of professional experience
Work History
Data Engineer
ACT Fiberent
Bengaluru
09.2021 - Current
Analyzed user requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
Developed and implemented data models, database designs, data access and table maintenance codes.
Collaborated with cross-functional teams to gather requirements and translate business needs into technical specifications for data solutions.
Optimized SQL queries and database schemas for performance improvements in data retrieval operations.
Optimized existing queries to improve query performance by creating indexes on tables.
Collaborated with data scientists and analysts to understand data needs and implement appropriate data models and structures.
Streamlined data flow from diverse sources using ETL tools such as SQL, PySpark and Airflow.
Provided technical mentorship to junior data engineers, guiding them on best practices and project execution.
Senior Client Engagement Officer at Housing ACT community services Directorate ACT GovernmentSenior Client Engagement Officer at Housing ACT community services Directorate ACT Government