Data Engineer with 2+ years of experience in my 7 years of experience in IT industry. Big Data technologies and Data Analysis, Proficient in Python, PySpark, Databricks SQL, Hadoop, Hive, AWS Cloud, with expertise in building and managing scalable data pipelines. Skilled in data mining, data preparation, data modeling, and ETL processes, ensuring high-quality data flow for analytical and business needs. Experienced in handling large datasets, implementing machine learning algorithms, and working with cloud platforms for data storage and processing. Strong knowledge of proof of concepts (PoC) and gap analysis to drive data-driven solutions for enterprise applications.
AIS Datalake, Advanced Info Service Public Company Limited (AIS), Thailand, Built a scalable ETL pipeline on AWS to automate data ingestion, transformation, and analytics for TV schedule data, user logs, and billing records., AWS S3, AWS Glue, Databricks, Pyspark, Advanced SQL, Excel, AWS Redshift, AWS RDS, AWS Lambda, AWS Sagemaker, Implemented a Medallion Architecture (Bronze, Silver, Gold) using AWS Glue, S3, Redshift, and Apache Airflow for efficient, structured data processing. Smart Routing Solution, Worldpay, UK, Developed a payment routing system to enhance transaction success rates by selecting the optimal payment terminal., Python, PySpark, Spark SQL, Machine Learning, Azure, Docker, ETL, Postman, Plotly, Dash