Arpan Hazra
Data Engineer
kolkata
Summary
Adaptable professional with background in developing and maintaining data systems within collaborative environment, seeking to transition into new field. Developed skills include data analysis and process optimization. Proven ability to drive impactful changes through data-driven insights.Expertise in designing, building, and optimizing complex data pipelines and ETL processes. Strong in SAS,SQL, Python, and cloud platforms, ensuring seamless data integration and robust data solutions. Known for excelling in collaborative environments, adapting swiftly to evolving needs, and driving team success.
Overview
5
5
years of professional experience
3
3
Languages
1
1
Certificate
Work History
Data Engineer
Inspira Enterprise India Ltd
08.2022 - Current
- Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Automated routine tasks using Python scripts, increasing team productivity and reducing manual errors.
- Having knowledge in Analysis, design, development , deployment, testing and implementation of Data Pipelines to build a single source of truth like Enterprise Data warehouse .
- Having knowledge in Dimensions and Facts data modelling .
- Developed and deployed SAS DI , AWS GLUE ETL jobs running daily , weekly and monthly basis .
- Automated ETL processes, making it easier to wrangle data and reducing time by as much as 40 %..
- Increased the efficiency of the fetching by approximately 30% by query optimization , indexing and partitioning., understanding of table Partitioning and Indexing techniques like hash partitioning , partitioning by range and also Unique Indexes , Non_unique Indexes and Bit Map Indexes
- Having knowledge in Base SAS , SAS Macros and Python programming for creating custom transformation and interactive reports for data analysis as per the business requirement .
- Good experience in Amazon Web Services like S3,IAM,EC2,Redshift,Athena,Glue
- Hands on experience in using python libraries like boto3,Pandas,Numpy,psycopg2,redshift connector
- Also responsible for scheduling Jobs in SAS Management Console and AWS Glue.
- Having good understanding of SQL functions .
- • Having knowledge in UNIX commads.
- • Responsible for writing PL/SQL scripts for Data Validation on each stage of ETL flows
GCB Operations Associate
British Telecom E-Serv India Pvt.Ltd
12.2020 - 04.2022
- Performed a Range of operational processes delivering against key measure that support the business objectives, Stakeholders and Customer. Executed Daily , Weekly and Monthly task and Reporting to ensure operational delivery.
- Providing regular input into KPI reporting and supporting team leaders and GCB management .
- Delivering excellent operational support to our key stakeholders and customers .
Apprentice Research Analyst
Globsyn 3rd Life Pvt.Ltd.
12.2019 - 12.2020
- Worked on Data Annotation using AI tools like Amazon Mturk.
- Also worked on Data labelling.
Education
Post-Graduate Certificate - Software Engineering (Cloud - Native Technologies)
Upgrad Education
04.2001 -
Bachelor of Technology - Electronics And Telecommunications Engineering
Future Institute of Technology
Kolkata, India 04.2001 -
Skills
ETL development
Data pipeline design
Data modeling
Data warehousing
Python programming
AWS glue ETL
AWS redshift
SAS Macros
Base SAS
Amazon S3
ETL design and implementation
Problem-solving abilities
Oracle SQL
Postgre SQL
AWS identity and Access management
Amazon Elastic Compute Cloud
SAS Data Integration Studio
Pl/SQL
Unix
MS Office
SAS Management Consol
Accomplishments
- Achieved Spot Awards by completing ETL developments with accuracy and efficiency.
Certification
SAS data Integration Studio: Fast Track
Timeline
SAS data Integration Studio: Fast Track
12-2022
Data Engineer
Inspira Enterprise India Ltd
08.2022 - Current
GCB Operations Associate
British Telecom E-Serv India Pvt.Ltd
12.2020 - 04.2022
Apprentice Research Analyst
Globsyn 3rd Life Pvt.Ltd.
12.2019 - 12.2020
Post-Graduate Certificate - Software Engineering (Cloud - Native Technologies)
Upgrad Education
04.2001 -
Bachelor of Technology - Electronics And Telecommunications Engineering
Future Institute of Technology
04.2001 -