
Looking for AWS Cloud Engineer / Data Engineer Dynamic ETL Developer practiced in helping companies with diverse transitioning, including sensitive [Type] data and massive big data installations. Promotes extensive simulation and testing to provide smooth ETL execution. Known for providing quick, effective tools to automate and optimize database management tasks.
Overall 23 years of experience as a Data Engineer using AWS
Performing daily Data Ingestion and Monitoring activities in AWS Redshift
Data integration from several sources (Oracle, Teradata and API-based) with different formats (Table, CSV Files and Flat File) into the cloud (AWS Redshift)
Monitoring Cluster Health, Troubleshooting, and Performance tuning and solving the issues
Proficient use of ETL tools like HVR (High Volume Replicator) and App flow
A deep understanding of setting up the Channel with the Source and Target locations, and the appropriate HVR replication actions
Good understanding of ticketing tools such as Service Now (including Incident, RITM, and Change Request) and Rally Space
Effective communication with customers and team members
In-depth knowledge of the Linux environment, including Ubuntu and RHEL
Adept at understanding and writing MySQL queries
Experience setting up and managing Linux servers on Amazon, encompassing EC2, EBS, EFS, VPC, ELB, S3, Redshift, SG, RDS, and IAM
Solid understanding of Jenkins, Docker, Terraform, Kubernetes and their components
Good grasp on developing Docker images using Docker files
Utilized Python programming language extensively for data manipulation, analysis, and visualization, with a focus on the Pandas library
Conducted exploratory data analysis (EDA) using pandas to identify trends, patterns, and outliers in large datasets, enabling data-driven decision-making