Having 6 Years of work experience on Python and Big Data Technologies. Having Experience in data engineering using Python3.6,SnowFlake Sql,PySpark 3.X. Having Experience in Amazon Web Service (s3,kinesis,EMR,Lambada etc),GCP [BigQuery,Storage,Pub/sub,DataProc,composer(AirFlow), Workflows,Cloud build,DataPipelines , DataFlow,BigTable,DataStudio.DataPrep]
PSpark 3.X, Python 3.6, Pandas, PyQt5, Intellij, Maven, Gradle, GIT, Jenkins, Windows, Unix, Decision Trees, Random Forests, Boosting
Data Migration oracle to S3(DBOS)
Process of migrating the data from oracle database to amazon s3 storage involves transferring various datasets, including customer information transaction records, and product data., Configures and manages the amazon s3 storage environment., Sets up data ingestion pipeline and transfer protocols., Monitors s3 usage, performance and cost optimization.