Detail-oriented software engineer specializing in BigData ,data pipeline , optimization & Generative AI. Demonstrated success in streamlining processes, resulting in cost reductions of 15-20%. Committed to driving efficiency and excellence in data management.
Skills: Generative AI, LLM , RAG, LangChain, LangGraph,
Brief : Creating an SDLC Usecase to automatically provide the solution to prod errors and Data pipeline creation.
MY KEY RESPONSIBILITIES
Platform & Skills: Spark, Hive,Optimization,java8 ,spring Boot
Brief: I worked for platform team which generate optimized Spark & Hive queries for Analytical UseCases. It helped to reduce the cost by 15-20%
My Responsibilities :
Platform & Skills: Java , AWS Airflow, RDS , SQL, Glue, Python
Brief: It involve migrating the data from TerraData to RedShift to reduce the cost through optimal approach . Their key objective was to keep the data identical .
My Key Responsibilities:
Platform & Skills: GCP cloud , BigQuery, DataProc, Composer, GCS, Hbase , BigTable.
Brief: HbaseToBigQuery migration from on-prem to cloud.
My key Responsibilities:
Platform & Skills : AWS security ,BigData
Brief : Applying the security services to the dataset at rest and transit and data transformations.
My Key Responsibilities:
Platform & Skills: Core java, Spring boot, Web Services, React , Redux, Designing.
Brief: It was a case study project where i worked with 2 of my teammates , online grocery services. where customer can easliy order the items through website.\
My Key Responsibilities: