Kamal Theja Arisetty
Hyderabad
Summary
Experienced Senior Data Engineer with 10+ years developing, testing, and maintaining data architectures. Proficient in database management systems, Big Data processing frameworks, and data modeling. Skilled in leading teams to create innovative data solutions that optimize system efficiency and inform business decision-making. Proven track record of enhancing data availability and accuracy.
Overview
11
11
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
Shell India Pvt. Ltd.
Bangalore
05.2023 - Current
- Developed data pipelines to ingest and process large datasets.
- Created ETL scripts to move and transform data from various sources into a centralized repository.
- Performed advanced analytics on structured and unstructured data using SQL, PySpark.
- Automated manual processes by creating custom scripts and programs using scripting languages using PowerShell.
Technical Specialist
IBM Consulting Pvt. Ltd.
04.2021 - 05.2023
- Project is based on energy domain where we gather and process data to maximize profits in their trader through shipping industry
- Automated extraction of data from emails through ADF and PySpark by calling API's and integrated the flow end to end
- Merged various sources to bring insights through ADF and PySpark
- Deployed artifacts using Azure DevOPS
- Brought right set of data by performing data analysis.
Senior Data Engineer
Deloitte Consulting India Pvt. Ltd.
Hyderabad
09.2019 - 04.2021
- Project is based on Insurance domain where they aggregate data for insights and meet the policies by USA government
- Migrated the application from on-premise to Azure performing same transformations using PySpark
- Orchestrated workflow using Control-M
- Rebuild a framework to handle change in primary key for dataset automatically correcting historical and current data.
Consultant
TechMahindra Pvt. Ltd.
Hyderabad
11.2018 - 08.2019
- Project is based on pharma domain where they make strategic planning on marked pricing in various countries across the globe
- Integrated various sources of data using U-SQL and created a universal data lake to store global data
- Later migrated the same functionality using PySpark
- Lead Azure Governance team in handling request across various projects for the client.
Senior Data Engineer / Associate Data Engineer
Accenture Services Pvt. Ltd.
01.2014 - 11.2018
- Big Oil: The driving purpose of the project is to develop a global digital analytics practice providing measurement and actionable insights for marketing activities across multiple channels through the customer journey from discover to explore, buy and engage
- Developed and modified pipelines in ADF, SQL SP's
- Implemented code fixes to major components of clickstream data analytics per given change requests across various layers in project workflow
- USA Retailer: The functional aspect of the project would involve providing a platform for Data Scientists to analyze customer's profile and the customer's shopping behavior
- Involved in Data analysis through HQL Queries using few retail statistics like pvalue, pscore, affinities and bundles, deciles
- Tableau and D3.js (Visualization) dashboards validation through CQL queries (Cassandra)
- Managed the delivery of user stories and lead the team.
Education
B Tech. in Information Technology -
Jawaharlal Nehru Technological University, Kakinada
05.2013
Skills
- Azure Data factory
- Databricks
- PySpark
- Azure Datalake
- Azure Storage account
- Azure KeyVault
- Logic Apps
- Datalake Analytics
- PowerShell
- AAD
- HDInsight
- Azure DevOPS
- JIRA
- WinSCP
- PuTTy
- IDE's - Visual Code, SSMS, Eclipse
- Microsoft SQL, MySQL, Oracle, HQL, U-SQL
- Data Governance
Domains
- Retail
- Energy
- Finance
- Pharma
- Technology
Methodology
Agile
Awards
- STAR AWARD - IBM, Deloitte
- ACE - Accenture
- Client Appreciations across all projects
Certification
- Databricks Certified Data Engineer Associate
- AI Beginner Certificate from KPMG
Timeline
Senior Data Engineer
Shell India Pvt. Ltd.
05.2023 - Current
Technical Specialist
IBM Consulting Pvt. Ltd.
04.2021 - 05.2023
Senior Data Engineer
Deloitte Consulting India Pvt. Ltd.
09.2019 - 04.2021
Consultant
TechMahindra Pvt. Ltd.
11.2018 - 08.2019
Senior Data Engineer / Associate Data Engineer
Accenture Services Pvt. Ltd.
01.2014 - 11.2018
B Tech. in Information Technology -
Jawaharlal Nehru Technological University, Kakinada
Similar Profiles
SIBA PRASAD BARIKSIBA PRASAD BARIK
Senior Business Analyst at Shell India Pvt. Ltd.Senior Business Analyst at Shell India Pvt. Ltd.
Spoorthy NayakSpoorthy Nayak
CC Lead Testing at Shell India Pvt LtdCC Lead Testing at Shell India Pvt Ltd
Mallaiah YBMallaiah YB
Change and Projects Advisor at Shell India Markets Pvt LimitedChange and Projects Advisor at Shell India Markets Pvt Limited