Aravinda Reddy Rikka
Senior Data Engineer
Hyderabad,TS
Summary
Senior Data Engineer with over 13 years of experience in designing and implementing batch and real-time processing applications across AWS cloud and on-premises clusters. Expertise includes constructing robust real-time data pipelines from Solace and JMS into Hadoop, integrating Hive queries into Spark environments using Parquet, JSON and AVRO formats. Proficient in leveraging a wide array of cloud services, including EC2, S3, EMR, Redshift, Glue and Lambda, as well as traditional ETL tools such as Teradata and Informatica. Proven track record in leading development and migration initiatives within the Scaled Agile Framework (SAFe), delivering end-to-end projects from requirements gathering through deployment and post-implementation support.
Overview
7
7
Certification
14
14
years of professional experience
Work History
Senior Data Engineer
Standard Chartered
Kuala Lumpur, Malaysia
11.2022 - 09.2024
- Designed and implemented a centralized enterprise data lake
integrating diverse source systems including credit card, loan, and user
data platforms. - Expertise in building new campaigns in Real time for new products
- Built scalable ingestion pipelines to extract, transform, and load
structured and semi-structured data into the lake, ensuring consistency
and reliability across heterogeneous systems. - Tuned queries, optimized storage formats (e.g., Parquet/ORC), and
leveraged partitioning strategies which improved performance by 40%
and reduce costs. - Implemented advanced encryption standards to safeguard sensitive
financial data, enabling secure sharing with downstream applications
while meeting compliance requirements. - Deployed automated workflows and monitoring solutions to ensure
pipeline reliability, data freshness, and proactive issue resolution.
Senior Data Engineer
Standard Chartered Bank
Chennai, Tamilnadu
04.2021 - 10.2022
- Direct project aimed at constructing TOKENIZATION framework for
encryption of card details in data lake - Executed comprehensive data analysis aimed at identifying influence of
existing markets with tokenized card numbers on marketing initiatives - Tracking data pipelines subsequent to encryption of card details.
- Managing interactions with stakeholders, downstream users, and country
business users to assess business impact and validate data reports, etc. - Proficient expertise in creating and executing real-time use cases
through Kafka Spark Streaming with Scala. - Optimized data pipelines by 20% by implementing advanced ETL
processes and streamlining data flow.
Senior Data Engineer
Standard Chartered
Kuala Lumpur, Malaysia
08.2018 - 02.2021
- Analyzed extensive datasets to identify trends and patterns in customer
behaviors. - Contributed to strategic planning sessions alongside stakeholders to
analyze business requirements pertaining to data engineering initiatives. - Developed contact policy to governance protocols to uphold compliance
with country regulatory standards in data management. - Implemented ETL solutions leveraging Apache Spark and Python to
accelerate data ingestion operations. - Orchestrated design of data architecture aimed at delivering scalable
data solutions throughout multiple business units. - Designed real-time messages to validate business rules for transaction
approvals. Facilitated delivery of card offers via SMS, push notifications,
and email upon rule validation. - Designed de-duplication workflow to avoid duplicate customer records,
resulting in 15% decrease in data overhead
Data Architect
Standard Chartered Bank
Kuala Lumpur, Malaysia
10.2024 - Current
- Designed and developed scalable solutions across platforms , enhancing
the system resilience and eliminating the redundant processes by 25%. - Implemented best practices for data governance, ensuring data quality
and compliance throughout the organization. - Collaborated with stakeholders to gather requirements and translate
them into effective technical solutions for complex data challenges. - Developed ETL processes using advanced tools to streamline data
ingestion, transformation, and loading activities efficiently. - Leading the team of 15+ team members , developers and Support team,
assigned tasks and monitored performance against targets. - Architected and led the team in migration of Data Quality application
from IDQ ( informatica ) to Pyspark which increased the Quality and
execution timelines by 40%. - Implemented multiple project improvement controls which reduced the
manual effort by 30%
Data Engineer
Kaiser Health Care
Hyderabad, Telangana
07.2014 - 06.2018
- Engineered and managed data pipelines leveraging Apache Spark and
Hadoop frameworks. - Investigated large datasets to reveal trends facilitating strategic
decision-making across departments.
Streamlined ETL processes to elevate data quality and processing speed
by 30%. - Partnered with cross-functional teams to compile requirements for data
architecture projects. - Focuses on migrating the existing project from Teradata to Hadoop
environment. - Developed UDF's in scala for masking sensitive customer data and to
perform business logic operations. - Developed PROD & DR sync tool using FS image from cluster and alerts
the team if any data is not in sync.
Associate Data Engineer
Dubai Telecom
Hyderabad
02.2012 - 06.2014
- Created and enhanced data pipelines to improve data processing
efficiency. - Spearheaded initiatives to automate reporting processes, minimizing
manual workload significantly. - Guaranteed data integrity by implementing rigorous testing and
validation procedures. - Enhanced health check metrics, resulting in 10% reduction of manual
effort - Produced daily reports with OBIEE tool, enhancing support for business
analysts' reporting needs. Analyzed data to formulate comprehensive
business reports aiding strategic decision-making, which reduced
manual effort >50%. - Guided new team members while providing L3 production support for
hot fix deployments
Education
Bachelors - computer applications
01-2012
Higher Secondary Certification - undefined
01-2009
High School Certification - undefined
01-2007
Skills
- Cloud & DevOps: AWS (EC2, EMR, S3), Microsoft Azure, Azure DevOps, CI/CD (ADO), Jenkins, Git, Bitbucket
- Languages: Python, Scala, Java, Linux Shell Scripting Workflow: Apache Airflow, Control-M, CA Autosys, Azure Data Factory, Oozie
- Frameworks: Apache Spark (PySpark, SparkSQL), Hive, HBase, Apache Kafka, Pig
- Tools & Platforms: Databricks, Azure Synapse Analytics (SQL DW), Sqoop, Talend, Informatica PowerCenter, Syncsort (Precisely Connect/DMX), Jira, IntelliJ IDEA, Eclipse, PuTTY
- Databases & Data Warehousing: Teradata, DQL, IBM Db2, Oracle, HDFS
- Soft Skills: Teamwork, Time Management, Leadership, Communication, Stakeholder Management, Agile
Certification
- AWS Cloud Practitioner
- AWS Solution Architect ( Associate )
- Essential Google Cloud Infrastructure.
- Google Cloud Platform Fundamentals.
- HDP certified developer.
- Spark Developer Certification.
- Retail Banking Domain Certification.
Disclaimer
Place: Hyderabad Aravinda Reddy Rikka
Timeline
Data Architect
Standard Chartered Bank
10.2024 - Current
Senior Data Engineer
Standard Chartered
11.2022 - 09.2024
Senior Data Engineer
Standard Chartered Bank
04.2021 - 10.2022
Senior Data Engineer
Standard Chartered
08.2018 - 02.2021
Data Engineer
Kaiser Health Care
07.2014 - 06.2018
Associate Data Engineer
Dubai Telecom
02.2012 - 06.2014