Kaushlendra Rai
Bengaluru
Summary
Experienced with building scalable data infrastructures, ensuring seamless data flow and integration. Utilizes advanced data engineering techniques to support business intelligence and analytics. Track record of leveraging team collaboration and technical acumen to drive data-driven decision-making.
Overview
6
6
years of professional experience
Work History
Lead Data Engineer
Birlasoft
09.2024 - Current
- Collaborated with Financial Times as part of the AWS ProServe team to modernize and redesign their data pipeline, enhancing scalability and performance
- Developed a real-time data ingestion pipeline leveraging Amazon MSK (Managed Service for Apache Kafka) for seamless streaming of high-velocity data
- Designed and implemented real-time event processing using Apache Flink, ensuring low-latency transformations and enriched event streams
- Utilized Amazon S3 as a data lake, implementing efficient data partitioning and lifecycle policies for optimized storage and retrieval
- Architected Amazon Redshift-based data warehouse solutions, enabling high-performance analytics and reporting on ingested data
- Ensured best practices in data governance, security, and cost optimization across AWS services
- Worked closely with client stakeholders and cross-functional teams to align technical solutions with business objectives
Lead Data Engineer
Birlasoft
09.2024 - Current
- Collaborated with Financial Times as part of the AWS ProServe team to modernize and redesign their data pipeline, enhancing scalability and performance
- Developed a real-time data ingestion pipeline leveraging Amazon MSK (Managed Service for Apache Kafka) for seamless streaming of high-velocity data
- Designed and implemented real-time event processing using Apache Flink, ensuring low-latency transformations and enriched event streams
- Utilized Amazon S3 as a data lake, implementing efficient data partitioning and lifecycle policies for optimized storage and retrieval
- Architected Amazon Redshift-based data warehouse solutions, enabling high-performance analytics and reporting on ingested data
- Ensured best practices in data governance, security, and cost optimization across AWS services
- Worked closely with client stakeholders and cross-functional teams to align technical solutions with business objectives
Senior Data Engineer
Schneider Electric
12.2022 - 09.2024
- Designed and worked on implementation of fraud detection system using statistics, NLP and Supervised Learning with human feedback which save huge value (~10%) for business from fraud losses in respective domains (financial accounting, Procurement & sales) and enriching the auditing process of internal governance team and avoiding hefty penalties from anticorruption security agencies
- Worked on AI Assisted Sales Enablement for channel managers which generates cross-selling(selling related, supplementary products based on the customer's interest on purchase of, one of company's products) and upselling (upgrade quantity of product purchased) recommendations for customers
- Worked on various data-engineering related services such as pipeline creation, data ingestion, data pre processing and training with Inference using technologies such as PySpark, AWS Glue, AWS Lambda, S3, Sagemaker, Kafka, step-Functions, & SQL etc
Senior Software Engineer
Botmantra
02.2019 - 12.2022
- Contributed in design and development of multiple modules for a financial domain application with technologies like Python- flask, Pandas, React JS and Azure Cloud technologies like Azure- functions, Blob storages, Kafka, AKS with MYSQL database
- Also, collaborated with business stakeholders and other cross functional team to develop efficient financial workflows
- Developed highly-scalable Word-Doc tool which involved extraction and reconciliation of multiple stats from documents like .docx, pdfs and MS excel files in Python by making use of concepts like Multiprocessing, multithreading, Visual basics functions and AWS services like EC2, SQS, SNS and S3
Education
BE - electronics & communications
AMC engineering college
01.2018
Skills
- Python
- Java
- JavaScript
- Spark
- HDFS
- Kafka
- Flink
- Redshift
- Glue
- Airflow
- S3
- ECS
- EC2
- Lambda functions
- Step function
- Kinesis
- SQS
- SNS
- DynamoDB
- Data structures & Algorithms
- Cloudformation
- ETL development
- Data pipeline design
Timeline
Lead Data Engineer
Birlasoft
09.2024 - Current
Lead Data Engineer
Birlasoft
09.2024 - Current
Senior Data Engineer
Schneider Electric
12.2022 - 09.2024
Senior Software Engineer
Botmantra
02.2019 - 12.2022
BE - electronics & communications
AMC engineering college
Similar Profiles
Anupam BhatiaAnupam Bhatia
Senior manager at BirlasoftSenior manager at Birlasoft
Yuvaranjith SYuvaranjith S
BY WMS Techno Functional Consultant at BirlasoftBY WMS Techno Functional Consultant at Birlasoft
Prasanna Kumar KuchharlaptiPrasanna Kumar Kuchharlapti
Sr.Business Analyst at BirlasoftSr.Business Analyst at Birlasoft