Lopamudra Sharma
Bangalore
Summary
Accomplished Data Engineer at Standard Chartered Bank GBS, skilled in leveraging Hadoop and Spark to optimize data ingestion and extraction processes. Proven ability to enhance internal frameworks, driving efficiency and reliability. Adept in collaboration and problem-solving, with a strong foundation in Java and SQL, ensuring high-quality data solutions.
Overview
11
11
years of professional experience
Work History
Data Engineer
Standard Chartered Bank GBS
Bengaluru
07.2021 - Current
- Engaged in development, support, and enhancement of several internal frameworks emphasizing data ingestion and extraction from a range of sources like Teradata, Hive, and assorted filesystems featuring real-time and historical data.
Developer Programmer
Capgemini Technology
Bengaluru
07.2019 - 04.2022
- Resolved client issues within banking domain through targeted solutions.
- Enhanced SDM, DQMF, and 'BEF' frameworks to improve functionality.
- Deployed end-to-end extraction framework during Isilon migration.
- Addressed performance challenges within Spark to optimize processing speeds.
- Imported data from RDBMS tables into HDFS and HIVE efficiently.
- Executed Sqoop commands to export data into alternative databases.
- Transferred logs to HDFS utilizing Sqoop for better data management.
- Developed OOZIE workflows to execute multiple jobs concurrently.
- Resolved client issues within banking domain through targeted problem-solving strategies.
- Implemented AWS clusters to deploy NiFi flows effectively.
- Developed customised NiFi processors to enhance functionality and create tailored NARs.
Cox
11.2018 - 05.2019
- Worked on telecom domain to solve client's problem
- Loaded data into hive tables and hbase tables
- Worked on spark streaming with nifi and kafka
- Worked on scripting and deployment using jenkins.
Software Programmer
Synechron Technologies Pvt. Ltd.
Bengaluru
02.2018 - 10.2018
- Worked on Capital Markets domain (various asset classes like Equities and Rates, Electronic Trading and Trade Life Cycle), FIX protocol
- Generated report based on ALGO, MLO, ECN trades.
- Worked on Compliance report generation.
- Worked on scripting and deployment.
- Provides solution on data driven decision in investment banking domain.
GATHI ANALYTICS PVT LTD
05.2017 - 10.2017
- Processed unstructured data and converted it into structured information
- Worked on sentimental analysis
- Worked on real time data as well as offline data
- Worked on recommendation engine.
- Provides solution on data driven decision in investment banking domain.
Software Engineer
BOOMERANG COMMERCE
03.2015 - 03.2017
- Executed data processing through Hive queries aligned with Decision-making engine (BoomRev).
- Developed SQL queries to extract and manipulate data efficiently.
- Utilized Python for data mining, enhancing analytical capabilities.
- Imported data from RDBMS tables into HDFS and Hive for centralized storage.
- Employed Sqoop commands for seamless data export to other databases.
- Transformed logs into HDFS using Sqoop for better accessibility.
- Created Oozie workflows to execute multiple jobs concurrently, optimizing resource usage.
- Monitored and scheduled Oozie jobs, ensuring timely execution and error resolution.
Education
M.S - ELECTRONICS AND TELECOMMUNICATION
Ravenshaw University
Skills
- Spark
- Python
- Apache Spark
- ETL processes
- Hadoop ecosystem
- SQL expertise
- Scripting languages
- Data migration
- Big data processing
- RDBMS
- AWS services
- Snowflake
Awards
- Won Star of quarters and certificates of appreciation multiple times for performing well above expectations in Synechron Technology
- Received multiple appreciation emails for contributions made in Boomerang Commerce
Timeline
Data Engineer
Standard Chartered Bank GBS
07.2021 - Current
Developer Programmer
Capgemini Technology
07.2019 - 04.2022
Cox
11.2018 - 05.2019
Software Programmer
Synechron Technologies Pvt. Ltd.
02.2018 - 10.2018
GATHI ANALYTICS PVT LTD
05.2017 - 10.2017
Software Engineer
BOOMERANG COMMERCE
03.2015 - 03.2017
M.S - ELECTRONICS AND TELECOMMUNICATION
Ravenshaw University