Monu Kumar
Shamli
Summary
Adept in Big Data and Hive, my tenure at Tata Consultancy Services honed my analytical prowess and problem-solving skills, leading to innovative IT solutions that streamlined business processes. Recognized for my contributions, I excel in transforming complex technical challenges into actionable insights, demonstrating a strong blend of technical expertise and strategic thinking.
Overview
5
5
years of professional experience
1
1
Certification
Work History
IT Analyst
Tata Consultancy Servicies
Noida
05.2024 - Current
- Developed and implemented IT solutions to streamline business processes.
- Created detailed technical specifications for software applications.
- Resolved complex technical issues by providing innovative solutions.
- Analyzed project requirements and created test plans accordingly.
Engineer-Technology
Iris Software Technologies Private Limited
NOIDA
02.2023 - 05.2024
- Perform various action and transformation as per business requirement
- Design is based on Schema and Application
- Developed Spark scripts by using Spark-shell commands as per the requirements
- Responsible for overall design & development of the different module
- Design and develop JIL’s for data processing
- Identification of bugs and other observation reported in testing
- Responsible for self code review to ensure the development work
- Unit testing with test cases developed
- Analyze, Strategize and plan the delivery approach for the basic requirements while setting up a technical infrastructure of the project while reviewing the project proposals
- Design and develop multiple spark batch application for high data
- Design and develop spark applications for data processing ETL
- AutoSys to trigger the JIL’s job
Big Data Developer
Future Focus InfoTech Pvt Ltd
New Delhi
02.2022 - 01.2023
- Company Overview: This project deals with Canada Market Sales
- Experience in migrating workflow from Hadoop to GCP cloud domain with internal frame work
- According to the client requirement we have to do the validation of the data and prepare the validation sheet
- Business Domain/Function: Finance, Supply Chain, Merchandising domain
- Environment/Technology Stack: Sqoop, Hive, Spark-Sql, Git, JIRA, Confluence
- Experience into migration of data Hadoop2GCP migration
- Experience in importing and exporting data using Sqoop & Extraction wrapper from RDBMS to HDFS /GCS Bucket and vice-versa
- Experience extensively on the Hadoop Distribution File System Command
- Experience with the SQOOP to load data and other live in put data to HDFS
- Processing data in HDFS by use of extensive HIVE tables
- Experience in using ORC File, AVRO files formats
- Created and worked Sqoop jobs with incremental load to extract the data in an incremental last modified mode to HDFS
- Created a merge jobs to merge the old data that was already there in HDFS/GCS Buckets with new extracted data before loading into Hive
- Very good understanding of Partitions, bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance
- Optimizing of existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frames and Pair RDD's
- Developed Spark scripts by using Spark-shell commands as per the requirement
- Experienced in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning
- Used Spark API over Cloudera Hadoop YARN to perform analytics on data in Hive
- Experience in the Extraction of structured data from (BQ) / Big Query with the help Of Sqoop/Conf File under GCS Bucket and Run the ETL flow (DAG) with the help of Airflow
- Accomplishments/Results: Received multiple appreciations from client
- This project deals with Canada Market Sales
Data Engineer/DTE
LinkQuest Technologies Pvt Ltd
Noida
12.2019 - 10.2021
- Company Overview: Description of the project: KPI monitoring based upon the threshold
- Compare the KPI with required values and we have to prepare the report and sent them to client for the validation
- Experience with Microsoft Excel, Sqoop, Hive, Spark-Sql, Git, JIRA, Confluence
- Load and transform large sets of structured data from Relational Database Systems to HDFS and vice-versa using Sqoop tool
- Designing and creating Hive external tables and creating Partitions and Bucketing techniques in Hive using Hive Query Language(HQL)
- Experience in varied business process including Production, Planning and Sourcing
- Expertise on usage of SQL queries to extract data from RDBMS databases – MySQL, MSSQL, Big Query, Mainframe, DB2 and Oracle
- Experience on importing the data from RDBMS databases MySQL, and Oracle into Hadoop Data Lake using Sqoop
- Accomplishments/Results: Received multiple appreciations from client
- Description of the project: KPI monitoring based upon the threshold
Education
B.Tech - Electronics And Communications Engineering
IIET College
Samani, Kurukshetra, Haryana06-2019
Higher Secondary School -
DAV Inter College
Un06.2014
Senior Secondary School -
CCSSH School
Un04.2012
Skills
- Big Data
- Hive
- Spark
- Python
- Apache Hadoop
- PySpark
- Sqoop
- SQL
- MySQL
- Oracle MS SQL
- JIRA
- AutoSys
- Airflow
- Automic
- Git control
- Bit Bucket
Certification
Apache Spark certification, 09/29/23, Data Bricks Certified Associated Developer for Apache Spark
Languages
- Hindi
- English
Timeline
IT Analyst
Tata Consultancy Servicies
05.2024 - Current
Engineer-Technology
Iris Software Technologies Private Limited
02.2023 - 05.2024
Big Data Developer
Future Focus InfoTech Pvt Ltd
02.2022 - 01.2023
Data Engineer/DTE
LinkQuest Technologies Pvt Ltd
12.2019 - 10.2021
Apache Spark certification, 09/29/23, Data Bricks Certified Associated Developer for Apache Spark
B.Tech - Electronics And Communications Engineering
IIET College
Higher Secondary School -
DAV Inter College
Senior Secondary School -
CCSSH School
Similar Profiles
Rini JacobRini Jacob
Business Process Lead at Tata Consultancy ServiciesBusiness Process Lead at Tata Consultancy Servicies
Vrunda ChindhadeVrunda Chindhade
HR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services LimitedHR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services Limited
Sreya BasuSreya Basu
Procare Analyst at Tata Steel(Tata Consultancy Services)Procare Analyst at Tata Steel(Tata Consultancy Services)