Balaji Naveen Kumar Karanam
Bigdata Engineer
Bengaluru
Summary
I am an experienced data analytics professional with 17 years of expertise in consulting and building data-driven applications. I have worked on various projects related to Analytics, Data Engineering, Data Mining, Business Intelligence, and Data Warehouse to meet operational and strategic business needs.
As a Solution Engineer, I have taken key initiatives to modernize and optimize existing Data warehouse applications. I have extensive hands-on experience in working with Spark, Hive, Airflow, Databricks, Impala, and scoop. Additionally, I have worked with Power Center tools like Source Analyzer, Warehouse Designer, Mapping Designer, and have a good working knowledge of PL/SQL and Unix Shell Scripting.
I have also played a pivotal role in leading large development teams and mentored cross-technical teams to deliver data solutions. As a Scrum master, I have helped organizations and clients to set up agile processes, and have played the role of Scrum master cum development lead in many projects.
Overall, my experience and skills make me an ideal candidate for roles related to data analytics, data engineering, business intelligence, and data warehousing.
Overview
19
19
years of professional experience
3
3
years of post-secondary education
Work History
Data Engineer
TATA Consultancy Services
Bengaluru
04.2018 - Current
- Participated in process flow analysis, manage requirement analysis, design, development, and process redesign.
- Worked on Spark SQL queries, Data frames, and import data from Data sources, perform transformations; perform read/write operations, save the results to output directory into HDFS.
- Used Jupyter notebooks and Spark-Shell to develop, test and analyze Spark jobs before Scheduling Customized Spark jobs.
- Fine-tuned Spark jobs for setting right Batch Interval time, correct level of Parallelism and memory tuning.
- Replaced the existing MapReduce programs and Hive Queries into Spark application using PySpark.
- Conducted code reviews for team members to ensure proper test coverage and consistent coding standards.
- Developed Json Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data using the Cosmos Activity.
- Worked in Agile development environment in sprint cycles of two weeks by dividing and organizing tasks.
Solution Architect
Tata Consultancy Services
Bengaluru
05.2008 - 03.2018
- Participated in process flow analysis, manage requirement analysis, design, development, and process redesign.
- Providing guidance and support for the design, development, and implementation of automated processes.
- Responsible for Project scoping, Iteration planning, overseeing Development, ensuring QA standard, SIT, UAT and Production readiness at onsite.
- Experience in running projects in MO, MC and Staff Aug modes.
- Involved in Data modelling.
- Performance tuning of complex SQL queries.
- Oracle 11G to 12C data base migration.
- Setup projects in offshore, with completely synthesized data and delivered projects successfully.
- Implemented agile development methodology in project.
- Implemented Data security logic, to provide the data to authorized users depending on their application roles.
- Developed complex Informatica mapping and fine-tuned existing mappings and workflows.
Software Engineer
Accenture Services Pvt.Ltd
Bengaluru
04.2006 - 04.2008
- Analyzed the business requirement and translate the logical model to technical specification document.
- Creating Mappings as per the requirement given by Business.
- Developed mappings/sessions using Informatica power center for data loading.
- Involved in unit testing and performance tuning.
- Interact with QA on the code and Fix the bug if found.
- Created PL/SQL Procedures to load the data into Health check tables.
Software Engineer
Versabit Technologies
Bengaluru
06.2004 - 03.2006
- Worked on Informatica – source Analyzer, Warehouse Designer, Mapping Designer, Mapplet and Transformations.
- Involved extracting data and transforming the data before loading the data into target (warehouse) Oracle tables. The transformations included generating unique sequence numbers and aggregations for the star schema target tables. The data sources were Oracle database tables and flat files and the target tables in an Oracle database.
- Used various transformations like Source Qualifier, Filter, Aggregator, Expression, Connected and Unconnected Lookup, Sequence Generator, and update Strategy.
- Developed mappings/sessions using Informatica power center for data loading.
- Developed mappings to load the data in slowly changing dimensions.
- Involved in unit testing and performance tuning.
Education
Master of Computer Applications - Computer Applications
Madras University
Chennai 06.2000 - 04.2003
Timeline
Data Engineer
TATA Consultancy Services
04.2018 - Current
Solution Architect
Tata Consultancy Services
05.2008 - 03.2018
Software Engineer
Accenture Services Pvt.Ltd
04.2006 - 04.2008
Software Engineer
Versabit Technologies
06.2004 - 03.2006
Master of Computer Applications - Computer Applications
Madras University
06.2000 - 04.2003
Similar Profiles
Vrunda ChindhadeVrunda Chindhade
HR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services LimitedHR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services Limited
Sreya BasuSreya Basu
Procare Analyst at Tata Steel(Tata Consultancy Services)Procare Analyst at Tata Steel(Tata Consultancy Services)
Arun VArun V
Program Manager at Tata consultancy services | Financial Ombudsman ServicesProgram Manager at Tata consultancy services | Financial Ombudsman Services
Naimish AgnihotriNaimish Agnihotri
Assistant Delivery Manager at Tata Consultancy Services, Global Shared ServicesAssistant Delivery Manager at Tata Consultancy Services, Global Shared Services
Parth SawantParth Sawant
Product Engineer at JuspayProduct Engineer at Juspay