SURAJ GUPTA
Associate Architect - BigData
Bengaluru,KA
Summary
Ạ quality focused Lead / Architect with over 14 + years of experience in the Technological domain , Software Development & maintenance experience. Extensive Experience in building Data Engineering & analytical solutions.
Overview
14
14
years of professional experience
4
4
years of post-secondary education
3
3
Languages
Work History
Lead MTS
Salesforce
05.2021 - Current
- Building proof of concepts within the organisations technical frameworks / expansions to solve business problems
- Designed & lead the development of AWS sdk based Datasync utility services for cloud migration
- Working closely with Product owners & salesforce partners (AWS) to fulfil the business deliverables
Staff Software Engineer
Walmart Labs
Bengaluru, KARNATAKA
11.2019 - 02.2021
- Leading the development work on Migration of outgoing Teradata system into datalake
- Building Streaming application pipelines using Spakr+Kafka integration framework
- Working on understanding and streamlining Walmart existing processes for better coordination and alignment among teams
- Leading the efforts in migration of existing traditional internal ETL framework and scheduling tools to advanced processing framework like
- Park along with building CICD pipelines
Software Development Engineer
TESCO, KARNATAKA
Bengaluru
09.2016 - 10.2019
- Worked in a fast-paced agile development environment to quickly analyze, develop, and test potential use cases for the business
- Work closely together with global tech, product and data science teams to develop new ideas, implement and test them, and measure success
- Building CICD pipelines and developing project frameworks
- Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation
- End to End Design & development of Data platform for building a master source of Tesco Products
- Involved in Design and analysis of new features and product using Scala &
- Park/Kafka Frameworks to provide better and effective solution to business
- Maintaining the existing application framework and ensure smooth executions of various processes running on cluster
- Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members beam jobs.com
- Participated and Presented ideas as a Single individual on TESCO
- ACKATHON
Module Lead Engineer
IMPETUS INFOTECH, Bengaluru, KARNATAKA
09.2015 - 09.2016
- Design and Developed new modules and demonstrated abilities in key decision makings
- Maintenance and Enhancements of existing modules and involved in re designing implementations
- Involved in developing modules for new client involving technologies like
- Cala 2.10, Spark 1.5, Kafka 0.9 and Cassandra 2.2
- Successfully developed and delivered couple of initiatives on big data analytics and large data processing using SparkSQL, Scala and Hive
- Developed code on XML processing using Spark/Scala
- Training and mentoring junior team members in Big Data technologies
Technical Consultant
E2 Open, Amber Road Softwares, Bengaluru
07.2012 - 09.2015
- Understanding HDFS and Hadoop mechanism
- Co coordinating with Architects and being part of initial set up of data pipelines using Hadoop map reduce, sqoop etc
- Participating in design discussions and analyze the problem in detail to understand the key points
- Interfacing with client for requirement gathering, finalizing technical specifications for our product
- Working closely with Functional Team to support finalizing specification design document
- Ensuring smooth implementation and testing of the application
Associate
COGNIZANT TECHNOLOGY SOLUTIONS, Bengaluru, KARNATAKA
06.2011 - 07.2012
- Interfacing with Onsite team for business gathering and finalizing technical / functional specifications
- Involved in high level and Low level design for the project as lead
- Monitoring multiple teams and working closely to support production issues as Lead
- Fixing functional and performance defects
Associate Consultant
ORACLE FINANCIAL SERVICES SOFTWARE, Bengaluru, KARNATAKA
10.2010 - 06.2011
- Involved in development of software component for banking client
- Developed multiple modules across projects and delivered on time
- Provided support for production issues and fixes beam jobs.com
Senior Software Engineer
MINDTREE LTD, Bengaluru
, KARNATAKA
07.2007 - 09.2010
- Interfacing with clients for business gathering, conducting system analysis and finalizing technical / functional specifications and high level design documents for the project
- Independently handled module/Client and was solely responsible for the functionality and technical specifications of the module in the offshore team
- Developed custom reports and SDD (Solution Description Documents) and successfully implemented and ensured proper unit testing before delivery
- Participating in project management and testing as per requirement in the project
Education
BE -
SATHYABAMA UNIVERSITY
01.2003 - 01.2007
Skills
Scala, Java
Apache Spark Batch/Streaming, Apache Kafka , DataBricks Delta Lake
ELK, NoSql, Hive, Nifi, Oozie, Flume,Splunk,Presto,AWS , CICD, HDFS, Struts, Hibernate, RDBMS
Timeline
Lead MTS
Salesforce
05.2021 - Current
Staff Software Engineer
Walmart Labs
11.2019 - 02.2021
Software Development Engineer
TESCO, KARNATAKA
09.2016 - 10.2019
Module Lead Engineer
IMPETUS INFOTECH, Bengaluru, KARNATAKA
09.2015 - 09.2016
Technical Consultant
E2 Open, Amber Road Softwares, Bengaluru
07.2012 - 09.2015
Associate
COGNIZANT TECHNOLOGY SOLUTIONS, Bengaluru, KARNATAKA
06.2011 - 07.2012
Associate Consultant
ORACLE FINANCIAL SERVICES SOFTWARE, Bengaluru, KARNATAKA
10.2010 - 06.2011
Senior Software Engineer
MINDTREE LTD, Bengaluru
07.2007 - 09.2010
BE -
SATHYABAMA UNIVERSITY
01.2003 - 01.2007