Senior Software Engineer
IBM Pvt Ltd
06.2022 - Current
Niraj Niyanta
Bengaluru
Summary
Data Engineer and with over 10+ years of rich experience in Application Development and maintenance associated with IBM. 5 years of experience with Accenture with Big Data technologies stack and have hands on experience in Apache Spark, SCALA, SPARK SQL, SPARK Streaming and Oozie, HADOOP technology stack, HDFS, Map Reduce, SQOOP, HIVE3.8 years of experience in . 5 Years of experience in Microsoft Dynamics CRM online version. Having 4 Years of experience on Big Data application running on cloud AZURE/AWS Virtual machine, EMR, EC2,S3 and REDSHIFT. Adept in end-to-end development of software products from requirement analysis to system study, designing coding testing, de-bugging, documentation, and implementation using Agile, Scrum, Waterfall methodology. Having a clear understanding of the high-level business needs of clients and stakeholders. Skilled in performance tuning, MS SQL Development and Administration involving Development, installation, configuration, and migration of databases along with database design and management. Expert in working Scala, C#, ASP.Net, MS SQL Proficient on development tools like IntelliJ, Visual studio, GitHub, Teamcity for CI/CD, Azure Devops for versioning. Good knowledge of Object-Oriented Programming and methodologies.
Work History
British Petroleum
06.2022 - Current
- Technology &Tools : Apache , SPARK, , AWS (EMR, Elastic Search, S3, EMR, GLUE, Athena, Cloud Formation)
- This project about migrating the ETL jobs from Palantir to AWS Platform
- Jobs needs to be develop in Pyspark and scheduled on GLUE
- Migrating tables in S3 and creating tables in Athena
- Creating SDLF pipeline , Designing pipeline , configure Repos(AZURE Devops).
Accenture
- Superstar of the Month" By,
- Awarded “Kudos” by The Smart Cube
Developer
The Smart Cube Pvt. Ltd
- Developed synchronous and asynchronous plugins, custom workflow using C#, deployed plugin using plugin registration tool , XRM tool
- Integration with Angus website with CRM
- Written Web API call from Javascript
- Developed web jobs, Hosted Angus application in Azure
- Customized form , entity and Business rules, Workflow , configured queue for sending mails
- Written Unit and UAT test cases
- END OF Accenture, As Smart cube employee I worked for in house HR application except Payroll
Developer
Team Lease Pvt Ltd
- Worked to developed in house MVC.net application using VS tool
- Written Complex SQL queries , Stored procedure, Functions
- Developed client-side code using jQuery, Added Bootstrap
- Used TFS for versioning
- Solving incidents , Unit testing
- END OF Smart Cube Project
Team Member( Developer)
Wells Fargo and JP Morgan
- My Responsibilities - include specific functions/ tasks/ performance objectives
- Analysis of new requirement and discussing with Team
- Maintenance and development of stored database objects, ad hoc reports, and financial formats
- Maintenance of ASP.Net application
- Writing and development of test scripts for system performance throughput
- Maintenance and update of training guides and user manuals to keep pace with new customizations and views
- Provision and co-ordination (UAT) of software application support for all MRI users
- End of Team Lease Project
Developer
Indusinfoways Pvt. Ltd, Indusinfoways Pvt Ltd
- Is a subsidiary company of Indusfila which develop and maintain software applications for its business
- This company works to develop Supply , Purchase, Accounts , Warehouse and HR Application using .net platform
- Developed win forms for various application(HR, Supply , Purchasing & Accounts)
- Created and modified MS SQL data base , Written Stored Procedures Triggers, and functions
- Resolving Tickets raised by business users.
Lead Developer
Dollar Tree
07.2019 - Current
- Technology &Tools : SparkSQL, Streaming, Sqoop, AWS (EMR, Elastic Search, S3, EMR)
- Dollar tree store is a chain of retail stores, serving the customers worldwide, with a wide range of products like groceries, home decor, furniture, electronics etc
- Dollar tree has 4000+ retail stores, selling worldwide and generating the sales data at their POS(Point of Sale) system
- These data are stored in AWS-S3 from where data will be pushed in Big Data pipeline wherein cleaning and processing the data and finally deriving the useful business analysis
- Apart from this there are preexisted Business Data Stored at Oracle is also pushed into Big Data pipeline
- We are responsible for the development, support and maintain software applications throughout its life cycle, Defining technical solution based on business and technical requirements including User Interface Design with a concentration on User Centric Development
- Writing application code to meet the technical solution
- Software development that performs unit, integration, and negative test cases prior to release from software development into traditional QA & Test tasks
- Defining the integration strategy including rationale, integration environment requirements, and determines the product-component integration sequence
- Assesses and identifies mitigation for risks, including those related to high level design, integration, and data quality
- Participates in design reviews
- Ensures architectural changes (as defined by Architects) are implemented and contributes to root cause /problem analysis
- Contributes to the definition of development and SW standards to implement/reflect organization guidelines (naming conventions, encryption, and security settings) and ensures standards are adhered to.
Technical Lead Developer
Accenture Solution PVT. Ltd
07.2017 - 05.2022
Senior Application Developer
Accenture Solution Pvt Ltd
01.2017 - 05.2022
Software Development
Angus Chemical
02.2017 - 12.2018
- Development of source code, including descriptions, for all Software Components in accordance with Detailed Software Requirements specification, the functional design and the technical design document or backlog
- For injection data from Oracle to S3 which can be queried using hive and spark SQL tables
- Worked on Sqoop jobs for ingesting data from Oracle to Amazon S3
- Created hive external tables for querying the data
- Use Spark Dataframe APIs to inject Oracle data to S3 and stored in Redshift
- Process the datasets and apply different transformation rules on the top of different datasets
- Process the complex/nested Json and Csv data using Dataframe API
- Automatically scale-up the EMR Instances based on the data
- Participates and resolves findings in reviews (4 eyes principle) of developed source code
- Integration of software components following the groups integration strategy
- Verification of integrated software components by unit and integrated software testing according to the software test plan
- Develops methods to deploy Change Items (CIs) to the target environments
- Provides Release Deployments on non-Production Management controlled environments
- Supports creation of Software Product Training Materials, Software Product User Guides, and Software Product Deployment Instructions
- Fix’s software defects/bugs
- Measures and analyses code for quality
- Collaborates with Functional Analysts and technical Specialists to complete work, as required, Technology &Tools : CRM Dynamics, MS SQL , XRM Tool , AZURE APP Services(Web Jobs), Function , Virtual Machine
- Angus Chemical produced various chemicals for many industries like paints, cosmetic, Health etc
- Company provides free samples as per their customer needs
- Sales Module of MS CRM track this process
- An opportunity is created when free sample request from web site, customer care or campaign
- Once the order is confirmed a record is created in opportunity entity and sample is being dispatched
- We are responsible for maintenance of CRM Application , enhancement and bug fixing .
Software Engineer
The Smart Cube Pvt. Ltd
07.2015 - 11.2016
Software Engineer
Team Lease Pvt Ltd
12.2013 - 06.2015
Software Engineer
Indusinfoways Pvt Ltd
06.2011 - 09.2013
Software Trainee
Blue Chips Computer Consultancy Pvt. Ltd
08.2010 - 05.2011
- Domain
- Tenure Dollar Tree Retails 3 yrs Angus Chemicals Chemical 2 yr Wells Fargo BFS 0.8 Yrs JP Morgan
Education
Bachelor of Engg(B.E) -
Rural Engineering College
01.2009
Skills
- BFS
- 2 yrs
- Skill Profile
- Software Application
- Operating Systems
- UNIX (HP UX, IBM AIX,SunOS), Windows XP / Windows 7
- Application & Tools
- IntelliJ, PyCharm, Github, Tortoise SVN,CONTROL-M, Teamcity,
- VSS, Toad, MS Office, MS SQL Server, AdvMS Excel,
- UNICENTER(scheduler), REMEDY, JIRA,Autosys
- Database
- MSSQL server
- Programming Languages
- SQL, PL /SQL, C#,Javascript, Jquery
- Reporting Tool
- SSRS
- Big data Analytics
- Cloudera Distribution for Hadoop (CDH), APACHE SPARK with SCALA APIs, SPARK SQL,HDFS, Hive ,PySPARK
- Cloud
- Core Competencies
- Application Development
- Design and building Hadoop application along with Apache Spark
- Developed spark code using SCALA APIs and deliver end to end solutions Developed generic Reader Framework using Spark
- Worked on transformation layer using APACHE SPARK RDD, Data frame APIs and SPARK SQL and applied various transformation and aggregations provided by spark framework and also developed SPARK SCALA UDF
- Created data ingestion framework where we can load data from oracle database to hive partitioned table
- Created HIVE tables and loading and analysing data using hive query language
- Worked on SPARK integration with hive and Oracle at ingestion layers Worked with different file formats like ORC, Parquet, and JSON XML etc
- Performance tuning of SPARK application and HIVE queries
- PL/SQL Stored packages, procedures , Functions , Triggers,Views, Complex SQL queries
Accomplishments
- Page | 1
Timeline
Senior Software Engineer
IBM Pvt Ltd
06.2022 - Current
British Petroleum
06.2022 - Current
Lead Developer
Dollar Tree
07.2019 - Current
Technical Lead Developer
Accenture Solution PVT. Ltd
07.2017 - 05.2022
Software Development
Angus Chemical
02.2017 - 12.2018
Senior Application Developer
Accenture Solution Pvt Ltd
01.2017 - 05.2022
Software Engineer
The Smart Cube Pvt. Ltd
07.2015 - 11.2016
Software Engineer
Team Lease Pvt Ltd
12.2013 - 06.2015
Software Engineer
Indusinfoways Pvt Ltd
06.2011 - 09.2013
Software Trainee
Blue Chips Computer Consultancy Pvt. Ltd
08.2010 - 05.2011
Accenture
Developer
The Smart Cube Pvt. Ltd
Developer
Team Lease Pvt Ltd
Team Member( Developer)
Wells Fargo and JP Morgan
Developer
Indusinfoways Pvt. Ltd, Indusinfoways Pvt Ltd
Bachelor of Engg(B.E) -
Rural Engineering College
Similar Profiles
Kartik RathKartik Rath
Application Developer at IBM Pvt LtdApplication Developer at IBM Pvt Ltd
JAYKUMAR VJAYKUMAR V
Junior Business Associate (BAND-3) at IBM PVT LTDJunior Business Associate (BAND-3) at IBM PVT LTD
Rajkiran SasaneRajkiran Sasane
iOS Development Lead at IBM Pvt LtdiOS Development Lead at IBM Pvt Ltd
Nikita BNikita B
TALENT ACQUISITION COORDINATOR at IBM PVT LTDTALENT ACQUISITION COORDINATOR at IBM PVT LTD
KIRAN KKIRAN K
Quality Control at Daffy Healthcare PVT LTDQuality Control at Daffy Healthcare PVT LTD