Summary
Overview
Work History
Education
Skills
Playing Chess
Timeline
Generic

Hemant Sharma

Software Engineer
New Delhi

Summary

Innovative software development professional with a 12-year track record of crafting maintainable and scalable software solutions. Adept in spearheading projects that meet and exceed organizational goals through rigorous, consistent practices and a detail-oriented approach. Proficient in navigating high-pressure environments, swiftly adapting to new challenges and technological shifts to enhance the organizational brand.

Proven ability to master new technologies and methodologies while thriving in both collaborative and autonomous roles. Highly skilled in Python, with extensive experience in designing and implementing robust ETL pipelines within the Data Engineering sector. Committed to fostering a team-oriented environment focused on achieving project goals with precision and speed, continually driving projects towards successful, timely completion.

Overview

12
12
years of professional experience
8
8
years of post-secondary education

Work History

Staff Software Engineer

STEM Inc.
07.2023 - Current
  • Reviewed and enhanced over 100+ pull requests, playing pivotal role in maintaining high code quality and introducing best practices that accelerate product development cycles.
  • Developed Jupyter Notebook environment, enabling sales analysts to compute forecasted prices and savings for potential customers, thereby enhancing decision-making processes and client engagements.
  • Streamlined development workflows by integrating agile methodologies, significantly improving project delivery timelines and team collaboration using tools like Jira.
  • Cultivated culture of continuous improvement, overseeing regular code reviews and feedback sessions, which foster collective growth and knowledge sharing within team.
  • Architected scalable systems to support increasing user traffic, ensuring robust performance and system stability under varied load conditions.
  • Translated technical concepts and information into terms parties could easily comprehend
  • Tested troubleshooting methods and documented resolutions for inclusion in knowledge base for support team use
  • Tuned systems to boost performance
  • Created proofs of concept for innovative new solutions
  • Optimized dust, temperature and humidity controls for installed systems
  • Reduced application load times by optimizing database queries and streamlining data retrieval processes
  • Performed root cause analysis on reported issues, swiftly resolving bugs while minimizing disruptions to users'' experiences
  • Increased system reliability by proactively addressing potential security vulnerabilities in the codebase
  • Developed robust APIs for seamless integration of internal and external services with the software platform
  • Enhanced user experience through implementing intuitive interfaces and responsive designs

Technical Architect

Infinite Computer Solutions
8 2021 - 07.2023
  • Developed network and system architecture according to business needs.
  • Collaborated with clients to determine project specifications and scope.
  • Engineered architecture and infrastructure for Analytics Platform.
  • Reviewed clients' overall app and infrastructure estate, business priorities and success criteria to design transformation plans.
  • Authored code in Python and JavaScript within Django, Flask and FAST API framework.
  • Troubleshot and tested software and debugged to clean up code and improve efficiency.
  • Defined and maintained databases to deliver responsiveness to data client requests.
  • Worked with customers to understand needs and provide excellent service.
  • Analyzed complex data and identified anomalies, trends and risks to provide useful insights to improve internal controls.
  • Developed, implemented and maintained data analytics protocols, standards and documentation.
  • Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
  • Prepared documentation and analytic reports, delivering summarized results, analysis and conclusions to stakeholders.
  • Communicated new or updated data requirements to global team.
  • Conducted deep-dive hands-on training sessions to transfer knowledge to customers considering or already using AWS.
  • Worked flexible hours across night, weekend and holiday shifts.
  • Identified issues, analyzed information and provided solutions to problems.
  • Led design and deployment of a data-driven architecture for OTT platform, utilizing advanced Azure cloud technologies in collaboration with AWS to maximize streaming performance and data analytics utilizing hybrid cloud.
  • Architected and programmed robust data processing solutions, writing and optimizing PySpark scripts within Azure Databricks to streamline data flows and enhance transformation processes.
  • Deployed and administered sophisticated ETL pipelines using Azure Data Factory, ensuring efficient data synchronization and management for continuous real-time streaming capabilities.
  • Developed a scalable data storage strategy with Azure Data Lake (Delta Lake Geo2), facilitating advanced data handling and quick retrieval methods crucial for extensive media content distribution.
  • Designed and integrated SDK APIs across multiple client devices, working with diverse media players such as Bitmovin, AVPlayer, and ExoPlayer. Focused on creating flexible, maintainable APIs that enhance media player functionalities and ensure seamless content delivery across platforms.
  • Implemented innovative strategies for handling inactive clients, developing methods to detect and manage devices in sleep mode or those unable to send data. This approach minimized data loss and ensured consistent user experience and reliable analytics.
  • Explored and applied IoT system concepts, gaining insights into device interconnectivity which aided in refining analytics and optimizing content delivery strategies for personalized user engagement. Also build a system to make auto generated calls using mobile devices and record call to validate ivr script and successful response.

Sr. Data Engineer

TekSystems(For FMC Corp)
03.2021 - 08.2021
  • Collaborated with Application, Data Science and App Engineering team on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
  • Explained data results clearly and discussed how it can be utilized to support project objectives.
  • Built Airflow Jobs, worked on Django Backend on data models to reduce data duplicity
  • Integrated Microsoft Azure Queue, Functions and blob storage to asynchronously transfer data between multiple environments.
  • Mentored team with best practices and knowledge on product.
  • Managed over 10 ETL jobs running in Airflow docker containers hosted over Azure cloud.
  • Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly
  • Developed custom algorithms for efficient data processing, enabling faster insights and decisionmaking
  • Contributed significantly towards setting up an automated monitoring mechanism using state-of-the-art technologies and tools, which led to proactive issue identification and resolution
  • Enhanced system performance by designing and implementing scalable data solutions for high-traffic applications

Associate Consultant

HCL Technologies
05.2016 - 03.2021

Overview:

Reviewed project specifications and designed technology solutions that met or exceeded performance expectations. This involved Orchestrating efficient large-scale software deployments, including testing features and correcting code.

ETL

  • Wrote highly maintainable, solid code for ETL system, forming core framework and earning consistent praise from subsequent developers since initial version.
  • Built a concurrent system for bi-directional data flows between two systems.
  • Created Canonical models for complex transformation of objects.
  • The framework clearly differentiates between DTO and canonical model that is process on later stage by the application
  • The design also features data serialization and caching using in memory object graphs.
  • Custom DSL for gathering filtering results.
  • Used cryptography to securely store creds in encrypted form.
  • Features config manage to gather input from XML and validate from XSD.
  • Also, the user could specify a JSON file to provide input.
  • Multiprocessing
  • Optimized performance using multiprocessing.
  • Build large data set ingestion system using it.
  • Used to purge sensitive data object by spawning and destroying process. Enhancing data security.
  • Correlation Service:
  • Invented the service to perform complex correlation using weights.
  • Still investigating opportunities to use pandas and ML algos to improve the system even further.
  • Written custom log manager based on command poll pattern to receive inputs from multiple processes and write to respective log files.
  • Bulk Data transactions using python.
  • Checked client code for bugs and weaknesses using PyDebugger and other rational troubleshooting methods.

NODE JS:

  • Writing code in TypeScript and JS
  • Creating Data Models
  • Package installation with NPM
  • Using libraries to build standalone portable executables using pkg.
  • Building front end to deliver streamed output to read data using Mongoose Driver
  • Using Middleware and Authentication midlewares.

MONGO DB:

  • Created Data model to emphasize utilization of less CPU with trade off of more disk utilization.
  • Applied Indexing to enhance computation.
  • Created custom queries to perform aggregations.
  • Configured MongoDB to store Blobs of large files
  • Integrated with Nest JS with Mongoose

DEBUGGING AND DEFECT FIXING:

  • Debug using VS code extension PyDebugger
  • Debug using Pycharm
  • Building custom pre-execution scripting for setting up debug environment.
  • Troubleshooting complex code paths by enabling conditional breakpoints
  • Debugging application performance by testing for specified benchmarks and profiling metrics.

DJANGO:

  • Building REST API for producing HTML, JS, XML and JSON response for consumer applications.
  • Data Models
  • View
  • XML and HTML template with JS code.
  • Middleware:
  • Authentication
  • Rate Limiting
  • Custom Middleware for data validation
  • Integration with MSSQL
  • Cursor based Pagination

DJANGO TEST FRAMEWORK

  • Setup Fixtures
  • Unit tests
  • Integration Tests
  • Django Fixtures for loading complex data from yaml files.
  • Random data generation for mocking systems.
  • Custom render method using yield functionality for streaming large dataset

FLASK

  • Data Models with SQL Alchemy
  • XML and HTML template with JS code.
  • Integration with MSSQL & SQLITE3

DATA ENGINEERING:

SQL

  • Writing complex joins to maintain multiple tables
  • Data Models and ERD building.
  • Using Variables in query
  • SQL Server basic Admin tasks like backup restore etc

PANDAS & NUMPY

  • Random Fake Data generator using numpy libraries.
  • Extrapolating Arrays to suit mathematical needs of complex computation logic at various stages.
  • Loading and filtering large data sets(over 25M records)
  • Aggregating Data on multiple data points to be later visualized
  • Integrating Pandas with SQL/MongoDB and CSV for storing, querying and analyzing dataset with other tools.
  • Implementing Markov Chains and Random Walk for Lexical Data Generation from test data set.
  • Assisted in the development of sales proposals by crafting compelling narratives highlighting our firm''s capabilities and expertise
  • Effectively communicated complex concepts to diverse audiences through clear visualization techniques and concise language use
  • Proactively identified risks and developed contingency plans to minimize potential issues during project execution
  • Evaluated the effectiveness of implemented strategies by monitoring performance metrics, making necessary adjustments as needed
  • Partnered with external vendors to source valuable insights that enriched analyses on client's competitive landscape
  • Delivered high-quality presentations showcasing key findings and recommendations to both internal stakeholders and clients
  • Collaborated closely with cross-functional teams to devise effective strategies and action plans for clients'' businesses
  • Managed multiple projects simultaneously while maintaining attention to detail, organization, and adherence to deadlines

Automation Engineer

Computer Sciences Corporation
09.2012 - 05.2016
  • Trained developers and quality assurance team members in automation programs and processes.
  • Established best practices and innovative solutions to enhance production rates and output quality.
  • Maintained, debugged and optimized automation programs.
  • Prepared automation concept and control drawings according to client specifications.
  • Tested, automated and whitelisted software to be used in secure environments.
  • Created detailed test cases for use on diverse projects.
  • Monitored data on system functionality and reported to senior staff.
  • Performed gap analysis procedures and detailed data reviews to optimize implementation.
  • Instructed junior team members on protocols and procedures of each station to maximize contributions.
  • Applied change control best practices to Django development processes to provide software enhancements without disruptions for end users.
  • Identified possible system enhancements to improving functionality and streamline administration.
  • Designed web-based assets for deployment on Amazon Web Services (AWS) cloud computing platforms, including EC3, S3 and Lambda.
  • Developed skills for conversing with machine in multiple languages like Powershell, Python, C#, VBScript and VB.NET during this time.
  • Written Excel Macros, SQL Queries, Bigfix Action Script, Bigfix Relevance, Ansible, MongoDB No SQL during this time.

Education

Bachelor of Technology[AMIETE, 2013 Batch] - Computer Science Engineering

Institute Of Engineers Of Electronics And Telecom.
Sagarpur, Delhi
03.2013 - 01.2018

Diplioma in Computer Science - Computer Science Engineering

Guru Nanak Dev Polytechnic
Rohini Sector 15 Delhi.
03.2009 - 03.2012

Skills

Code reviews

Playing Chess

"Chess is the struggle against the error." – Johannes Zukertort

Timeline

Staff Software Engineer

STEM Inc.
07.2023 - Current

Sr. Data Engineer

TekSystems(For FMC Corp)
03.2021 - 08.2021

Associate Consultant

HCL Technologies
05.2016 - 03.2021

Bachelor of Technology[AMIETE, 2013 Batch] - Computer Science Engineering

Institute Of Engineers Of Electronics And Telecom.
03.2013 - 01.2018

Automation Engineer

Computer Sciences Corporation
09.2012 - 05.2016

Diplioma in Computer Science - Computer Science Engineering

Guru Nanak Dev Polytechnic
03.2009 - 03.2012

Technical Architect

Infinite Computer Solutions
8 2021 - 07.2023
Hemant SharmaSoftware Engineer