Nitesh Verma

Foundry application stores trade valuations, PnL, and risk sensitivities data. It is golden.

Store most of this data in the bank, and provide mechanisms for fast aggregation and querying of this data.

• Actively involved in different phases of the development lifecycle. Hands-on experience in system requirement analysis, high-level design, and low-level design for Microservices.
• Designed a market data service from scratch that handles and processes millions of messages into BigQuery.
• Designed a highly scalable downstream feed service that takes an XML template, parses the XML, queries BigQuery, generates feeds, and stores them in a GCS bucket. This solution overrides a decade-old system, which used to take a long time.
• Hands-on experience in writing unit tests using Mockito, and integration tests using Gherkin, Cucumber.

• Implement data ingestion routines using best practices in data modeling.
• Ensure a streamlined process for CI/CD development and build, implementing proper PR flows.
• Building an operational dashboard and alerts for the data intake pipeline.
• Data profiling for new sources/intakes.
• Building, orchestrating, and owning 40-plus batch and streaming pipelines.
• Lead an initiative to optimize Spark data pipelines on Kubernetes to reduce costs. Eventually, we reduced costs by 95 percent.
• Deployed Airflow infrastructure and migrated existing jobs from the Kubernetes scheduler, which eventually stabilized the system and required less manual monitoring.

• Worked for Leading Uk Bank on ingestion, data condensation and data curation layer using spark and hortonwork platform

• Company Overview: Worked for [m]PLATFORM a media planning applications, data analytics and digital services
• This product makes it possible for media planners at GroupM agencies to use most detailed consumer data to achieve results for their clients
• The analytical data processing includes data acquisition, data cleansing, data ingestion, aggregation, data enrichment, and reporting
• Customers generate the analytical reports as per the business requirements
• Worked for [m]PLATFORM a media planning applications, data analytics and digital services
• This product makes it possible for media planners at GroupM agencies to use most detailed consumer data to achieve results for their clients