Blog

6 best practices for operationalizing decision models from local dev to production

A look at how to action a handful of best practices derived from experience and observation intended to improve decision model success.

Accelerate decision model development with a collaboration platform

Work together on your decision apps and iterate faster with increased visibility across your entire team – from model management to experimentation. It’s as simple as inviting users to join your team in the Nextmv console.

Release: Shadow testing for decision models in Nextmv

Shadow testing isn’t just for the MLOps crowd. Decision algorithm teams can have it too for their optimization models solving routing, scheduling, allocation, and fulfillment problems across supply chain, retail, healthcare, and more.

How to pull Nextmv run data into Google Sheets

Every time you run your app, Nextmv captures metadata that provides insight into how the app is performing. Use a simple script to pull that run data into Google Sheets to analyze and visualize KPIs over time.

What is shadow testing for optimization models and decision algorithms?

You’re pretty sure your staging model is ready for production. Pretty sure... But you want to test it under real-world conditions without real-world impact. Shadow testing gives your “understudy” algorithm the stage to prove its mettle.

A vehicle routing solution that extends from SaaS to customizable, testable model

We are excited to release the public beta of our new out-of-the-box routing engine that lets users solve VRPs with a low-code SaaS – and use the same model to customize and incorporate testing into their dev workflows.

The o10n speedrun

Decision optimization technology plays a critical role in everyday operations — food delivery, healthcare staffing, and subscription box assembly — but it can often stand in its own way. It doesn’t have to.

Introducing acceptance testing: it’s like CI/CD for your decision algorithm

We’re thrilled to announce the beta release of algorithm acceptance testing with Nextmv. We’ve streamlined making go/no-go decisions for decision model changes – paving a clear path to production.

Release roundup: batch experiments, deeper app visibility, and sample decision apps

Identify how updates to your model will impact business metrics using batch experiments. Plus, add more context to your apps by naming your runs, viewing the run input directly in the console, and more.

What is scenario testing for optimization models?

Welcome to the what-if wonderland of parallel universes. What if you expand your delivery region? Or fulfill orders from stores and distribution centers? Or hire more staff? Scenario tests help provide the answers. And, no, it’s not the same as simulation.

What are batch experiments for optimization models?

You need to change your decision model, but you’re not sure how it’ll impact your KPIs. Will there be unexpected effects? Batch experiments allow for exploration through summary statistics to orient yourself to impacted metrics.

What is acceptance testing for optimization models?

You’ve got a production decision model and an updated decision model. Should you ship the new model to prod? Will the new model meet your acceptable KPI thresholds? Acceptance testing provides the answers by delivering a documented, repeatable decision-making process.

The road to production is paved with testing and experimentation

Do you launch decision model A or B? What happens if an operator makes a manual override? How does a new optimization model perform against real-world data? Testing and experimentation has the answers, but getting them has traditionally been a challenge.