Blog

Testing decision models: How to do it and why it matters

Testing optimization models improves workflows, increases stakeholder buy-in, and helps teams deploy to production safely and quickly. But what are the steps to make testing repeatable and scalable?

Introducing acceptance testing: it’s like CI/CD for your decision algorithm

We’re thrilled to announce the beta release of algorithm acceptance testing with Nextmv. We’ve streamlined making go/no-go decisions for decision model changes – paving a clear path to production.

Release roundup: batch experiments, deeper app visibility, and sample decision apps

Identify how updates to your model will impact business metrics using batch experiments. Plus, add more context to your apps by naming your runs, viewing the run input directly in the console, and more.

What is scenario testing for optimization models?

Welcome to the what-if wonderland of parallel universes. What if you expand your delivery region? Or fulfill orders from stores and distribution centers? Or hire more staff? Scenario tests help provide the answers. And, no, it’s not the same as simulation.

What are batch experiments for optimization models?

You need to change your decision model, but you’re not sure how it’ll impact your KPIs. Will there be unexpected effects? Batch experiments allow for exploration through summary statistics to orient yourself to impacted metrics.

What is acceptance testing for optimization models?

You’ve got a production decision model and an updated decision model. Should you ship the new model to prod? Will the new model meet your acceptable KPI thresholds? Acceptance testing provides the answers by delivering a documented, repeatable decision-making process.