Skip to content

PricingSaaS joins Willingness to PayRead the announcement →

Product change·Oct 4 → Jan 1, 2026·Q4 2025·Cloud & DevOps

Datadog LLM Observability Unveils New Experiments Feature to Optimize Model Comparisons and Enhance Testing Capabilities

DatadogProductFeature added

What changed

Feature added

New Experiments feature: Select best configurations with side-by-side experiment comparisons

Feature added

New Experiments feature: Generate versioned datasets from traces to standardize and reuse test cases

Feature added

New Experiments feature: Run experiments to compare models, prompts, and agent logic before release

Feature added

Enhanced evaluations: Added support for custom evaluations alongside out-of-the-box quality checks

Feature added

New Experiments feature: Debug traces in Playground by testing prompts, parameters, and models

Before and after

Oct 4, 2025 vs Jan 1, 2026
Pulse.
100%
Change 1 of 5 · feature added

New Experiments feature: Select best configurations with side-by-side experiment comparisons

Sign in to view the full comparison

See the before/after screenshots and every marked-up change.