Plugin directory / AI Models / dsh-eval-infra
dsh-eval-infra
Unverified
1Stars
AI ModelsCategory
GitHubSource
What it does
Paired A/B evaluation infrastructure for DeepSeek Harness (dsh) components: interleaved repeated runs through the real runtime, verifier self-checks, one-variable arms, regression gating, cache- and calendar-aware cost, CLI + web UI
Our take
Unverified — not yet install-tested; try it in your own environment.
Unverified — not yet install-tested; try it in your own environment.
“Verified” means our CI ran dsh plugin add in a clean profile and it booted — not a security audit and not an endorsement of third-party code.
Install
🧩 Let your agent install it (recommended)
Install the catalog once, then ask DeepSeek Harness to find and install this plugin.
dsh plugin add dshbase-catalogWeb profile:
dsh plugin --profile web add github:tt-wang/dsh-eval-infra