evals-mcp-server

Indexed by io.github.cyanheads

About

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

Use this server

Add it to your MCP client. The catalogue lists this config verbatim from its source — it does not run, download, or vouch for the server. Review the command before you run it.

Transportstdio (runs a local command)

Env varsEVALS_DATA_DIR EVALS_REQUIRE_CONFIRMATION EVALS_DEFAULT_LICENSE EVALS_CAPTURE_DIR MCP_LOG_LEVEL

Claude Code

claude mcp add --env EVALS_DATA_DIR= --env EVALS_REQUIRE_CONFIRMATION= --env EVALS_DEFAULT_LICENSE= --env EVALS_CAPTURE_DIR= --env MCP_LOG_LEVEL= evals-mcp-server -- npx @cyanheads/evals-mcp-server

Cursor

Add to Cursor

If the button doesn't open Cursor, use the JSON below — Cursor accepts the same mcpServers config.

VS Code

code --add-mcp '{"name":"evals-mcp-server","command":"npx","args":["@cyanheads/evals-mcp-server"],"env":{"EVALS_DATA_DIR":"","EVALS_REQUIRE_CONFIRMATION":"","EVALS_DEFAULT_LICENSE":"","EVALS_CAPTURE_DIR":"","MCP_LOG_LEVEL":""}}'

JSON

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "@cyanheads/evals-mcp-server"
      ],
      "env": {
        "EVALS_DATA_DIR": "",
        "EVALS_REQUIRE_CONFIRMATION": "",
        "EVALS_DEFAULT_LICENSE": "",
        "EVALS_CAPTURE_DIR": "",
        "MCP_LOG_LEVEL": ""
      }
    }
  }
}

Environment variables are listed by name only — fill in your own values. Entries never carry secrets.