Back to MCP Servers

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

To add evals-mcp-server to Claude, run the install command below or copy the ready-made config for Claude Code, Claude Desktop, Cursor and VS Code further down. Restart your client after adding it and its tools show up in your next conversation. It declares 5 environment variables, listed below.

DevTools

Install

npx -y @cyanheads/evals-mcp-server@0.1.6

Environment variables

EVALS_DATA_DIRSet in your MCP config
EVALS_REQUIRE_CONFIRMATIONSet in your MCP config
EVALS_DEFAULT_LICENSESet in your MCP config
EVALS_CAPTURE_DIRSet in your MCP config
MCP_LOG_LEVELSet in your MCP config

Set only if the maker requires them; this listing does not flag any of them as required.

Install with your client

Terminal
claude mcp add evals --env EVALS_DATA_DIR=<YOUR_EVALS_DATA_DIR> --env EVALS_REQUIRE_CONFIRMATION=<YOUR_EVALS_REQUIRE_CONFIRMATION> --env EVALS_DEFAULT_LICENSE=<YOUR_EVALS_DEFAULT_LICENSE> --env EVALS_CAPTURE_DIR=<YOUR_EVALS_CAPTURE_DIR> --env MCP_LOG_LEVEL=<YOUR_MCP_LOG_LEVEL> -- npx -y @cyanheads/evals-mcp-server@0.1.6

Run this in a terminal to add the server to Claude Code.

What this does

evals-mcp-server exposes a set of tools to Claude over the Model Context Protocol. After you add it to claude_desktop_config.json (snippet above) and restart Claude Desktop, those tools become callable inside any conversation.

Requirements

This server declares the following environment variables. Set only the ones the maker requires for your setup; this listing does not flag any of them as required:

EVALS_DATA_DIR
EVALS_REQUIRE_CONFIRMATION
EVALS_DEFAULT_LICENSE
EVALS_CAPTURE_DIR
MCP_LOG_LEVEL

Set these via the env object in your MCP config (see claude_desktop_config.json snippet above).

Frequently asked questions

How do I install evals-mcp-server?

Run the Claude Code command in the install section to add evals-mcp-server to Claude Code, or copy the ready-made config for your client from the install section on this page. Restart your client afterwards and the tools appear in your next conversation.

Which clients work with evals-mcp-server?

This page carries setup and config for Claude Code, Claude Desktop, Cursor and VS Code. Any other MCP client that accepts a standard server config can connect to evals-mcp-server as well.

Does evals-mcp-server need an API key?

This listing does not flag an API key as required. The server can use these environment variables: EVALS_DATA_DIR, EVALS_REQUIRE_CONFIRMATION, EVALS_DEFAULT_LICENSE, EVALS_CAPTURE_DIR, MCP_LOG_LEVEL; the maker's docs say which of them your setup needs. They go in the env block of your MCP config.

Imported from the Official MCP Registry. The details above come from the registry entry; the maker can claim this listing to correct them, add docs, and see its traffic.

Is this your MCP server?

Claim this listing to see its traffic, fix details yourself, and skip the review queue on future updates.

Listed on clauderules.net

Add this badge to your README

Show visitors this server is listed in the ClaudeRules directory. The badge links straight to this listing.

Markdown
[![Listed on clauderules.net](https://clauderules.net/api/badge/io-github-cyanheads-evals-mcp-server)](https://clauderules.net/mcp/io-github-cyanheads-evals-mcp-server)
HTML
<a href="https://clauderules.net/mcp/io-github-cyanheads-evals-mcp-server" target="_blank" rel="noopener noreferrer"><img src="https://clauderules.net/api/badge/io-github-cyanheads-evals-mcp-server" alt="Listed on clauderules.net" /></a>