LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.
To add retriEVAL to Claude, run the install command below. Restart Claude Code after adding it and its tools show up in your next conversation. It needs 4 environment variables, listed below.
Install
docker run -i --rm ghcr.io/hcarrillo001/retrieval-mcp:1.0.0Environment variables
ANTHROPIC_API_KEYSet in your MCP configRETRIEVAL_JUDGE_BACKENDSet in your MCP configRETRIEVAL_JUDGE_MODELSet in your MCP configRETRIEVAL_BUDGET_USDSet in your MCP configWhat this does
retriEVAL exposes a set of tools to Claude over the Model Context Protocol. After you add it to claude_desktop_config.json (snippet above) and restart Claude Desktop, those tools become callable inside any conversation.
Requirements
This server needs the following environment variables to be set before it can run:
ANTHROPIC_API_KEY RETRIEVAL_JUDGE_BACKEND RETRIEVAL_JUDGE_MODEL RETRIEVAL_BUDGET_USD
Set these via the env object in your MCP config (see claude_desktop_config.json snippet above).
Frequently asked questions
How do I install retriEVAL?
The install section on this page carries the maker's install command for retriEVAL, as submitted. Restart your client afterwards and the tools appear in your next conversation.
Which clients work with retriEVAL?
This page carries setup and config for Claude Code. Any other MCP client that accepts a standard server config can connect to retriEVAL as well.
Does retriEVAL need an API key?
Yes. Before it can run, set these environment variables: ANTHROPIC_API_KEY, RETRIEVAL_JUDGE_BACKEND, RETRIEVAL_JUDGE_MODEL, RETRIEVAL_BUDGET_USD. They go in the env block of your MCP config.
Imported from the Official MCP Registry. The details above come from the registry entry; the maker can claim this listing to correct them, add docs, and see its traffic.
Is this your MCP server?
Claim this listing to see its traffic, fix details yourself, and skip the review queue on future updates.
Add this badge to your README
Show visitors this server is listed in the ClaudeRules directory. The badge links straight to this listing.
[](https://clauderules.net/mcp/io-github-hcarrillo001-retrieval-mcp)<a href="https://clauderules.net/mcp/io-github-hcarrillo001-retrieval-mcp" target="_blank" rel="noopener noreferrer"><img src="https://clauderules.net/api/badge/io-github-hcarrillo001-retrieval-mcp" alt="Listed on clauderules.net" /></a>More Search MCP servers
GitHub
Connect AI assistants to GitHub - manage repos, issues, PRs, and workflows through natural language.
Serena MCP: the IDE for your agent
A powerful toolkit for coding, providing semantic retrieval and editing capabilities.
mediar-ai/screenpipe
🎖️ 🦀 🏠 🍎 Local-first system capturing screen/audio with timestamped indexing, SQL/embedding storage, semantic search, LLM-powered history analysis, and event-triggered actions - enables building c
MCP Toolbox for Databases
MCP Toolbox for Databases enables your agent to connect to your database.