LLM Preflight MCP Server
Last reviewed: 2026-09-08 · As of: v2.12.0 Catch LLM integration regressions before they ship. LLM Preflight is a local contract preflight for model, prompt, structured-output, and provider-call changes. It runs a small cross-provider preflight and compares validated output, response speed, tokens, and estimated cost.
People who work with benchmark, gemini and model migration and want it reachable from Claude, Cursor, VS Code, or another MCP client. The project is written in Python.
VERIFIED ACTIVE
LAST COMMIT 2026-09-09 · ★ 2 · #243 OF 945 MAINTAINED OTHER · VERIFIED 2026-09-18
MIT · Python servers · how we verify → /methodology
01 · Install LLM Preflight
before you install - you'll need
The README does not document required environment variables for a basic install.
Claude Code
claude mcp add feronovak-llm-preflight -- uvx llm-preflight Claude Desktop / Cursor / VS Code - add to config
{
"mcpServers": {
"feronovak-llm-preflight": {
"command": "uvx",
"args": [
"llm-preflight"
]
}
}
} Same JSON for Cursor. For VS Code, rename the top-level key from `mcpServers` to `servers`.
Using another client? Same JSON, different key
Claude Desktop · mcpServers
Cursor · mcpServers
VS Code · servers
Windsurf · mcpServers
Zed · context_servers
Cline · mcpServers
Roo Code · mcpServers
Continue · mcpServers
LibreChat · mcpServers
Gemini CLI · mcpServers
Codex CLI · mcp_servers
Full setup guides: every client.
02 · Evidence
Security posture
What to check before giving this server access to your agent - from the registry, GitHub, and our own probes. We don't score safety; we show what's verifiable.
runs as local process (stdio) - runs on your machine with your user's permissions
license MIT - declared in the repository
pypi package llm-preflight - check the name against the project README before installing (PyPI has no namespace ownership)
registry namespace io.github.feronovak is GitHub-verified and matches the repo owner
03 · What LLM Preflight can do
Prose above is summarized from the project's README and registry record - no invented capabilities.
Limitations (from the README)
[!WARNING] Live benchmarks make paid API requests. Start with the no-key demo, preview the plan before a live run, and keep limits and repetitions small.
Latest releases
v2.14.0 · 2026-09-09
v2.13.0 · 2026-09-08
v2.12.0 · 2026-09-08
04 · Who maintains LLM Preflight
LLM Preflight is maintained by feronovak. It's the only MCP server we track from this author; the repo dates to Jul 2026.
05 · Facts
- repository
- github.com/feronovak/llm-preflight
- category
- other - ranked #243 of 945 actively-maintained other servers as of 2026-09-18.
- release cadence
- 10+ releases in the last 90 days (latest 2026-09-09)
- registry
- io.github.feronovak/llm-preflight (active, first published 2026-08-31 · 2 versions)
- packages
- pypi:llm-preflight
06 · LLM Preflight FAQ
What is LLM Preflight?
Last reviewed: 2026-09-08 · As of: v2.12.0 Catch LLM integration regressions before they ship. LLM Preflight is a local contract preflight for model, prompt, structured-output, and provider-call changes. It runs a small cross-provider preflight and compares validated output, response speed, tokens, and estimated cost.
Is LLM Preflight still maintained?
Yes - as of 2026-09-18, its last commit was 2026-09-09 and it shipped 10+ releases in the last 90 days. We re-verify nightly.
How do I install LLM Preflight?
Run `uvx llm-preflight`. The README does not document required environment variables for a basic install. You can also paste the ready-made client config above.
Does LLM Preflight run locally?
Yes - it's a stdio server: it runs on your machine (via uvx) with your user's permissions. Your data stays local unless the server itself calls external APIs.
07 · Alternatives to LLM Preflight
Alternatives to LLM Preflight
Maintained other servers if LLM Preflight isn't the fit.
- Heyputer MCP Server Puter MCP enables AI tools to interact with Puter: manage files, websites, workers, and more ★ 43,552 · 2026-09-17
- Server Commands An MCP server to run arbitrary commands ★ 39,038 · 2026-09-11
- basebalance.cloud - x402 RPC & MCP gateway USDC-gated Base JSON-RPC: free 10 req/min, $0.50 per 10k. Failover, cache, /mcp, ledger. ★ 6,432 · 2026-08-26
- Zotero MCP (54yyyu) Search, read, annotate, and add to your Zotero research library, local or web. ★ 5,069 · 2026-09-15
- Firebase MCP Gives AI development tools Firebase-specific capabilities and expertise. ★ 4,470 · 2026-09-18
- Microsoft Fabric MCP Server MCP tools for interacting with Microsoft Fabric ★ 3,681 · 2026-09-17
More MCP servers to compare · Filekiwi MCP Server · Blank Files MCP · fipeX MCP · Dyslex Ia
More Python MCP servers · Gflow CLI · Figma MCP Server (figma) · Python MCP · Vaultbeat Apple Health · FinStack MCP · see all