Submit
CSOAI-ORG

MEOK MCP Test MCP

Community CSOAI-ORG
Updated

MEOK MCP Test MCP — golden-file + schema-drift + tool-failure tests for any MCP server. Drop-in pre-publish gate, pytest template, HMAC-signed reports, Shields.io grade badge. By MEOK AI Labs.

MEOK MCP Test MCP

Drop-in golden-file + schema-drift + tool-failure test harness for ANY MCP server. Generates a pytest template, produces an HMAC-signed test report, prints a Shields.io grade badge for your README.

🧪 Part of the MEOK Governance Substrate (£499/mo) — combine with mcp-spec-compliance-mcp (spec audit) + meok-mcp-hardening-mcp (security red-team) for the full pre-publish gate.

Why this exists

Thousands of MCPs ship zero tests. MCP Inspector is debug-only. Anthropic Registry will probably enforce some baseline by Q4 2026. Every MCP author wants a green check before submitting.

This MCP gives you:

Test What it catches
validate_server_json Missing name/version/description/repo
validate_tool_schema Tool name not alphanumeric, description <5 or >1024 chars, invalid JSON Schema type
diff_server_json Breaking changes (removed keys, type flips)
run_golden_diff Snapshot drift
check_idempotency_static Non-deterministic read-only tools
generate_test_template Pytest scaffolding so authors can drop tests in CI
run_test_suite The full default flow above as one call
sign_test_report HMAC seal + Shields.io badge URL

Quick start

pip install meok-mcp-test-mcp
# or
uvx meok-mcp-test-mcp

from server import run_test_suite, sign_test_report

report = run_test_suite(
    server_json=my_server_json,
    golden_pairs=[
        {"name": "list_chains", "actual": actual_out, "expected": expected_out},
    ],
    schema_drift_baseline=last_known_good_server_json,
)
sealed = sign_test_report(report)
print(sealed["badge_url"])  # paste in your README

Tools exposed

  • run_test_suite(server_json, golden_pairs?, schema_drift_baseline?) — full default suite
  • validate_server_json(server_json) — structural validation
  • validate_tool_schema(tool) — single tool deep-check
  • diff_server_json(old, new) — structural diff with breaking-change flag
  • run_golden_diff(actual, expected) — single snapshot check
  • check_idempotency_static(samples) — given N samples, return whether all equal
  • generate_test_template() — pytest scaffolding
  • sign_test_report(report) — HMAC-seal + Shields.io badge

Wire it up to your CI

# .github/workflows/mcp-test.yml
name: MEOK MCP Test
on: [push, pull_request]
jobs:
  test:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: actions/setup-python@v5
        with: { python-version: "3.11" }
      - run: pip install meok-mcp-test-mcp
      - run: python -m server  # runs the included pytest scaffold

Scoring

  • A ≥ 90% passed
  • B ≥ 75%
  • C ≥ 60%
  • D ≥ 40%
  • F otherwise

Verify any signed report

Paste any signed test report at https://meok.ai/verify — the HMAC signature is checked against MEOK's public JWKS.

Pricing

  • Self-host: free (MIT)
  • Starter: £29/mo — 1K test runs/mo + signed badge SLA
  • Pro: £79/mo — 10K runs/mo + custom badge + public dashboard
  • Governance Substrate: £499/mo — bundled with 10 governance MCPs
  • A2A Substrate: £999/mo — bundled with all 12 A2A MCPs

Companion MCPs

  • mcp-spec-compliance-mcp — registry-spec conformity audit
  • meok-mcp-hardening-mcp — OWASP LLM Top 10 + 5 MCP-specific risks
  • meok-mcp-cardgen-mcp — generate .well-known/mcp cards
  • meok-agents-md-lint-mcp — AGENTS.md spec lint

Legal

Built by MEOK AI Labs — trading name of CSOAI LTD, UK Companies House 16939677.Founder: Nicholas Templeman ([email protected]).License: MIT.

MCP Server · Populars

MCP Server · New