cognis-digital

MODELROUTE

Community cognis-digital
Updated

Local model router / proxy across Ollama, vLLM, and cloud with fallback

MODELROUTE

Local model router / proxy across Ollama, vLLM, and cloud with fallback

PyPI CI License: COCL 1.0 Suite

AI Agents & LLMOps โ€” build, route, evaluate, and secure agents.

pip install cognis-modelroute
modelroute scan .            # โ†’ prioritized findings in seconds

๐Ÿ”Ž Example output

Real, reproducible output from the tool โ€” runs offline:

$ modelroute-emit --version
modelroute 0.1.0
$ modelroute-emit --help
usage: modelroute [-h] [--version] [--format {table,json}]
                  {route,simulate,providers,models} ...

Local model router/proxy with fallback.

positional arguments:
  {route,simulate,providers,models}
    route               resolve alias to a fallback chain + request plan
    simulate            route + dispatch with simulated outages
    providers           list configured providers
    models              list models (optionally filter by alias)

options:
  -h, --help            show this help message and exit
  --version             show program's version number and exit
  --format {table,json}

Blocks above are real modelroute output โ€” reproduce them from a clone.

Sample result format (illustrative values โ€” run on your own data for real findings):

{
"finding": {
"id": "1234567890",
"name": "Suspicious Network Traffic",
"description": "Network traffic from unknown IP address",
"confidence": 0.8,
"created_by": "AI System",
"created_at": "2023-02-20T14:30:00Z"
},
"indicators": [
{
"type": "ip",
"value": "192.168.1.100",
"label": "Malicious IP Address"
}
]
}

Usage โ€” step by step

modelroute is a local model router/proxy that resolves a model alias into aprovider fallback chain and builds the dispatch request. Console script: modelroute.

  1. Install from a clone:
    pip install -e .
    
  2. Resolve an alias into a fallback chain + request plan:
    modelroute route fast --prompt "Summarize this changelog" --strategy local-first
    
  3. Inspect what's configured โ€” list providers and models:
    modelroute providers
    modelroute models fast
    
  4. Read the output โ€” --format json returns the chosen candidate and full chain:
    modelroute --format json route fast -p "hi" | jq '.chosen, .fallback_chain'
    
  5. Simulate an outage โ€” verify failover by failing named providers:
    modelroute simulate fast -p "hi" --fail openai,anthropic
    

Contents

  • Why modelroute? ยท Features ยท Quick start ยท Example ยท Architecture ยท AI stack ยท How it compares ยท Integrations ยท Install anywhere ยท Related ยท Contributing

Why modelroute?

AI infra

modelroute is single-purpose, scriptable, and self-hostable: point it at a target, get prioritized results in the format your workflow already speaks (table ยท JSON ยท SARIF), gate CI on it, and let agents drive it over MCP.

โ†‘ back to top

Features

  • โœ… Resolve
  • โœ… Build Request
  • โœ… Estimate Tokens
  • โœ… Messages Tokens
  • โœ… Dispatch
  • โœ… List Models
  • โœ… List Providers
  • โœ… Runs on Linux/macOS/Windows ยท Docker ยท devcontainer
  • โœ… Ports in Python, JavaScript, Go, and Rust (ports/)
โ†‘ back to top

Quick start

pip install cognis-modelroute
modelroute --version
modelroute scan .                       # scan current project
modelroute scan . --format json         # machine-readable
modelroute scan . --fail-on high        # CI gate (non-zero exit)
โ†‘ back to top

Example

$ modelroute scan .
  [HIGH    ] MOD-001  example finding             (./src/app.py)
  [MEDIUM  ] MOD-002  another signal              (./config.yaml)

  2 findings ยท risk score 5 ยท 38ms
โ†‘ back to top

Architecture

flowchart LR
  IN[target / manifest] --> P[modelroute<br/>checks + rules]
  P --> OUT[findings (JSON / SARIF)]
โ†‘ back to top

Use it from any AI stack

modelroute is interoperable with every popular way of using AI:

  • MCP server โ€” modelroute mcp (Claude Desktop, Cursor, Cognis.Studio, uncensored-fleet)
  • OpenAI-compatible / JSON โ€” pipe modelroute scan . --format json into any agent or LLM
  • LangChain ยท CrewAI ยท AutoGen ยท LlamaIndex โ€” wrap the CLI/JSON as a tool in one line
  • CI / scripts โ€” exit codes + SARIF for non-AI pipelines
โ†‘ back to top

How it compares

Cognis modelroute LiteLLM
Self-hostable, no account โœ… varies
Single command, zero config โœ… โš ๏ธ
JSON + SARIF for CI โœ… varies
MCP-native (AI agents) โœ… โŒ
Polyglot ports (JS/Go/Rust) โœ… โŒ
Open license โœ… COCL varies

Built in the spirit of LiteLLM, re-framed the Cognis way. Missing a credit? Open a PR.

โ†‘ back to top

Integrations

Pipes into your stack: SARIF for code-scanning, JSON for anything, an MCP server (modelroute mcp) for AI agents, and a webhook forwarder for SIEM/Slack/Jira. See docs/INTEGRATIONS.md.

โ†‘ back to top

Install โ€” every way, every platform

pip install "git+https://github.com/cognis-digital/modelroute.git"    # pip (works today)
pipx install "git+https://github.com/cognis-digital/modelroute.git"   # isolated CLI
uv tool install "git+https://github.com/cognis-digital/modelroute.git" # uv
pip install cognis-modelroute                                          # PyPI (when published)
docker run --rm ghcr.io/cognis-digital/modelroute:latest --help        # Docker
brew install cognis-digital/tap/modelroute                             # Homebrew tap
curl -fsSL https://raw.githubusercontent.com/cognis-digital/modelroute/main/install.sh | sh
Linux macOS Windows Docker Cloud
scripts/setup-linux.sh scripts/setup-macos.sh scripts/setup-windows.ps1 docker run ghcr.io/cognis-digital/modelroute DEPLOY.md (AWS/Azure/GCP/k8s)
โ†‘ back to top

Related Cognis tools

  • agentsmith โ€” Config-first scaffolding and orchestration for multi-agent workflows
  • skillhub โ€” Local skill registry and installer for AI agents
  • toolguard โ€” Runtime allowlist and policy for agent tool-calls
  • evalbench โ€” Offline LLM / agent eval harness with regression gates
  • ragkit โ€” Batteries-included local RAG pipeline โ€” ingest, index, serve
  • memorybank โ€” Portable long-term memory store for agents, exposed over MCP

Explore the suite โ†’ ๐Ÿ—‚๏ธ all 170+ tools ยท โญ awesome-cognis ยท ๐Ÿ”— cognis-sources ยท ๐Ÿค– uncensored-fleet ยท ๐Ÿง  engram

โ†‘ back to top

Contributing

PRs, new rules, and demo scenarios are welcome under the collaboration-pull model โ€” see CONTRIBUTING.md and SECURITY.md.

โญ If modelroute saved you time, star it โ€” it genuinely helps others find it.

Interoperability

{} composes with the 300+ tool Cognis suite โ€” JSON in/out and a sharedOpenAI-compatible /v1 backbone. See INTEROP.md for thesuite map, composition patterns, and reference stacks.

License

Source-available under the Cognis Open Collaboration License (COCL) v1.0 โ€” free for personal, internal-evaluation, research, and educational use; commercial / production use requires a license ([email protected]). See LICENSE.

Cognis Digital ยท one of 170+ tools in the Cognis Neural Suite ยท Making Tomorrow Better Today

MCP Server ยท Populars

MCP Server ยท New

    Cassette-Editor

    Oh My Cassette: Chat Your Raw Clips Into a Finished Cut

    ไฝ ็š„้š่บซ AI ๅ‰ช่พ‘ๆญๆกฃ | Pocket AI co-editor for video montage โ€” AI video editing plugin & MCP server for Claude Code, Codex, Hermes & OpenCode

    Community Cassette-Editor
    trendsmcp-ai

    Trends MCP

    MCP server for live trend data. Query Google Search, YouTube, TikTok, Reddit, Amazon, Wikipedia, News sentiment, Web Traffic, App Downloads, Steam, npm and more. Works with Claude, Cursor, VS Code, GitHub Copilot, ChatGPT, Windsurf, Cline, Raycast and any MCP-compatible.

    Community trendsmcp-ai
    jacob-bd

    Gemini Notebook (formerly Google NotebookLM) CLI & MCP Server

    Programmatic access to Gemini Notebook - via command-line interface (CLI), Model Context Protocol (MCP) server, and AI agent skills.

    Community jacob-bd
    PxyUp

    Fitter โ€” web data for AI agents

    New way for collect information from the API's/Websites

    Community PxyUp
    kayhendriksen

    foehn

    Download MeteoSwiss Open Government Data โ€” weather stations, radar, hail, forecasts and climate series โ€” via Python API, CLI, or MCP server, as DataFrames, Parquet, xarray Datasets or Zarr stores

    Community kayhendriksen