blazickjp

web-browser-mcp-server

Community blazickjp
Updated

Transform your AI applications with advanced web browsing capabilities through this Model Context Protocol (MCP) server

Twitter Followsmithery badgePython VersionLicense: MITPyPI DownloadsPyPI Version

โœจ Features

๐ŸŒ Enable AI assistants to browse and extract content from the web through a simple MCP interface.

The Web Browser MCP Server provides AI models with the ability to browse websites, extract content, and understand web pages through the Message Control Protocol (MCP). It enables smart content extraction with CSS selectors and robust error handling.

๐Ÿค Contribute โ€ข๐Ÿ“ Report Bug

โœจ Core Features

  • ๐ŸŽฏ Smart Content Extraction: Target exactly what you need with CSS selectors
  • โšก Lightning Fast: Built with async processing for optimal performance
  • ๐Ÿ“Š Rich Metadata: Capture titles, links, and structured content
  • ๐Ÿ›ก๏ธ Robust & Reliable: Built-in error handling and timeout management
  • ๐ŸŒ Cross-Platform: Works everywhere Python runs

๐Ÿš€ Quick Start

Installing via Smithery

To install Web Browser Server for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install web-browser-mcp-server --client claude

Installing Manually

Install using uv:

uv tool install web-browser-mcp-server

For development:

# Clone and set up development environment
git clone https://github.com/blazickjp/web-browser-mcp-server.git
cd web-browser-mcp-server

# Create and activate virtual environment
uv venv
source .venv/bin/activate

# Install with test dependencies
uv pip install -e ".[test]"

๐Ÿ”Œ MCP Integration

Add this configuration to your MCP client config file:

{
    "mcpServers": {
        "web-browser-mcp-server": {
            "command": "uv",
            "args": [
                "tool",
                "run",
                "web-browser-mcp-server"
            ],
            "env": {
                "REQUEST_TIMEOUT": "30"
            }
        }
    }
}

For Development:

{
    "mcpServers": {
        "web-browser-mcp-server": {
            "command": "uv",
            "args": [
                "--directory",
                "path/to/cloned/web-browser-mcp-server",
                "run",
                "web-browser-mcp-server"
            ],
            "env": {
                "REQUEST_TIMEOUT": "30"
            }
        }
    }
}

๐Ÿ’ก Available Tools

The server provides a powerful web browsing tool:

browse_webpage

Browse and extract content from web pages with optional CSS selectors:

# Basic webpage fetch
result = await call_tool("browse_webpage", {
    "url": "https://example.com"
})

# Target specific content with CSS selectors
result = await call_tool("browse_webpage", {
    "url": "https://example.com",
    "selectors": {
        "headlines": "h1, h2",
        "main_content": "article.content",
        "navigation": "nav a"
    }
})

โš™๏ธ Configuration

Configure through environment variables:

Variable Purpose Default
REQUEST_TIMEOUT Webpage request timeout in seconds 30

๐Ÿงช Testing

Run the test suite:

python -m pytest

๐Ÿ“„ License

Released under the MIT License. See the LICENSE file for details.

Made with โค๏ธ by the Pear Labs Team

MCP Server ยท Populars

MCP Server ยท New

    cognicore-dev

    CogniCore

    Persistent memory, reflection & safety for AI agents. No vector DB, no embedding server โ€” BM25 + multi-hop retrieval runs in-process. MCP server with 10 tools. Apache 2.0.

    Community cognicore-dev
    avivgerz-hue

    ๐Ÿ›ก๏ธ vibe-shield

    60-rule static security scanner, MCP server & skill poisoning auditor for AI-generated codebases (Claude Code, Codex, Cursor).

    Community avivgerz-hue
    frankShan001

    CutVoke

    Open-source, local-first video editor your AI agent can drive over MCP (Claude Code, Codex, Cursor). Windows ยท macOS ยท Linux. The AI makes the cut; you finish it on the same timeline.

    Community frankShan001
    HiveForensics-AI

    @knolo/mcp

    The open framework AI agents use to share knowledge with one another. Pack knowledge into a portable, verifiable Knowledge Image, pin it by digest, mount it locally over MCP, and prove what was used. Local-first, deterministic, no vector DB required.

    Community HiveForensics-AI
    shannonbay

    Quarterdeck

    Persistent goals for Claude Code, like "keep my inbox under control". Fresh agent runs on a schedule, webhook or failing health check, with instructions, memory and your decisions kept outside the agent. Actions wait for your approval until you trust them, enforced by a hook. MCP server + web app.

    Community shannonbay