Fire in da houseTop Tip:Paying $100+ per month for Perplexity, MidJourney, Runway, ChatGPT and other tools is crazy - get all your AI tools in one site starting at $15 per month with Galaxy AI Fire in da houseCheck it out free

web-browser-mcp-server

MCP.Pizza Chef: blazickjp

The web-browser-mcp-server is a minimalist MCP server implementation designed to provide web browsing capabilities to AI assistants. Leveraging BeautifulSoup4, it enables structured extraction and navigation of web content through a standardized MCP interface. This server allows AI models to interact with live web pages, parse HTML content, and retrieve relevant information in real-time, enhancing AI workflows with dynamic web data access. It supports Python 3.11+ and is distributed under the MIT license, making it accessible and easy to integrate into various AI-enhanced applications.

Use This MCP server To

Enable AI assistants to browse live web pages Extract structured data from HTML content Support real-time web content retrieval for AI models Integrate web browsing into AI workflows Parse and navigate web pages programmatically Facilitate dynamic information gathering from websites

README

Twitter Follow smithery badge Python Version License: MIT PyPI Downloads PyPI Version

web-browser-mcp-server MCP server

โœจ Features

๐ŸŒ Enable AI assistants to browse and extract content from the web through a simple MCP interface.

The Web Browser MCP Server provides AI models with the ability to browse websites, extract content, and understand web pages through the Message Control Protocol (MCP). It enables smart content extraction with CSS selectors and robust error handling.

๐Ÿค Contribute โ€ข ๐Ÿ“ Report Bug

โœจ Core Features

  • ๐ŸŽฏ Smart Content Extraction: Target exactly what you need with CSS selectors
  • โšก Lightning Fast: Built with async processing for optimal performance
  • ๐Ÿ“Š Rich Metadata: Capture titles, links, and structured content
  • ๐Ÿ›ก๏ธ Robust & Reliable: Built-in error handling and timeout management
  • ๐ŸŒ Cross-Platform: Works everywhere Python runs

๐Ÿš€ Quick Start

Installing via Smithery

To install Web Browser Server for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install web-browser-mcp-server --client claude

Installing Manually

Install using uv:

uv tool install web-browser-mcp-server

For development:

# Clone and set up development environment
git clone https://github.com/blazickjp/web-browser-mcp-server.git
cd web-browser-mcp-server

# Create and activate virtual environment
uv venv
source .venv/bin/activate

# Install with test dependencies
uv pip install -e ".[test]"

๐Ÿ”Œ MCP Integration

Add this configuration to your MCP client config file:

{
    "mcpServers": {
        "web-browser-mcp-server": {
            "command": "uv",
            "args": [
                "tool",
                "run",
                "web-browser-mcp-server"
            ],
            "env": {
                "REQUEST_TIMEOUT": "30"
            }
        }
    }
}

For Development:

{
    "mcpServers": {
        "web-browser-mcp-server": {
            "command": "uv",
            "args": [
                "--directory",
                "path/to/cloned/web-browser-mcp-server",
                "run",
                "web-browser-mcp-server"
            ],
            "env": {
                "REQUEST_TIMEOUT": "30"
            }
        }
    }
}

๐Ÿ’ก Available Tools

The server provides a powerful web browsing tool:

browse_webpage

Browse and extract content from web pages with optional CSS selectors:

# Basic webpage fetch
result = await call_tool("browse_webpage", {
    "url": "https://example.com"
})

# Target specific content with CSS selectors
result = await call_tool("browse_webpage", {
    "url": "https://example.com",
    "selectors": {
        "headlines": "h1, h2",
        "main_content": "article.content",
        "navigation": "nav a"
    }
})

โš™๏ธ Configuration

Configure through environment variables:

Variable Purpose Default
REQUEST_TIMEOUT Webpage request timeout in seconds 30

๐Ÿงช Testing

Run the test suite:

python -m pytest

๐Ÿ“„ License

Released under the MIT License. See the LICENSE file for details.


Made with โค๏ธ by the Pear Labs Team

Web Browser MCP Server

web-browser-mcp-server FAQ

How do I install the web-browser-mcp-server?
You can install it via PyPI using 'pip install web-browser-mcp-server'. It requires Python 3.11 or higher.
What web scraping library does this MCP server use?
It uses BeautifulSoup4 for parsing and extracting data from HTML web pages.
Is the web-browser-mcp-server compatible with multiple LLM providers?
Yes, it is provider-agnostic and works with OpenAI, Anthropic Claude, and Google Gemini models through the MCP protocol.
How does the server handle dynamic web content like JavaScript?
The server primarily parses static HTML content; it does not execute JavaScript, so dynamic content may not be fully accessible.
Can I customize the web-browser-mcp-server for specific scraping needs?
Yes, since it is open-source under the MIT license, you can modify and extend its functionality to suit your requirements.
What security considerations should I keep in mind?
Always ensure the server runs in a secure environment and respects website terms of service to avoid unauthorized scraping.
Does the server support concurrent browsing sessions?
The server can handle multiple requests, but concurrency depends on your deployment setup and resource allocation.
Where can I find documentation and support?
Documentation is available on the GitHub repository and MCP ecosystem pages, with community support via GitHub issues and discussions.