Fire in da houseTop Tip:Most people pay up to $340 per month for Perplexity, MidJourney, Runway, ChatGPT, and more - but you can get them all your AI tools for $15 with Galaxy. It's free to test!Fire in da houseCheck it out

website-downloader

MCP.Pizza Chef: pskill9

The website-downloader MCP server enables downloading complete websites using the wget tool. It preserves the original website's directory structure and converts links to function locally, allowing offline browsing and analysis. This server requires wget to be installed on the host system, supporting macOS, Linux, and Windows platforms. It is ideal for capturing full website snapshots for offline use, archival, or data extraction within MCP-enabled workflows.

Use This MCP server To

Download full websites for offline browsing Archive website content preserving structure Extract website data for analysis Mirror websites locally for testing Preserve website snapshots for compliance

README

Website Downloader MCP Server

This MCP server provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.

Google Workspace Server MCP server

Prerequisites

The server requires wget to be installed on your system.

Installing wget

macOS

Using Homebrew:

brew install wget

Linux (Debian/Ubuntu)

sudo apt-get update
sudo apt-get install wget

Linux (Red Hat/Fedora)

sudo dnf install wget

Windows

  1. Using Chocolatey:
choco install wget
  1. Or download the binary from: https://eternallybored.org/misc/wget/
    • Download the latest wget.exe
    • Place it in a directory that's in your PATH (e.g., C:\Windows\System32)

Usage

The server provides a tool called download_website with the following parameters:

  • url (required): The URL of the website to download
  • outputPath (optional): The directory where the website should be downloaded. Defaults to the current directory.
  • depth (optional): Maximum depth level for recursive downloading. Defaults to infinite. Set to 0 for just the specified page, 1 for direct links, etc.

Example

{
  "url": "https://example.com",
  "outputPath": "/path/to/output",
  "depth": 2  // Optional: Download up to 2 levels deep
}

Features

The website downloader:

  • Downloads recursively with infinite depth
  • Includes all page requisites (CSS, images, etc.)
  • Converts links to work locally
  • Adds appropriate extensions to files
  • Restricts downloads to the same domain
  • Preserves the website structure

Installation

  1. Build the server:
npm install
npm run build
  1. Add to MCP settings:
{
  "mcpServers": {
    "website-downloader": {
      "command": "node",
      "args": ["/path/to/website-downloader/build/index.js"]
    }
  }
}

website-downloader FAQ

What is required to run the website-downloader MCP server?
The server requires wget to be installed on your system, which is available for macOS, Linux, and Windows.
How does the website-downloader preserve website functionality offline?
It maintains the website's directory structure and converts links to work locally, enabling offline navigation.
Can I use the website-downloader on Windows?
Yes, wget can be installed on Windows via Chocolatey or by downloading the binary and adding it to your PATH.
Is the website-downloader compatible with all MCP hosts?
Yes, as an MCP server, it can integrate with any MCP client or host that supports server tool calls.
Does the website-downloader support partial website downloads?
The server uses wget, which supports options for selective downloading; configuration depends on the tool parameters.
How do I install wget on Linux?
On Debian/Ubuntu, use 'sudo apt-get install wget'; on Red Hat/Fedora, use 'sudo dnf install wget'.
Can the website-downloader be used with different LLM providers?
Yes, it works with MCP clients using models like OpenAI, Claude, and Gemini by exposing website data for model interaction.
Is internet access required during the download process?
Yes, the server needs internet access to fetch website content during the download operation.