mcp-rss-crawler MCP Server

Use This MCP server To

Fetch and cache RSS feeds for real-time content updates Filter RSS feeds by category, source, or keywords Manage RSS feeds via API endpoints (add, update, delete) Integrate RSS feed data into LLM workflows using MCP Fetch articles from Firecrawl API for enriched content Provide structured RSS feed data to MCP clients like Claude Desktop

README

MCP-RSS-Crawler

An MCP (Message Chain Protocol) server that fetches RSS feeds and shares them with LLMs.

Features

Fetching and caching of RSS feeds (SQLite database)
MCP protocol implementation for seamless LLM integration
Support for filtering feeds by category, source, or keywords
Comprehensive API endpoints for feed management
- Add, update, and delete feeds
Support for fetching articles from Firecrawl

Requirements

Bun
Firecrawl API key
Claude Desktop or other MCP client

Setup as MCP Server

Clone this repository
Create a claude_desktop_config.json file based on claude_desktop_config.json.example with your configuration

{
  "mcpServers": {
    "rss-crawler": {
      "command": "/path/to/bun",
      "args": ["run", "/path/to/mcp-rss-crawler/apps/mcp-server/src/mcp-cli.ts"],
      "cwd": "/path/to/mcp-rss-crawler",
      "env": {
        "PORT": "5556",
        "DB_DIR": "/path/to/mcp-rss-crawler",
        "FIRECRAWL_API_KEY": "fc-<YOUR_FIRECRAWL_API_KEY>"
      }
    }
  }
}

Install dependencies:
```
bun install
```
Start Claude Desktop:

MCP Protocol

The server implements the Message Chain Protocol (MCP) which allows LLMs to access your latest RSS feeds. The MCP endpoint accepts POST requests with a JSON body containing a messages array and returns a response with the latest feed items.

Example request:

{
  "messages": [
    {
      "role": "user",
      "content": "What are the latest news from my RSS feeds?"
    }
  ]
}

Example response:

{
  "messages": [
    {
      "role": "assistant",
      "content": "Here are the latest articles from your RSS feeds:",
      "name": "rss-mcp"
    },
    {
      "role": "tool",
      "content": "[{\"title\":\"Article Title\",\"summary\":\"Article summary...\",\"published\":\"2025-03-16T04:30:00.000Z\",\"origin\":\"Feed Name\",\"link\":\"https://example.com/article\"}]",
      "name": "rss-feeds"
    }
  ]
}

Configuration Options

The server can be configured through environment variables or a .env file:

PORT - Server port (default: 5556)
FIRECRAWL_API_KEY - Firecrawl API key
DB_DIR - Database directory (default: ~/.mcp-rss-crawler)

Troubleshooting

For connection issues, check your network settings and firewall configuration
Logs are available in the console and can be used to diagnose problems
For more detailed logging, set the DEBUG=mcp-rss:* environment variable

mcp-rss-crawler FAQ

How do I set up the mcp-rss-crawler server?

Clone the repository, configure the claude_desktop_config.json, and run the server with Bun and a Firecrawl API key.

What database does mcp-rss-crawler use for caching?

It uses SQLite to cache RSS feed data locally for efficient retrieval.

Can I filter RSS feeds by specific criteria?

Yes, you can filter feeds by category, source, or keywords through the API.

How does mcp-rss-crawler integrate with LLMs?

It implements the MCP protocol, allowing seamless sharing of RSS feed data with LLMs like OpenAI, Claude, and Gemini.

Is Firecrawl API required to use mcp-rss-crawler?

Yes, a Firecrawl API key is required to fetch articles, enhancing the feed content.

What MCP clients are compatible with mcp-rss-crawler?

It works with MCP clients such as Claude Desktop and other compatible clients supporting MCP protocol.

Can I manage RSS feeds dynamically?

Yes, the server provides API endpoints to add, update, and delete RSS feeds as needed.

What environment is needed to run mcp-rss-crawler?

The server requires Bun runtime, a Firecrawl API key, and configuration for MCP clients.