deep_search_lightning

MCP.Pizza Chef: positive666

Deep Search Lightning is a lightweight MCP server offering a pure web search solution tailored for large language models. It supports multi-engine aggregated search, deep reflection, and result evaluation, balancing web search with deep research. Its framework-free design enables easy integration by developers, improving search quality and contextual understanding across various model sizes without relying on costly search engines.

Use This MCP server To

Aggregate search results from multiple web search engines Enable deep reflection and evaluation of search results for LLMs Integrate lightweight web search into AI workflows without heavy dependencies Improve contextual understanding in LLMs through enhanced search data Provide a framework-free web search server for easy developer integration Support small LLMs with stable and effective search tool calling Combine web search and deep research for balanced information retrieval

README

MseeP.ai Security Assessment Badge

Deep Search Lightning

中文文档

A lightweight, pure web search solution for large language models, supporting multi-engine aggregated search, deep reflection and result evaluation. A balanced approach between web search and deep research, providing a framework-free implementation for easy developer integration.

✨ Why deepsearch_lightning?

Web search is a common feature for large language models, but traditional solutions have limitations:

  • Limited search result quality and reflection effectiveness
  • Requires powerful models and paid search engines
  • Small models often struggle with tool calling patterns
  • Contextual understanding can be unstable across different model sizes

Deep Search Lighting provides:

  • Framework-free implementation with no restrictions
  • Works with free APIs while maintaining good query quality
  • Adjustable depth parameters to balance speed and results
  • Reflection mechanism for model self-evaluation
  • Supports models of any size, including smaller ones

[Experimental Planning]:

  • Simplified design without web parsing or text chunking
  • Considering adding RL-trained small recall models

✨ Features

  • Multi-engine aggregated search:

    • ✅ Baidu (free)
    • ✅ DuckDuckGo (free but requires VPN)
    • ✅ Bocha (requires API key)
    • ✅ Tavily (requires registration key)
  • Reflection strategies and controllable evaluation

  • Custom pipelines for all LLM models

  • OpenAI-style API compatibility

  • Pure model source code for easy integration

  • Built-in MCP server support

📺 DEMO

demo

🔄 Piepline

Piepline

🚀 Quick Start

1. Installation

    conda create -n deepsearch_lightning python==3.11
    conda activate deepsearch_lightning
    pip install -r requirements.txt
    # Optional: For langchain support
    pip install -r requirements_langchain.txt

🔧Configuration

  1. Rename .env.examples to .env
  2. Fill in your model information (currently supports OpenAI-style APIs)
  3. Baidu search is enabled by default - configure other engines as needed

🚀 RUN

        1. test case
                python test_demo.py
        2. streamlit demo
                streamlit run streamlit_app.py
        3. run mcp server
                python mcp_server.py 
                python langgraph_mcp_client.py

Planning

🧪 RL-trained small recall QA model validation
🧪 Strategy improvements
🧪 Multi-agent framework implementation

🙌 Welcome to contribute your ideas! Participate in the project via [Issues] or [Pull Requests].

License

This repository is licensed under the Apache-2.0 License.

deep_search_lightning FAQ

How does Deep Search Lightning improve search result quality?
It aggregates results from multiple engines and applies deep reflection and evaluation to enhance relevance and accuracy.
Is Deep Search Lightning dependent on any specific frameworks?
No, it is a framework-free implementation designed for easy integration.
Can Deep Search Lightning be used with smaller LLMs?
Yes, it supports stable tool calling patterns suitable for small models.
Does Deep Search Lightning require paid search engine APIs?
No, it is designed to work without relying on costly search engine services.
How does Deep Search Lightning balance web search and deep research?
By combining aggregated search with deep reflection and result evaluation to provide richer context.
What makes Deep Search Lightning lightweight?
Its pure web search approach and minimal dependencies keep it efficient and easy to deploy.
Can developers easily integrate Deep Search Lightning into their projects?
Yes, its framework-free design and MCP server architecture simplify integration.
Does Deep Search Lightning support real-time search for LLMs?
Yes, it provides real-time aggregated search results to enhance LLM context.