tokenmizer

tokenmizer

MCP.Pizza Chef: Shweta-Mishra-ai

TokenMizer helps your AI remember the full history of your conversations, including decisions, goals, and errors, even when the chat gets very long. It works as a local helper that connects with popular AI tools like Claude Desktop, VS Code, and others, letting your AI pick up where it left off without losing important context. Setting it up requires some technical steps but no special accounts beyond your AI provider keys.

Other

Use This MCP server To

Keep AI chat sessions aware of past decisions and context Resume multi-day AI projects without re-explaining Track why certain choices were made in AI conversations Maintain a detailed memory of errors and goals across chats Use AI tools like Claude or GPT with persistent session memory

README

TokenMizer

TokenMizer

Your AI forgets why. TokenMizer remembers.

An OpenAI-compatible proxy that builds a knowledge graph of your session — decisions, files, errors, goals — and replays it when the
context window runs out. Not a summary: a queryable graph that knows "we switched from MongoDB to PostgreSQL, and here is why."

One line to adopt · works with Claude, GPT, Gemini, Grok, DeepSeek, Mistral, Cohere, Ollama · MIT

PyPI Downloads CI MCP Registry Stars Glama Score Sponsor

Quick start · Claude Code & MCP · Architecture · Benchmarks · Configuration · API & CLI · Contributing

TokenMizer demo: 40-turn session checkpointed at 87% context, resumed next day in 233 tokens
Real run: 25-node graph, checkpoint ckpt_21a0959c3ddf, 233-token resume. Regenerate with python scripts/gen_demo_gif.py.

tokenmizer FAQ

Can I use this to keep my AI conversations from forgetting past decisions?
Yes — TokenMizer remembers your session history and decisions across conversations, so your AI keeps context even when the chat gets long.
Can I use TokenMizer with Claude Desktop or VS Code?
Yes — it works with Claude Desktop, Cursor, VS Code, Continue, and any OpenAI-compatible client.
Do I need an API key or account to use TokenMizer?
You will need API keys for your AI providers like OpenAI, Anthropic, or Ollama, but TokenMizer itself does not require a separate account.
How hard is it to set up TokenMizer?
It requires developer-level setup, including installing via pip and configuring your AI client to use it as a local proxy.
Does TokenMizer summarize my chat history?
No — it builds a detailed memory graph that keeps track of why decisions were made, not just what was decided.
Can I use TokenMizer with GPT, Gemini, or Claude?
Yes — it supports GPT, Claude, Gemini, Grok, DeepSeek, Mistral, Cohere, Ollama, and more.