Fire in da houseTop Tip:Paying $100+ per month for Perplexity, MidJourney, Runway, ChatGPT and other tools is crazy - get all your AI tools in one site starting at $15 per month with Galaxy AI Fire in da houseCheck it out free
UI-TARS-desktop

UI-TARS-desktop

MCP.Pizza Chef: bytedance

Lets you connect an AI assistant to a virtual computer or browser so it can look at what's on the screen, click buttons, type text, and carry out multi-step tasks on its own, the same way a person would. It works as its own desktop app and can also connect to apps like VS Code, and it supports controlling either your own computer or a remote computer and browser over the internet. You will need an API key for the underlying AI model to power it.

Coding
Other
Web/Research

Use This MCP server To

Let my assistant click through a website for me Automate repetitive computer tasks like filling out forms Test a website by having my assistant click through it Control a remote computer or browser without local setup Complete multi-step tasks that span several apps automatically Have my assistant look at my screen and describe what it sees

README

Agent TARS Banner

Introduction

English | ็ฎ€ไฝ“ไธญๆ–‡

TARS* is a Multimodal AI Agent stack, currently shipping two projects: Agent TARS and UI-TARS-desktop:

Agent TARS UI-TARS-desktop
agent-tars-book-hotel.mp4
computer-use-triple-speed.mp4
Agent TARS is a general multimodal AI Agent stack, it brings the power of GUI Agent and Vision into your terminal, computer, browser and product.

It primarily ships with a CLI and Web UI for usage. It aims to provide a workflow that is closer to human-like task completion through cutting-edge multimodal LLMs and seamless integration with various real-world MCP tools.
UI-TARS Desktop is a desktop application that provides a native GUI Agent based on the UI-TARS model.

It primarily ships a local and remote computer as well as browser operators.

Table of Contents

News

  • [2025-11-05] ๐ŸŽ‰ We're excited to announce the release of Agent TARS CLI v0.3.0! This version brings streaming support for multiple tools (shell commands, multi-file structured display), runtime settings with timing statistics for tool calls and deep thinking, Event Stream Viewer for data flow tracking and debugging. Additionally, it features exclusive support for AIO agent Sandbox as isolated all-in-one tools execution environment.
  • [2025-06-25] We released an Agent TARS Beta and Agent TARS CLI - Introducing Agent TARS Beta, a multimodal AI agent that aims to explore a work form that is closer to human-like task completion through rich multimodal capabilities (such as GUI Agent, Vision) and seamless integration with various real-world tools.
  • [2025-06-12] - ๐ŸŽ We are thrilled to announce the release of UI-TARS Desktop v0.2.0! This update introduces two powerful new features: Remote Computer Operator and Remote Browser Operatorโ€”both completely free. No configuration required: simply click to remotely control any computer or browser, and experience a new level of convenience and intelligence.
  • [2025-04-17] - ๐ŸŽ‰ We're thrilled to announce the release of new UI-TARS Desktop application v0.1.0, featuring a redesigned Agent UI. The application enhances the computer using experience, introduces new browser operation features, and supports the advanced UI-TARS-1.5 model for improved performance and precise control.
  • [2025-02-20] - ๐Ÿ“ฆ Introduced UI TARS SDK, is a powerful cross-platform toolkit for building GUI automation agents.
  • [2025-01-23] - ๐Ÿš€ We updated the Cloud Deployment section in the ไธญๆ–‡็‰ˆ: GUIๆจกๅž‹้ƒจ็ฝฒๆ•™็จ‹ with new information related to the ModelScope platform. You can now use the ModelScope platform for deployment.

Agent TARS

npm version downloads node version Discord Community Official Twitter ้ฃžไนฆไบคๆต็พค Ask DeepWiki

Agent TARS is a general multimodal AI Agent stack, it brings the power of GUI Agent and Vision into your terminal, computer, browser and product.

It primarily ships with a CLI and Web UI for usage. It aims to provide a workflow that is closer to human-like task completion through cutting-edge multimodal LLMs and seamless integration with various real-world MCP tools.

Showcase

Please help me book the earliest flight from San Jose to New York on September 1st and the last return flight on September 6th on Priceline
agent-tars-new-flight.mp4

Booking Hotel Generate Chart with extra MCP Servers
agent-tars-book-hotel.mp4
mcp-chart.mp4
Instruction: I am in Los Angeles from September 1st to September 6th, with a budget of $5,000. Please help me book a Ritz-Carlton hotel closest to the airport on booking.com and compile a transportation guide for me Instruction: Draw me a chart of Hangzhou's weather for one month

For more use cases, please check out #842.

Core Features

  • ๐Ÿ–ฑ๏ธ One-Click Out-of-the-box CLI - Supports both headful Web UI and headless server execution.
  • ๐ŸŒ Hybrid Browser Agent - Control browsers using GUI Agent, DOM, or a hybrid strategy.
  • ๐Ÿ”„ Event Stream - Protocol-driven Event Stream drives Context Engineering and Agent UI.
  • ๐Ÿงฐ MCP Integration - The kernel is built on MCP and also supports mounting MCP Servers to connect to real-world tools.

Quick Start

Agent TARS CLI

# Launch with `npx`.
npx @agent-tars/cli@latest

# Install globally, required Node.js >= 22
npm install @agent-tars/cli@latest -g

# Run with your preferred model provider
agent-tars --provider volcengine --model doubao-1-5-thinking-vision-pro-250428 --apiKey your-api-key
agent-tars --provider anthropic --model claude-3-7-sonnet-latest --apiKey your-api-key

Visit the comprehensive Quick Start guide for detailed setup instructions.

Documentation

๐ŸŒŸ Explore Agent TARS Universe ๐ŸŒŸ

Category Resource Link Description
๐Ÿ  Central Hub Website Your gateway to Agent TARS ecosystem
๐Ÿ“š Quick Start Quick Start Zero to hero in 5 minutes
๐Ÿš€ What's New Blog Discover cutting-edge features & vision
๐Ÿ› ๏ธ Developer Zone Docs Master every command & features
๐ŸŽฏ Showcase Examples View use cases built by the official and community
๐Ÿ”ง Reference API Complete technical reference



UI-TARS Desktop

UI-TARS

UI-TARS Desktop is a native GUI agent for your local computer, driven by UI-TARS and Seed-1.5-VL/1.6 series models.

   ๐Ÿ“‘ Paper    | ๐Ÿค— Hugging Face Models   |   ๐Ÿซจ Discord   |   ๐Ÿค– ModelScope  
๐Ÿ–ฅ๏ธ Desktop Application    |    ๐Ÿ‘“ Midscene (use in browser)   

Showcase

Instruction Local Operator Remote Operator
Please help me open the autosave feature of VS Code and delay AutoSave operations for 500 milliseconds in the VS Code setting.
computer-use-triple-speed.mp4
remote-computer-operators.mp4
Could you help me check the latest open issue of the UI-TARS-Desktop project on GitHub?
browser-use-triple-speed.mp4
remote-browser-operators.mp4

Features

  • ๐Ÿค– Natural language control powered by Vision-Language Model
  • ๐Ÿ–ฅ๏ธ Screenshot and visual recognition support
  • ๐ŸŽฏ Precise mouse and keyboard control
  • ๐Ÿ’ป Cross-platform support (Windows/MacOS/Browser)
  • ๐Ÿ”„ Real-time feedback and status display
  • ๐Ÿ” Private and secure - fully local processing

Quick Start

See Quick Start

Contributing

See CONTRIBUTING.md.

License

This project is licensed under the Apache License 2.0.

Citation

If you find our paper and code useful in your research, please consider giving a star โญ and citation ๐Ÿ“

@article{qin2025ui,
  title={UI-TARS: Pioneering Automated GUI Interaction with Native Agents},
  author={Qin, Yujia and Ye, Yining and Fang, Junjie and Wang, Haoming and Liang, Shihao and Tian, Shizuo and Zhang, Junda and Li, Jiahao and Li, Yunxin and Huang, Shijue and others},
  journal={arXiv preprint arXiv:2501.12326},
  year={2025}
}

UI-TARS-desktop FAQ

Can I use this to automate clicking through a website?
Yes โ€” it can see a browser window and click, type, and scroll just like a person would, so you can hand off repetitive browsing tasks.
Do I need to write any code to use this?
No coding is required, but setup does involve pasting a small configuration snippet into your AI app's settings.
Which apps can I use this with?
It works with VS Code and other apps that support the Model Context Protocol, and it also ships as its own standalone desktop application.
Do I need an API key?
Yes, you need an API key for the underlying AI model, such as one from OpenAI, Claude, or Gemini, to power the agent's decisions.
Is this hard to set up?
Setup is moderate โ€” you paste a short configuration snippet into your app rather than writing code, though more advanced remote setups may need a developer's help.
Can this control a computer I don't own or one running somewhere else?
Yes โ€” it includes a remote computer and browser mode that lets the assistant control a separate machine over the internet without installing anything locally.
Can I use this to test how a website behaves?
Yes โ€” since it can navigate and interact with a page the way a visitor would, you can use it to click through a site and confirm things work as expected.
Is it safe to let this run on my own computer?
It's meant to be given specific tasks and typically lets you review what it's about to do, but as with any tool that can click and type on your behalf, only run it with a model and setup you trust.