← Back to all projects

UI-TARS Desktop

ByteDance's desktop agent: the UI-TARS vision model moves your real mouse — and only that model family can drive it

OfficialApache-2.0
Stars
39.5k
Forks
4k
Open issues
506
Last commit
9 Oct 2026

What is UI-TARS Desktop?

Type an instruction and the app screenshots your screen, feeds it to the UI-TARS vision-language model, and issues the clicks, keystrokes and scrolling to carry it out — across the whole desktop or a browser, which is what separates it from browser-only agents. The model is the catch: you bring an endpoint serving the UI-TARS or Doubao family — self-hosting the open 7B weights via vLLM is the documented local route — and frontier models like GPT or Claude cannot drive the desktop app. Weigh the project's pulse too: desktop binaries have not shipped since August 2025, the hosted remote operators were discontinued, and 2026 activity slowed to a trickle as the repository pivoted toward its Agent TARS stack.

What can you do with UI-TARS Desktop?

  • The desktop, not just the browser — A computer operator drives the whole screen and a browser operator drives Chrome, Edge or Firefox — file managers, office software and native dialogs are all reachable. It moves the real cursor with no sandbox in between, and macOS requires Accessibility and Screen Recording permissions before it can act.
  • You bring the model endpoint — Any OpenAI-compatible endpoint serving the family works: the open UI-TARS-1.5-7B weights on your own GPU via vLLM or a Hugging Face inference endpoint, or ByteDance's VolcEngine cloud serving its Doubao vision models.
  • Agent TARS, the general-purpose sibling in the same repo — An npm CLI with a local web UI turns the same stack into a broader agent for search, browsing and file work, with three browser-control modes — a DOM mode that works with non-vision models, visual grounding from screenshots, and a hybrid of the two.
  • An SDK for building your own operators — The UI-TARS SDK ships operators for desktop input, browsers and Android over adb, so the screenshot-to-action loop can be embedded in your own automation rather than used only through the app.

Before you choose UI-TARS Desktop

  • Only UI-TARS and Doubao endpoints are documented for the desktop app; Ollama support is the tracker's most-reacted open request and GPT or Claude cannot substitute.Reported in#43
  • Windows and macOS only — Linux has been an open request since January 2025.Reported in#9
  • Distribution has stalled: the last desktop binary is from August 2025, nothing has shipped since November 2025, and the hosted remote operators were switched off — check the pulse before committing.

Star history

19 Aug to 30 Oct · +809

38.6k39.5k

Frequently asked questions

Is UI-TARS Desktop free for commercial use?

UI-TARS Desktop is released under the Apache-2.0 licence — OSI-approved open source, which permits commercial use.

How can UI-TARS Desktop be deployed?

UI-TARS Desktop is available as Runs locally.

UI-TARS Desktop
Ask AI
GitHub