Computer & Browser Use
Driving a browser or desktop on the user's behalf. The dividing line is whether the agent reasons over structured elements or raw pixels — the former is far more reliable wherever a usable DOM exists.
3 projects
Extracts the interactive elements of a page and hands the model a structured list, instead of asking it to guess click coordinates from a screenshot. That makes it markedly more reliable for form flows and scraping. It degrades on canvas-heavy applications and on sites with aggressive bot protection, where there is no clean DOM to read.
Lets you write deterministic Playwright for the steps you already know and drop into natural language only where the page is unpredictable. That mix is the pragmatic middle ground: fully AI-driven automation is slow and flaky, fully scripted automation breaks on redesigns.
Combines vision with DOM analysis so a flow keeps working when a site is redesigned — the failure mode that kills conventional selector-based scripts. Note the AGPL licence: if you intend to offer it as a network service, read the terms before you build on it.