Anthropic publicly releases AI tool that can take over the user’s mouse cursor
Anthropic's new Computer Use tool can take control of users' mouse cursors and perform basic tasks on their computers. It is now available exclusively with Anthropic's mid-range 3.5 Sonnet model via the API. It works by taking rapid successive screengrabs, so it can miss short-lived notifications and other changes and is incapable of some common actions like drag-and-drop. The tool is still cumbersome and error-prone at times. A video from Anthropic explaining the tool is available in the article.