Anthropic

Today, we're introducing an upgraded Claude 3.5 Sonnet, and a new model, Claude 3.5 Haiku. We’re also introducing a new capability in public beta: computer use. With computer use, developers can direct Claude to use computers the way people do—by looking at a screen, moving a cursor, clicking, and typing text. The new Claude 3.5 Sonnet is the first frontier AI model to offer computer use in public beta. While groundbreaking, computer use is still experimental—at times error-prone. We're releasing it early for feedback from developers. We've built an API that allows Claude to perceive and interact with computer interfaces. This API enables Claude to translate prompts into computer commands. Developers can use it to automate repetitive tasks, conduct testing and QA, and perform open-ended research. We're trying something fundamentally new. Instead of making specific tools to help Claude complete individual tasks, we're teaching it general computer skills—allowing it to use a wide range of standard tools and software programs designed for people. Claude 3.5 Sonnet's current ability to use computers is imperfect. Some actions that people perform effortlessly—scrolling, dragging, zooming—currently present challenges. We encourage exploration with low-risk tasks. Beyond computer use, the new Claude 3.5 Sonnet delivers significant gains in coding—an area where it already led the field. Sonnet scores higher on SWE-bench Verified than all available models—including reasoning models like OpenAI o1-preview and specialized models for agentic coding. Claude 3.5 Haiku is the next generation of our fastest model. Haiku now outperforms many state-of-the-art models on coding tasks—including the original Claude 3.5 Sonnet and GPT-4o—at the same cost as before. The new Claude 3.5 Haiku will be released later this month. We believe these developments will open up new possibilities for how you work with Claude, and we look forward to seeing what you'll create. Read the updates in full: https://lnkd.in/dBDxDTZF

Claude can now view images within a PDF, in addition to text. Enable the feature preview to get started: https://claude.ai/new?fp=1. This helps Claude 3.5 Sonnet more accurately understand complex documents, such as those laden with charts or graphics. The Anthropic API now also supports PDF inputs in beta: https://lnkd.in/emvau9Ez

See how Claude helps Hebbia deliver AI-powered document analysis to top financial and legal institutions, turning thousands of pages into actionable insights. https://lnkd.in/e4DnFAxs

You can now dictate messages to Claude on our iPhone, iPad, and Android apps. Download on Google Play: anthropic.com/android. Or on the Apple App Store: anthropic.com/ios.

The Claude app is now available to download on Mac and Windows: claude.ai/download.

Claude is now available on GitHub Copilot. Starting today, developers can select Claude 3.5 Sonnet in Visual Studio Code and GitHub.com. Access will roll out to all Copilot Chat users and organizations over the coming weeks. https://lnkd.in/eaJG3wwM

Claude can now write and run code. We've added a new analysis tool. The tool helps Claude respond with mathematically precise and reproducible answers. You can then create interactive data visualizations with Artifacts. Enable the feature preview by toggling it on here: https://claude.ai/new?fp=1. Or read more about the updates: https://lnkd.in/eMM9KSz8.

In this demo, Claude orchestrates a multi-step task by searching the web, using native applications, and creating a plan with the resulting information. Claude's computer use capabilities, while groundbreaking, remain experimental. We're gathering feedback from developers during this early release. Claude is generating all the computer actions shown here. This demonstration was recorded in a controlled environment, with some supporting infrastructure simplified to highlight the core capabilities. Read more about Claude and computer use: https://lnkd.in/dBDxDTZF

In this demo, Claude creates a themed website—generating code, launching a server, and fixing its own mistakes. While groundbreaking, computer use is still experimental—at times prone to errors. We're releasing computer use early for feedback from developers. Claude is generating all the computer actions shown here. This demonstration was recorded in a controlled environment, with some supporting infrastructure simplified to highlight the core capabilities. Read more about Claude and computer use: https://lnkd.in/dBDxDTZF

How we developed computer use, Claude's newest ability: https://lnkd.in/deXD7TKQ