Source item
Open original source ↗The problem is that no one believes Anthropic or any other major model lab is going to slow down.
In fact, they are incentivized to do the exact opposite, which is why they are investing more resources right now in R&D than ever before.
Dario is essentially arguing that Anthropic will open-source their technology to third-party evaluators, but he is unwilling to open-source the technology for everyone.
This type of "one foot in, one foot out" approach won't satisfy the public, nor will it accomplish Anthropic's stated goals.
They really only have two options: 1) fully open-source the technology or 2) bet the company on winning the ASI race as the monopolistic closed-source winner.
Since they won't open-source the technology, we should expect Anthropic and every other model lab to accelerate in the coming months. Recursive learning will ensure the acceleration will be faster than we all previously thought possible too.
I use products from Anthropic, OpenAI, xAI, Google, @cfosilvia, etc on a daily basis. This technology has fundamentally changed my life for the better. I would bet my optimistic experience is more prevalent than the doomer view.
With that said, it is commendable that AI leaders are issuing words of caution publicly, yet they know privately that economics make their promises impossible to fulfill.
Quoted context
These are the quoted author’s words.
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: https://t.co/OGyPb7yaYt
DarioAmodei ↗