A new blog post by OpenAI Principal Scientist Jakub Pachocki discusses the potential limits of AI development, focusing on a measurement called perplexity.
The slowdown in AI development was particularly hot topic after a former OpenAI and Anthropic researcher said the companies were “risking their lives,” and Anthropic’s IPO filing suggested the technology could pose “catastrophic or existential risks to society.”
Anthropic CEO Dario Amodei then announced plans to “set the pace on the frontier,” which OpenAI CEO Sam Altman and SpaceX CEO Elon Musk appear to have endorsed. Among other things, Amodei called on companies to agree to “common safety standards and limits on the rate of unchecked AI progress.”
But setting speed limits for AI development requires agreed speed measurements. Pachocki’s post, which Altman described as “the most important thing OpenAI has published in a while,” suggests that confusion (not to be confused with the company of the same name) may be the measure.
Pachoczky argues that benchmarks that focus on AI’s “downstream functions” are quickly becoming outdated as technology advances. But perplexity (which measures how accurately a model predicts the next token on average; lower perplexity means better prediction) is still “informative.”
Pachochki’s post includes a graph showing how the complexity of OpenAI models has decreased since GPT 3.5.
“GPT‑4, at approximately 0.91, was adept at making productive use of thought-chain reasoning, and this motivated the subsequent targeted exploitation of this ability and the creation of modern reasoning models,” he wrote. “Losses are now below 0.8, and innovative capabilities are emerging in areas such as cybersecurity and mathematics.”
In his view, perplexity thus provides the basis for a “shared benchmark of general intelligence” that AI companies could use to establish “common limits.” As perplexity serves as a standard measure of AI progress, companies commit to not exceeding certain thresholds “until the ability to understand and monitor AI behavior reaches certain tangible milestones.”
If you buy through links in our articles, we may earn a small commission. This does not affect editorial independence.
