Source item
Open original source ↗this is great work - we need better measurement techniques for performance and generalization
Quoted context
These are the quoted author’s words.
(Yet) another tale of Rise and Fall: DeepSeek R1 is claimed to match o1/o1-preview on olympiad level math & coding problems. Can it handle versions of AIW problems that reveal generalization & basic reasoning deficits in SOTA LLMs? (https://t.co/nHlKJFQuRn) 🧵1/n https://t.co/GHnnsHa74j
JJitsev ↗