Source item
Open original source ↗I have been thinking about @mattwridley’s book quite a bit while studying LLM evolution. Especially when a model can train or learn from another model. Now, what if in a single country there were four open models that could all learn from each other?
Quoted context
These are the quoted author’s words.
Matt Ridley: "Innovation happens when ideas have sex." "next-token learning is myopic and memorizes excessively; comparatively, multi-token approaches, namely teacherless training and diffusion models, excel in producing diverse and original output." https://t.co/qir4PGLwCG
trengriffin ↗