Source item
Open original source ↗Interesting.
Quoted context
These are the quoted author’s words.
It's only a matter of time before only the model creators have access to the most powerful models. The rest get access to smaller, distilled versions. Or access the models through first party apps and services that don't provide direct access to the token path. The investment needs for training are too high, and distillation too effective to warrant any other future.
martin_casado ↗