Source item

There was a pretty funny anecdotal complaint from the Machine Learning $RDDT subreddit. On $CBRS + OpenAI: - Needs 1-2K tokens/sec so tries to use Cerebras. - Claims OpenAI reserved all capacity, making waitlist infinite for everyone else not a hyperscaler. - Stated alternatives with Groq’s API not accessible to them Feels bad. But it does show how few players / limited capacity there is for fast inference.