Source item
Open original source ↗Step 1. Everyone experiments.
Step 2. The leaders start commoditizing features and make them much better for themselves.
Step 3. Turn the crank on costs and make each capability high margin.
As goes Databricks, others will follow. As a result, token consumption will explode but cost per token will crater because these companies won’t tolerate rent seeking behavior from models on performing generalized tasks that can be done by many providers.
Quoted context
These are the quoted author’s words.
An extremely important functionality for agents is to simply extract fields out of PDFs. This turns out to be harder than people think because LLMs are primarily trained on predicting the next tokens. This leads them to "autocorrect" things that they shouldn't autocorrect. We launched an AI Extract capability that just excels at doing just this task with very high accuracy (95% vs 87% for others) and extremely low cost. Check out this blog on how we did it. The function can of course be called directly from SQL and be used throughout the platform. https://t.co/60XC2mIZ2E
alighodsi ↗