It’s hyped to all hell, but I think it will ultimately settle down to something used for many things and be mostly just assumed. But I doubt all this spend from hyperscalers will ultimately pay out the way it’s being framed.
My guess? Things get scaled down so much that for most purposes, even where you might use a “frontier” model now, you could use a local model and get enough token/sec.
Succeed in demonstrating that the “AI era” is a manufactured Wall St sell-side narrative.
It’s hyped to all hell, but I think it will ultimately settle down to something used for many things and be mostly just assumed. But I doubt all this spend from hyperscalers will ultimately pay out the way it’s being framed.
My guess? Things get scaled down so much that for most purposes, even where you might use a “frontier” model now, you could use a local model and get enough token/sec.