• ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
    link
    fedilink
    arrow-up
    3
    ·
    1 day ago

    Right, there’s this assumption that LLM improvements will just keep scaling indefinitely. It’s far more likely that that the architecture has limits which we seem to be approaching, and then you just get diminishing returns, so the graph looks more like a sigmoid where we saw a ton of rapid progress, and it starting to flatten out as the easy gains get plucked.