• scruiser@awful.systems
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 day ago

    They’ve been talking about the recurrent layers… but my suspicion is that this “innovation” is to obfuscate “thinking” tokens/content instead of actually improving the model in any sort of useful way.