• blargerer@kbin.social
    link
    fedilink
    arrow-up
    11
    ·
    8 months ago

    The P in GPT is Pretrained. Its core to the architecture design. You would need to use some other ANN design if you wanted it to continuously update, and there is a reason we don’t use those at scale atm, they scale much worse than pretrained transformers.