• just another dev@lemmy.my-box.dev
    link
    fedilink
    English
    arrow-up
    15
    ·
    5 months ago

    The problem with LLMs is that they require immense compute power.

    To train. But you can run a relatively simple one like phi-3 on quite modest hardware.