Track_Shovel@slrpnk.net to Microblog Memes@lemmy.worldEnglish · 2 days agoSubscription based KPIsslrpnk.netimagemessage-square135linkfedilinkarrow-up11.1Karrow-down125
arrow-up11.07Karrow-down1imageSubscription based KPIsslrpnk.netTrack_Shovel@slrpnk.net to Microblog Memes@lemmy.worldEnglish · 2 days agomessage-square135linkfedilink
minus-squarethefluffiest@feddit.nllinkfedilinkEnglisharrow-up3·2 days agoThat’s just not true. They might steal from the American models, but they don’t depend on them.
minus-squaretyler@programming.devlinkfedilinkEnglisharrow-up4·2 days agoThey literally use them as base models for compression.
minus-squarejonathan@piefed.sociallinkfedilinkEnglisharrow-up3·2 days agoHow do they do that exactly?
minus-squarecrunchy@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up3·2 days agoIt’s a process called distillation. One way of doing it is creating thousands of accounts to prompt a big flagship model, then use the output to pre-train their own model.
That’s just not true. They might steal from the American models, but they don’t depend on them.
They literally use them as base models for compression.
How do they do that exactly?
It’s a process called distillation. One way of doing it is creating thousands of accounts to prompt a big flagship model, then use the output to pre-train their own model.