stabby_cicada@slrpnk.net to solarpunk memes@slrpnk.net · 24 hours agoone more shitty techbrofad downslrpnk.netimagemessage-square107fedilinkarrow-up1395arrow-down144file-text
arrow-up1351arrow-down1imageone more shitty techbrofad downslrpnk.netstabby_cicada@slrpnk.net to solarpunk memes@slrpnk.net · 24 hours agomessage-square107fedilinkfile-text
minus-squarePriorityMotif@lemmy.worldlinkfedilinkarrow-up3·2 hours agoYou can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
minus-squareTherapyGary@lemmy.blahaj.zonelinkfedilinkarrow-up3·1 hour agoYou can already run 3B llms on cheap phones using MLCChat, it’s just hella slow
You can run it on your own machine. It won’t work on a phone right now, but I guarantee chip manufacturers are working on a custom SOC right now which will be able to run a rudimentary local model.
You can already run 3B llms on cheap phones using MLCChat, it’s just hella slow