sanitation@lemmy.today to Programmer Humor@programming.dev · 20 hours agoNew compression techniquelemmy.todayimagemessage-square147linkfedilinkarrow-up11.03Karrow-down115file-text
arrow-up11.02Karrow-down1imageNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 20 hours agomessage-square147linkfedilinkfile-text
minus-squareboonhet@sopuli.xyzlinkfedilinkarrow-up1·4 hours agoAlso if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol