sanitation@lemmy.today to Programmer Humor@programming.dev · 19 hours agoNew compression techniquelemmy.todayimagemessage-square132linkfedilinkarrow-up1970arrow-down114file-text
arrow-up1956arrow-down1imageNew compression techniquelemmy.todaysanitation@lemmy.today to Programmer Humor@programming.dev · 19 hours agomessage-square132linkfedilinkfile-text
minus-squareSorryQuick@lemmy.calinkfedilinkarrow-up3·5 hours agoSaves input tokens and uses more output because of OCR, and output is priced way higher.
minus-squareboonhet@sopuli.xyzlinkfedilinkarrow-up1·2 hours agoAlso if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
Saves input tokens and uses more output because of OCR, and output is priced way higher.
Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol