vermaterc@lemmy.ml to AI@lemmy.mlEnglish · 2 months agoMaking Claude talk like caveman to cut 75% of tokensgithub.comexternal-linkmessage-square6linkfedilinkarrow-up147arrow-down14
arrow-up143arrow-down1external-linkMaking Claude talk like caveman to cut 75% of tokensgithub.comvermaterc@lemmy.ml to AI@lemmy.mlEnglish · 2 months agomessage-square6linkfedilink
minus-squareVibeSurgeon@piefed.sociallinkfedilinkEnglisharrow-up6·2 months agoIt’s likely that you’ll get reduced performance from this, as blowing up the token count is part of getting a marginal amount of increased performance out of the models. Funny though, as is most discoveries related to emergent LLM properties
It’s likely that you’ll get reduced performance from this, as blowing up the token count is part of getting a marginal amount of increased performance out of the models.
Funny though, as is most discoveries related to emergent LLM properties