☆ Yσɠƚԋσʂ ☆@lemmy.ml to AI@lemmy.mlEnglish · 18 days agoStop Thinking of LLMs as Next-Token Predictorsgmcgoldr.github.ioexternal-linkmessage-square23linkfedilinkarrow-up110arrow-down110
arrow-up10arrow-down1external-linkStop Thinking of LLMs as Next-Token Predictorsgmcgoldr.github.io☆ Yσɠƚԋσʂ ☆@lemmy.ml to AI@lemmy.mlEnglish · 18 days agomessage-square23linkfedilink
minus-squarereallykindasorta@slrpnk.netlinkfedilinkarrow-up4arrow-down3·17 days agoYeah and he basically argues that you shouldn’t see it as next-token even though he agrees that it is lol
minus-squarem532@lemmygrad.mllinkfedilinkarrow-up4arrow-down2·17 days agoAnd a mouse is technically a blob of molecules. But does calling a mouse a blob of molecules explain why it moves away from cats?
minus-squarefreagle@lemmy.mllinkfedilinkEnglisharrow-up2arrow-down3·17 days agoBut it’s different because “it does it’s own exploration of infinite space which is exactly like knowing how to win all chess positions through a brute force solution to the finite game space”
Yeah and he basically argues that you shouldn’t see it as next-token even though he agrees that it is lol
And a mouse is technically a blob of molecules. But does calling a mouse a blob of molecules explain why it moves away from cats?
But it’s different because “it does it’s own exploration of infinite space which is exactly like knowing how to win all chess positions through a brute force solution to the finite game space”