minus-squareAliasAKA@lemmy.worldtoTechnology@lemmy.world•Leak confirms OpenAI is preparing ads on ChatGPT for public roll outlinkfedilinkEnglisharrow-up2·9 days agoYou can get by surprisingly well on 20b parameter models using a Mac with decent ram or even 8b parameter models that fit on most high end (eg 16gb) model cards. Depends on your use cases but I almost exclusively use smaller local models. linkfedilink
You can get by surprisingly well on 20b parameter models using a Mac with decent ram or even 8b parameter models that fit on most high end (eg 16gb) model cards. Depends on your use cases but I almost exclusively use smaller local models.