Otter Raft@lemmy.ca to Selfhosted@lemmy.worldEnglish · 11 days agoGPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technicaarstechnica.comexternal-linkmessage-square58linkfedilinkarrow-up166arrow-down12
arrow-up164arrow-down1external-linkGPU prices are coming to earth just as RAM costs shoot into the stratosphere - Ars Technicaarstechnica.comOtter Raft@lemmy.ca to Selfhosted@lemmy.worldEnglish · 11 days agomessage-square58linkfedilink
minus-squareNotMyOldRedditName@lemmy.worldlinkfedilinkEnglisharrow-up0·11 days agoIt does work, but it’s not really fast. I upgraded to 96gb ddr4 from 32gb a year or so ago, and being able to play with the bigger models was fun, but it’s not something I could do anything productive with it was so slow.
minus-squarePossibly linux@lemmy.ziplinkfedilinkEnglisharrow-up1·11 days agoYour bottle necked by memory bandwidth You need ddr5 with lots of memory channels for it to he useful
It does work, but it’s not really fast. I upgraded to 96gb ddr4 from 32gb a year or so ago, and being able to play with the bigger models was fun, but it’s not something I could do anything productive with it was so slow.
Your bottle necked by memory bandwidth
You need ddr5 with lots of memory channels for it to he useful