• hoshikarakitaridia@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    17 days ago

    AI or servers probably. I have 40gb and that’s what I would need more ram for.

    I’m still salty because I had the idea of going cpu & ram sticks for AI inference literally days before the big AI companies. And my stupid ass didn’t buy them in time before the prices skyrocketed. Fuck me I guess.

    • panda_abyss@lemmy.ca
      link
      fedilink
      English
      arrow-up
      0
      ·
      17 days ago

      I’m often using 100gb of cram for ai.

      Earlier this year I was going to buy a bunch of 1tb ram used servers and I wish I had.

        • kossa@feddit.org
          link
          fedilink
          English
          arrow-up
          2
          ·
          16 days ago

          Yep, used ECC server RAM DDR3 or DDR4 is basically thrown out. Unfortunately most consumer mainboards do not support ECC.

          • hoshikarakitaridia@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            16 days ago

            This is exactly the reason I’m about to order a dell poweredge r630 with Intel xeon 2680 v4 from alibaba.

            Also I’ve never ordered from alibaba before so we’ll see if I get scammed xd

    • NotMyOldRedditName@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      17 days ago

      It does work, but it’s not really fast. I upgraded to 96gb ddr4 from 32gb a year or so ago, and being able to play with the bigger models was fun, but it’s not something I could do anything productive with it was so slow.