Cheap CUDA cards

Does anyone know a good place to get cheap (NVIDIA) graphics cards besides eBay (to the U.S.)? I’m currently using two (pre-owned) GTX 1060’s to train Rhasspy speech models and voices, and I’d like to either get more or something better.

Thanks to the 30xx shortages, it seems like all the good CUDA cards (1080 ti, 2080 ti) are holding their values, even used. I know there are cloud services like co-lab, but I’d like to keep things local :slight_smile:

Have you looked at the Coral USB adapter?
Not sure if that’s in the same ballpark as CUDA.

Update… It might be after looking at this writeup.

1 Like

This sounds like a great way to donate to your efforts! Want to DM me a link to something you’d like? I’m happy to help!

1 Like

make a amazon wishlist! or a donation option :slight_smile:

2 Likes

It looks good for inference, but I need CUDA for training new models. I do wonder if we could get the TTS voices to run on one of the Coral adapters though…

It would be, thank you for the offer :slight_smile: Looking at even the used prices, though, it’s a bit much for a donation. The GTX 1060 6GB (what I currently have) is around $150 on eBay pre-owned!

Here are the cards I’ve been looking at:

Name CUDA cores Memory Cost (used)
GTX 1060 1280 6 GB $150
GTX 1080 Ti 3584 11 GB $350
RTX 2070 Super 2560 8 GB $450
RTX 2080 Ti 4352 11 GB $950

These seem to be the best performance-per-dollar according to Tim Dettmers. I can’t believe the cards from two generations back are still so expensive!

Love the name and profile pic @kahless :smiley:

You guys are great, but I’m really hesitant to accept any money just in case there’s some kind of conflict with my job. But if someone has a cheap card they’re willing to sell, that seems fine :wink:

Love the name and profile pic @kahless :smiley:

You guys are great, but I’m really hesitant to accept any money just in case there’s some kind of conflict with my job. But if someone has a cheap card they’re willing to sell, that seems fine :wink:

:slight_smile:

1 Like

these used cards are still holding their value because are still profitable on crypto-mining

Ah, this makes sense. I was excited when I read that the P106-100 mining cards could be used for machine learning, only to find out that they’re now more expensive than the (equivalent) 1060 6GB’s which actually have display output!

I know these commodity cards wouldn’t exist if not for the market, but it’s frustrating having to compete with gamers and miners (and the scalpers among them) for hardware. NVIDIA’s “enterprise” cards are just laughably expensive, so until AMD gets RoCM up to a usable level, I’ll have to outbid kids wanting more FPS in Fortnite for cards :confused: