Best hardware for Gemma 4 31B
30.7B parameters · gemma family : per-quant VRAM needs, the used-GPU configs that fit, and how buying compares with renting cloud GPUs. Hardware costs sum the cheapest listings that passed our trust screen, one per card the config needs (screened, not guaranteed). Eligible purchases are covered by the eBay Money Back Guarantee if an item never arrives or doesn't match its description.
Q4_K_M
Minimum VRAM: 21.22 GB (file 18.3 GB + context/runtime headroom at 8k ctx; see methodology).
Cheapest fitting cloud offer: Vast.ai $0.116/hr (rtx-3090 class, on-demand) · cloud prices checked 2026-07-31.
| Config | Total VRAM | Cheapest screened hw cost | Est. watts | Tokens/sec | Breakeven vs cloud | Verdict |
|---|---|---|---|---|---|---|
| 1× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 24 GB | $270
report
400 feedback (100%) · no returns · listed 3 days | 325 W | – | 27 mo | Renting wins at 40 h/mo |
| 2× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 48 GB | $550 2 screened listings: $270 + $280 + shipping unknown on 1 of 2 listings
report
400 feedback (100%) · no returns · listed 3 days | 575 W | – | 152 mo | Renting wins at 40 h/mo |
| 1× NVIDIA TITAN RTX | 24 GB | $850
report
12,733 feedback (99.6%) · Top Rated seller · returns accepted · listed 21 days | 355 W | – | 84 mo | Renting wins at 40 h/mo |
| 1× AMD Radeon RX 7900 XTX | 24 GB | $898
report
2,597 feedback (99.6%) · Top Rated seller · returns accepted · listed 1 day | 430 W | – | 158 mo | Renting wins at 40 h/mo |
| 4× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 96 GB | $1,140 4 screened listings: $270 + $280 + $290 + $300 + shipping unknown on 2 of 4 listings
report
400 feedback (100%) · no returns · listed 3 days | 1075 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA GeForce RTX 3090 | 24 GB | $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 425 W | – | 205 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 3090 Ti | 24 GB | $1,350
report
5,792 feedback (99.8%) · Top Rated seller · returns accepted · listed 1 day | 525 W | – | 343 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A5000 | 24 GB | $2,140
report
39,358 feedback (99.7%) · Top Rated seller · returns accepted · listed 21 days | 305 W | – | 263 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 3090 | 48 GB | $2,480 2 screened listings: $1,240 + $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 775 W | – | never | Cloud always cheaper at this power price |
| 1× NVIDIA GeForce RTX 4090 | 24 GB | $2,497
report
4,757 feedback (99.4%) · returns accepted · listed 21 days | 525 W | – | 599 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A6000 | 48 GB | $3,949
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 375 W | – | 599 mo | Renting wins at 40 h/mo |
| 1× NVIDIA GeForce RTX 5090 | 32 GB | $4,500
report
151 feedback (99.2%) · Top Rated seller · returns accepted · listed 21 days | 650 W | – | 3,355 mo | Renting wins at 40 h/mo |
| 4× NVIDIA GeForce RTX 3090 | 96 GB | $4,974 4 screened listings: $1,240 + $1,240 + $1,245 + $1,249
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 1475 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA GeForce RTX 4090 | 48 GB | $4,997 2 screened listings: $2,497 + $2,500
report
4,757 feedback (99.4%) · returns accepted · listed 21 days | 975 W | – | never | Cloud always cheaper at this power price |
| 2× NVIDIA RTX A6000 | 96 GB | $7,948 2 screened listings: $3,949 + $3,999
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 675 W | – | 8,285 mo | Renting wins at 40 h/mo |
Fits, but not currently buyable as a set: 2× NVIDIA RTX A5000 (48 GB) needs 2 screened cards and the market has 1; 4× NVIDIA RTX A5000 (96 GB) needs 4 screened cards and the market has 1. We price a multi-card build from that many separate listings, so it stays unpriced until they exist.
- Configs without a screened purchase option are hidden until listings clear the trust screen (a multi-day survival window on eBay).
- Multi-card costs are the sum of that many separate screened listings; the cheapest listing counted twice is not a price anyone can pay. Prices exclude the PSU, board and case a multi-card build usually also needs.
- Tokens/sec: benchmarks coming; every number will be source-linked. We never publish unattributed performance figures.
- Breakeven and verdict use default assumptions (40 h/mo, $0.16/kWh, 24-month horizon, resale at 65% of median ask); adjust them in the calculator. Hardware links are screened, not guaranteed.
Run your own numbers for Gemma 4 31B (Q4_K_M) in the buy-vs-rent calculator →
Q8_0
Minimum VRAM: 36.23 GB (file 32.6 GB + context/runtime headroom at 8k ctx; see methodology).
Cheapest fitting cloud offer: RunPod $0.33/hr (rtx-a6000 class, on-demand) · cloud prices checked 2026-08-01.
| Config | Total VRAM | Cheapest screened hw cost | Est. watts | Tokens/sec | Breakeven vs cloud | Verdict |
|---|---|---|---|---|---|---|
| 2× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 48 GB | $550 2 screened listings: $270 + $280 + shipping unknown on 1 of 2 listings
report
400 feedback (100%) · no returns · listed 3 days | 575 W | – | 16 mo | Buying wins by month 16 |
| 4× NVIDIA Tesla P40
passive card, needs an added fan/shroud
| 96 GB | $1,140 4 screened listings: $270 + $280 + $290 + $300 + shipping unknown on 2 of 4 listings
report
400 feedback (100%) · no returns · listed 3 days | 1075 W | – | 53 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 3090 | 48 GB | $2,480 2 screened listings: $1,240 + $1,240
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 775 W | – | 96 mo | Renting wins at 40 h/mo |
| 1× NVIDIA RTX A6000 | 48 GB | $3,949
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 375 W | – | 125 mo | Renting wins at 40 h/mo |
| 4× NVIDIA GeForce RTX 3090 | 96 GB | $4,974 4 screened listings: $1,240 + $1,240 + $1,245 + $1,249
report
39,860 feedback (99.7%) · returns accepted · listed 14 days | 1475 W | – | 425 mo | Renting wins at 40 h/mo |
| 2× NVIDIA GeForce RTX 4090 | 48 GB | $4,997 2 screened listings: $2,497 + $2,500
report
4,757 feedback (99.4%) · returns accepted · listed 21 days | 975 W | – | 223 mo | Renting wins at 40 h/mo |
| 2× NVIDIA RTX A6000 | 96 GB | $7,948 2 screened listings: $3,949 + $3,999
report
23,219 feedback (99.9%) · Top Rated seller · returns accepted · listed 21 days | 675 W | – | 310 mo | Renting wins at 40 h/mo |
Fits, but not currently buyable as a set: 2× NVIDIA RTX A5000 (48 GB) needs 2 screened cards and the market has 1; 4× NVIDIA RTX A5000 (96 GB) needs 4 screened cards and the market has 1. We price a multi-card build from that many separate listings, so it stays unpriced until they exist.
- Configs without a screened purchase option are hidden until listings clear the trust screen (a multi-day survival window on eBay).
- Multi-card costs are the sum of that many separate screened listings; the cheapest listing counted twice is not a price anyone can pay. Prices exclude the PSU, board and case a multi-card build usually also needs.
- Tokens/sec: benchmarks coming; every number will be source-linked. We never publish unattributed performance figures.
- Breakeven and verdict use default assumptions (40 h/mo, $0.16/kWh, 24-month horizon, resale at 65% of median ask); adjust them in the calculator. Hardware links are screened, not guaranteed.
Run your own numbers for Gemma 4 31B (Q8_0) in the buy-vs-rent calculator →