GPUs that fit
| GPU | VRAM | Versions |
|---|---|---|
| RTX 2080 | 8 GiB | 1 |
| RTX 3070 | 8 GiB | 1 |
| RTX 4060 | 8 GiB | 1 |
| RTX 4060 Ti | 8 GiB | 1 |
| RTX 3080 | 10 GiB | 1 |
| RTX 2080 Ti | 11 GiB | 1 |
| RTX 3060 | 12 GiB | 1 |
| RTX 4070 | 12 GiB | 1 |
| RTX 4070 Ti | 12 GiB | 1 |
| RTX 4080 | 16 GiB | 1 |
| A10 | 24 GiB | 1 |
| A30 | 24 GiB | 1 |
| L4 | 24 GiB | 1 |
| RTX 3090 | 24 GiB | 1 |
| RTX 4090 | 24 GiB | 1 |
| RTX 5090 | 32 GiB | 1 |
| A100 40GB | 40 GiB | 1 |
| A40 | 48 GiB | 1 |
| L40 | 48 GiB | 1 |
| A100 80GB | 80 GiB | 1 |
| H100 80GB | 80 GiB | 1 |