XDA Developers on MSN

Nvidia stopped supporting my GPU, so I started self-hosting LLMs with it

I self-support my gpu now because Nvidia won't ...
GitHub

Get up and running with large language models.

Example extra list add on this repo. (ROCm5) "gfx803" "gfx900:xnack-" "gfx902" (ROCm6) gfx906:xnack- "gfx1010:xnack-" "gfx1011" "gfx1012:xnack-" "gfx1031" "gfx1032 ...