It’s no surprise that NVIDIA is gradually dropping support for older videocards, with the Pascal (GTX 10xx) GPUs most recently getting axed. What’s more surprising is the terrible way t…
I mean… my 6700xt dont have offical rocm support, but the rocm driver works perfectly fine for it. The difference is amd hasnt but the effort in testing rocm on their consumer cards, thus cant make claims support for it.
Removed by mod
I successfully ran local Llama with llama.cpp and an old AMD GPU. I’m not sure why you think there’s no other option.
Removed by mod
I mean… my 6700xt dont have offical rocm support, but the rocm driver works perfectly fine for it. The difference is amd hasnt but the effort in testing rocm on their consumer cards, thus cant make claims support for it.
Removed by mod
Llama.cpp now supports Vulkan, so it doesn’t matter what card you’re using.
Removed by mod
ML?
Removed by mod
Is that a huge deal for the average user?
Removed by mod