

I’m not who you replied to but… I’ve run a bunch of models through https://github.com/Mozilla-Ocho/llamafile and https://ollama.com/. I’m lucky enough to have a decent video-card (24GB), but if you are willing to be a bit more paitient, or run a lower model, you’ll probably be able to get it going.
Copying is Not Theft