[SOLVED] GPU acceleration with ollama

o5gmmob8 · l33t Joined: 17 Oct 2003 Posts: 614

This may be a silly question, but if I want to fully utilize my GPU with ollama, I need to use the nvidia drivers, correct?

Conversely, I cannot use nvidia with sway, only nouveau. So, if I want to use ollama, then perhaps another option with my current setup is - I should run it on a headless server where the GPU is just used for acceleration and I connect to it remotely on whatever machine I have.

Another option might be to use another GPU altogether like an Intel Arc and AMD which may appear to have better support in both sway and ollama.

fedeliallalinea · Posted: Mon Mar 17, 2025 6:16 am Post subject:

Yes for use gpu acceleration you need nvidia-drivers.
Ollama not support Intel ARC official but AMD does.
The third option is to change WM to one that supports nvidia.
_________________
Questions are guaranteed in life; Answers aren't.

"Those who would give up essential liberty to purchase a little temporary safety,
deserve neither liberty nor safety."
- Ben Franklin
https://www.news.admin.ch/it/nsb?id=103968

o5gmmob8 · l33t Joined: 17 Oct 2003 Posts: 614

Ok, that makes sense.

I tried installing nvidia-drivers-470 and it is masked for a reason, it is advised not to use it with kernels newer than 6.6, so I guess I'm stuck between a rock and a hard place.

This hardware is ancient, so that makes sense, get something newer, maintained and supported and it should work.

I glanced over the Arch Linux wiki page: https://wiki.archlinux.org/title/NVIDIA and it seems to allude to nvidia working with wayland provided a few things are configured.

logrusx · Advocate Joined: 22 Feb 2018 Posts: 3033

o5gmmob8 · l33t Joined: 17 Oct 2003 Posts: 614

I had it running, but it is one or the other. I was just trying to see if I can have both.