| View previous topic :: View next topic |
| Author |
Message |
seb95passionlinux
n00b
Joined: 27 Oct 2024
Posts: 15
Location: France
|
 Posted: Tue Jun 10, 2025 9:28 am Post subject: Ollama Error: POST predict: Post EOF |
 |
|
Hello, I'm using Ollama from Guru. Until now, it was fine. I had the GPU via Cuda, and everything worked fine. Then, recently, the Ollama build asked me to upgrade to dev-util/nvidia-cuda-toolkit-12.9.0 to satisfy its installation. Since then, no matter what I do, I get this:
| Code: | ollama run llama3.2
>>> ça va?
Error: POST predict: Post "http://127.0.0.1:43593/completion": EOF |
| Code: | [sebastien@passionlinuxgentoo ~]$ ollama run llama3.2
>>> racontes moi l'histoire de France
Error: POST predict: Post "http://127.0.0.1:36375/completion": EOF
[sebastien@passionlinuxgentoo ~]$ |
Some info:
| Code: | [I] dev-util/nvidia-cuda-toolkit
Available versions: ~11.8.0-r4(0/11.8.0)^md ~12.3.2(0/12.3.2)^md ~12.4.1(0/12.4.1)^md ~12.5.1(0/12.5.1)^md ~12.6.3-r1(0/12.6.3)^mstd ~12.8.1-r1(0/12.8.1)^mstd (~)12.9.0(0/12.9.0)^mstd {clang debugger examples nsight profiler rdma sanitizer vis-profiler PYTHON_TARGETS="python3_11 python3_12 python3_13"}
Installed versions: 12.9.0(0/12.9.0)^mstd(01:48:51 09/06/2025)(-clang -debugger -examples -nsight -profiler -rdma -sanitizer PYTHON_TARGETS="python3_13 -python3_11 -python3_12")
Homepage: https://developer.nvidia.com/cuda-zone
Description: NVIDIA CUDA Toolkit (compiler and friends)
[I] sci-ml/ollama [1]
Available versions: (~)0.6.5-r1^s (~)0.6.6^s (~)0.6.8^st (~)0.7.0^st (~)0.7.1^st **9999*l^st {blas cuda mkl rocm AMDGPU="+targets_gfx90a targets_gfx803 targets_gfx900 +targets_gfx906 +targets_gfx908 targets_gfx940 targets_gfx941 +targets_gfx942 targets_gfx1010 targets_gfx1011 targets_gfx1012 +targets_gfx1030 targets_gfx1031 +targets_gfx1100 targets_gfx1101 targets_gfx1102" CPU_FLAGS_X86="amx_int8 amx_tile avx avx2 avx512_bf16 avx512_vnni avx512f avx512vbmi avx_vnni bmi2 f16c fma3 sse4_2"}
Installed versions: 0.7.1^st(02:46:03 09/06/2025)(cuda -blas -mkl -rocm AMDGPU="targets_gfx90a targets_gfx906 targets_gfx908 targets_gfx942 targets_gfx1030 targets_gfx1100 -targets_gfx803 -targets_gfx900 -targets_gfx940 -targets_gfx941 -targets_gfx1010 -targets_gfx1011 -targets_gfx1012 -targets_gfx1031 -targets_gfx1101 -targets_gfx1102" CPU_FLAGS_X86="avx avx2 f16c fma3 sse4_2 -avx512_vnni -avx512f -avx512vbmi -avx_vnni -bmi2")
Homepage: https://ollama.com
Description: Get up and running with Llama 3, Mistral, Gemma, and other language models.
|
I'm trying to test it without cuda support and will give the result here.
_________________
La source c'est la vie... |
|
| Back to top |
|
 |
seb95passionlinux
n00b
Joined: 27 Oct 2024
Posts: 15
Location: France
|
| Posted: Tue Jun 10, 2025 9:43 am Post subject: |
|
|
It works, so it's the change of cuda that makes it stuck, but I had tested with the old version and I had the same.
| Code: | ollama run llama3.2
>>> racontes moi l'histoire de France
Quelle tâche ! L'histoire de la France est riche et complexe, étendue sur des millénaires. Je vais essayer de vous donner un aperçu général, mais gardez à l'esprit que cette histoire est en constante évolution.
**Les Origines (à partir du VIIIe siècle avant J.-C.) [...]**
|
Here are my Cuda changes:
| Code: | genlop -l | grep nvidia-cuda-toolkit
Sat Apr 5 03:13:29 2025 >>> dev-util/nvidia-cuda-toolkit-12.8.1
Fri May 2 11:36:51 2025 >>> dev-util/nvidia-cuda-toolkit-12.8.1
Sat Jun 7 22:43:19 2025 >>> dev-util/nvidia-cuda-toolkit-12.9.0
Mon Jun 9 01:49:46 2025 >>> dev-util/nvidia-cuda-toolkit-12.9.0 |
I tried to come back with the version of cuda which worked but nothing:
| Code: | grep nvidia-cuda-toolkit /var/log/emerge.log
1743815484: >>> emerge (6 of 7) dev-util/nvidia-cuda-toolkit-12.8.1 to /
1743815484: === (6 of 7) Cleaning (dev-util/nvidia-cuda-toolkit-12.8.1::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.8.1.ebuild)
1743815498: === (6 of 7) Compiling/Merging (dev-util/nvidia-cuda-toolkit-12.8.1::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.8.1.ebuild)
1743815596: === (6 of 7) Merging (dev-util/nvidia-cuda-toolkit-12.8.1::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.8.1.ebuild)
1743815607: >>> AUTOCLEAN: dev-util/nvidia-cuda-toolkit:0
1743815609: === (6 of 7) Post-Build Cleaning (dev-util/nvidia-cuda-toolkit-12.8.1::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.8.1.ebuild)
1743815609: ::: completed emerge (6 of 7) dev-util/nvidia-cuda-toolkit-12.8.1 to /
1746178447: >>> emerge (74 of 149) dev-util/nvidia-cuda-toolkit-12.8.1 to /
1746178447: === (74 of 149) Cleaning (dev-util/nvidia-cuda-toolkit-12.8.1::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.8.1.ebuild)
1746178466: === (74 of 149) Compiling/Merging (dev-util/nvidia-cuda-toolkit-12.8.1::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.8.1.ebuild)
1746178580: === (74 of 149) Merging (dev-util/nvidia-cuda-toolkit-12.8.1::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.8.1.ebuild)
1746178606: >>> AUTOCLEAN: dev-util/nvidia-cuda-toolkit:0
1746178606: === Unmerging... (dev-util/nvidia-cuda-toolkit-12.8.1)
1746178608: >>> unmerge success: dev-util/nvidia-cuda-toolkit-12.8.1
1746178611: === (74 of 149) Post-Build Cleaning (dev-util/nvidia-cuda-toolkit-12.8.1::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.8.1.ebuild)
1746178611: ::: completed emerge (74 of 149) dev-util/nvidia-cuda-toolkit-12.8.1 to /
1749328829: >>> emerge (1 of 4) dev-util/nvidia-cuda-toolkit-12.9.0 to /
1749328896: === (1 of 4) Cleaning (dev-util/nvidia-cuda-toolkit-12.9.0::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.9.0.ebuild)
1749328912: === (1 of 4) Compiling/Merging (dev-util/nvidia-cuda-toolkit-12.9.0::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.9.0.ebuild)
1749328974: === (1 of 4) Merging (dev-util/nvidia-cuda-toolkit-12.9.0::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.9.0.ebuild)
1749328993: >>> AUTOCLEAN: dev-util/nvidia-cuda-toolkit:0
1749328993: === Unmerging... (dev-util/nvidia-cuda-toolkit-12.8.1)
1749328995: >>> unmerge success: dev-util/nvidia-cuda-toolkit-12.8.1
1749328999: === (1 of 4) Post-Build Cleaning (dev-util/nvidia-cuda-toolkit-12.9.0::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.9.0.ebuild)
1749328999: ::: completed emerge (1 of 4) dev-util/nvidia-cuda-toolkit-12.9.0 to /
1749426232: *** emerge --ask --autounmask --autounmask-license=y --autounmask-use=y --complete-graph --deep --jobs=3 --keep-going --with-bdeps=y --getbinpkg --quiet --regex-search-auto=y --verbose --usepkg dev-util/nvidia-cuda-toolkit
1749426316: *** emerge --ask --autounmask --autounmask-license=y --autounmask-use=y --complete-graph --deep --jobs=3 --keep-going --with-bdeps=y --getbinpkg --quiet --regex-search-auto=y --verbose --usepkg dev-util/nvidia-cuda-toolkit
1749426426: *** emerge --ask --autounmask --autounmask-license=y --autounmask-use=y --complete-graph --deep --jobs=3 --keep-going --with-bdeps=y --getbinpkg --quiet --regex-search-auto=y --verbose --usepkg dev-util/nvidia-cuda-toolkit
1749426450: >>> emerge (1 of 1) dev-util/nvidia-cuda-toolkit-12.9.0 to /
1749426450: === (1 of 1) Cleaning (dev-util/nvidia-cuda-toolkit-12.9.0::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.9.0.ebuild)
1749426471: === (1 of 1) Compiling/Merging (dev-util/nvidia-cuda-toolkit-12.9.0::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.9.0.ebuild)
1749426535: === (1 of 1) Merging (dev-util/nvidia-cuda-toolkit-12.9.0::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.9.0.ebuild)
1749426581: >>> AUTOCLEAN: dev-util/nvidia-cuda-toolkit:0
1749426581: === Unmerging... (dev-util/nvidia-cuda-toolkit-12.9.0)
1749426583: >>> unmerge success: dev-util/nvidia-cuda-toolkit-12.9.0
1749426586: === (1 of 1) Updating world file (dev-util/nvidia-cuda-toolkit-12.9.0)
1749426586: === (1 of 1) Post-Build Cleaning (dev-util/nvidia-cuda-toolkit-12.9.0::/var/db/repos/gentoo/dev-util/nvidia-cuda-toolkit/nvidia-cuda-toolkit-12.9.0.ebuild)
1749426586: ::: completed emerge (1 of 1) dev-util/nvidia-cuda-toolkit-12.9.0 to / |
_________________
La source c'est la vie... |
|
| Back to top |
|
|
seb95passionlinux
n00b
Joined: 27 Oct 2024
Posts: 15
Location: France
|
| Posted: Thu Jun 12, 2025 6:57 am Post subject: |
|
|
Hello, am I the only one? Should I file a bug report? Kind regards
_________________
La source c'est la vie... |
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
Unsupported Software
