ffmpeg + whisper build (unable to find whisper)

[sdauth]

Hello,
I want to try whisper for ffmpeg (available since 8.0).
I installed app-accessibility/whisper-cpp-1.8.2 from guru overlay
then cloned ffmpeg (8.0 tag) then ran configure :

Code: Select all

./configure --prefix=/usr --enable-version3 --disable-shared --enable-gpl \
  --enable-nonfree --enable-static --enable-pthreads --enable-filters \
  --enable-openssl --enable-runtime-cpudetect --enable-libvpx --enable-libx264 \
  --enable-libx265 --enable-libopus --enable-libspeex --enable-libfreetype \
  --enable-fontconfig --enable-libzimg --enable-libvorbis --enable-libwebp \
  --enable-libfribidi --enable-libharfbuzz --enable-libpulse --enable-libass \
  --enable-whisper

but configure is unable to find whisper :

Code: Select all

require_pkg_config whisper whisper >= 1.7.5 whisper.h whisper_init_from_file_with_params
check_pkg_config whisper whisper >= 1.7.5 whisper.h whisper_init_from_file_with_params
test_pkg_config whisper whisper >= 1.7.5 whisper.h whisper_init_from_file_with_params
pkg-config --exists --print-errors whisper >= 1.7.5
Package whisper was not found in the pkg-config search path.
Perhaps you should add the directory containing `whisper.pc'
to the PKG_CONFIG_PATH environment variable
Package 'whisper' not found
ERROR: whisper >= 1.7.5 not found using pkg-config

the ebuild:

Code: Select all

# Copyright 2023-2025 Gentoo Authors
# Distributed under the terms of the GNU General Public License v2

EAPI=8

inherit cmake

MyPN="whisper.cpp"
MyP="${MyPN}-${PV}"

DESCRIPTION="Port of OpenAI's Whisper model in C/C++ "
HOMEPAGE="https://github.com/ggml-org/whisper.cpp"
SRC_URI="https://github.com/ggml-org/whisper.cpp/archive/refs/tags/v${PV}.tar.gz -> ${MyP}.tar.gz"

S="${WORKDIR}/${MyP}"

LICENSE="MIT"
SLOT="0"
KEYWORDS="~amd64"
IUSE="blas cuda hip opencl sdl2 vulkan"

CDEPEND="blas? ( sci-libs/openblas )
	cuda? ( dev-util/nvidia-cuda-toolkit:= )
	hip? ( sci-libs/hipBLAS:= )
	opencl? ( sci-libs/clblast:= )
	sdl2? ( media-libs/libsdl2:= )"
DEPEND="${CDEPEND}
	vulkan? ( dev-util/vulkan-headers )
"
RDEPEND="${CDEPEND}
	vulkan? ( media-libs/vulkan-loader )
"
BDEPEND="media-libs/shaderc"

src_configure() {
	# Note: CUDA and HIP are currently untested. Build failures may occur.
	# Turning off examples causes errors during configure
	# -DWHISPER_BUILD_TESTS=$(usex test)
	local mycmakeargs=(
		-DWHISPER_BUILD_EXAMPLES=ON
		-DGGML_CCACHE=OFF
		-DBUILD_SHARED_LIBS=OFF
		-DGGML_BLAS=$(usex blas)
		-DGGML_CLBLAST=$(usex opencl)
		-DGGML_CUBLAS=$(usex cuda)
		-DGGML_HIPBLAS=$(usex hip)
		-DGGML_VULKAN=$(usex vulkan)
		-DWHISPER_SDL2=$(usex sdl2)
	)
	cmake_src_configure
}

equery f whisper-cpp

Code: Select all

/usr/bin
/usr/bin/vad-speech-segments
/usr/bin/whisper-bench
/usr/bin/whisper-cli
/usr/bin/whisper-server
/usr/include
/usr/include/ggml-alloc.h
/usr/include/ggml-backend.h
/usr/include/ggml-blas.h
/usr/include/ggml-cann.h
/usr/include/ggml-cpp.h
/usr/include/ggml-cpu.h
/usr/include/ggml-cuda.h
/usr/include/ggml-metal.h
/usr/include/ggml-opt.h
/usr/include/ggml-rpc.h
/usr/include/ggml-sycl.h
/usr/include/ggml-vulkan.h
/usr/include/ggml-webgpu.h
/usr/include/ggml.h
/usr/include/gguf.h
/usr/include/whisper.h
/usr/lib
/usr/lib/pkgconfig
/usr/lib/pkgconfig/whisper.pc
/usr/lib64
/usr/lib64/cmake
/usr/lib64/cmake/ggml
/usr/lib64/cmake/ggml/ggml-config.cmake
/usr/lib64/cmake/ggml/ggml-version.cmake
/usr/lib64/cmake/whisper
/usr/lib64/cmake/whisper/whisper-config.cmake
/usr/lib64/cmake/whisper/whisper-version.cmake
/usr/lib64/libggml-base.a
/usr/lib64/libggml-cpu.a
/usr/lib64/libggml.a
/usr/lib64/libwhisper.a
/usr/share
/usr/share/doc
/usr/share/doc/whisper-cpp-1.8.2
/usr/share/doc/whisper-cpp-1.8.2/AUTHORS.bz2
/usr/share/doc/whisper-cpp-1.8.2/README.md.bz2
/usr/share/doc/whisper-cpp-1.8.2/README_sycl.md.bz2

Any idea to troubleshoot this ? Thanks

[Ionen]

Haven't actually tried it, but:

Code: Select all

/usr/lib/pkgconfig/whisper.pc

The .pc is installed in the wrong directory, it should be at /usr/lib64/pkgconfig/whisper.pc given it installed the 64bit library, ebuild needs fixing. May have went unnoticed by the ebuild author given cmake wouldn't be affected.

The .pc contents may also need to be updated to point to the right libdir albeit it may work regardless (for some picky linkers, having the wrong libdir can cause issues).

Edit: on a side-note, it's possible to use system's ffmpeg-8 by doing EXTRA_ECONF=--enable-whisper even if ebuild doesn't support it, albeit that will be broken if you're using a multilib ffmpeg given it'll try to enable it for 32bit too without ebuild modifications and the guru package doesn't give 32bit libs

[sdauth]

Thanks, I missed that.
I forgot to mention this is a no multilib (split-usr) system.
And indeed whisper.pc is quite lonely in /usr/lib/pkgconfig
So I copied it to /usr/lib64/pkgconfig/whisper.pc
No luck.

Tried to also specify lib64 as well (is it correct?)

Code: Select all

prefix=/usr
exec_prefix=${prefix}
libdir=${exec_prefix}/lib64
includedir=${prefix}/include

Name: whisper
Description: Port of OpenAI's Whisper model in C/C++
Version: 1.8.2
Libs: -L${libdir} -lggml  -lggml-base -lwhisper
Cflags: -I${includedir}

Same, still not found.

I just noticed ffmpeg-8.0 is now unmasked (with --disable-whisper indeed) but since I'm on a stable system, I'm unable to emerge it due to conflicts.

[sdauth]

Without adding it to /usr/lib64/pkgconfig/
$ pkg-config --libs whisper

Code: Select all

Package whisper was not found in the pkg-config search path.
Perhaps you should add the directory containing `whisper.pc'
to the PKG_CONFIG_PATH environment variable
Package 'whisper' not found

After adding it to /usr/lib64/pkgconfig/
$ pkg-config --libs whisper

Code: Select all

-lggml -lggml-base -lwhisper

So it seems to be the reason indeed but the ffmpeg configure script still fails to find it.
Or maybe there is one more step I don't know about ?

edit:
If I don't modify /usr/lib64/pkgconfig/whisper.pc ( libdir=${exec_prefix}/lib )
$ pkg-config --libs whisper

Code: Select all

-L/usr/lib -lggml -lggml-base -lwhisper