Roll your own the libraries

[peardox]

Do you have build recipies for the various backends?

I'm working on Pascal bindings for Whisper.cpp (sister project of Llama.cpp)

Having issues getting some backends built (ATM OpenCL, SYCL and Kompute are problems - looking at latter right now) so any pointers would definitely help.

Aiming for Cross Platform Delphi+FPC solution (bit's work ATM if you have libs - a few mods in PR with specific build params [which I really need to update the docs on])

[peardox]

Found some info

I've got blas, cuda, vulkan and rpc ATM on Windows (+ todo on Linux)
OpenCL is only for Mobile by the look of it
metal is Apple (tried Apple Silicon, optionally CoreML - x64 is an experiment-in-waiting)
Kompute = out of date
cpu = fine of course (but not GGML_CPU_ALL_VARIANTS on Apple Silicon, probably ok on Apple x64)

Not touched cann (Huawei Mobile?), hip, sycl or musa (looks old) yet - any of these good (and on what platforms?)

Waiting on feedback regarding 'Not touched'