bug: no Llama.cpp in the setting which leads to local models can't be used

[david-menloai]

Jan version

v0.5.15

Describe the Bug

There is no Llama.cpp under settings

---

user's configurations
Operating System: openSUSE Tumbleweed 20250219
KDE Plasma Version: 6.3.0
KDE Frameworks Version: 6.11.0
Qt Version: 6.8.2
Kernel Version: 6.13.3-1-default (64-bit)
Graphics Platform: Wayland
Processors: 24 × AMD Ryzen 9 7900X3D 12-Core Processor
Memory: 30.5 GiB of RAM
Graphics Processor 1: AMD Radeon RX 7900 XTX
Graphics Processor 2: AMD Radeon Graphics
Manufacturer: ASUS

Steps to Reproduce

No response

Screenshots / Logs

No response

What is your OS?

• MacOS
• Windows
• Linux

[artur-augustyniak]

Well, at least for me, the problem with current version is that the AppImage bundle creates symlink to the engine configuration:

└─$ ls -lah
total 12K
drwxrwxr-x  2 artur artur 4,0K lut 24 18:56 .
drwxrwxr-x 11 artur artur 4,0K lut 24 18:56 ..
lrwxrwxrwx  1 artur artur  107 lut 24 18:56 v0.1.49 -> /tmp/.mount_jan-lij7FrFl/resources/app.asar.unpacked/shared/engines/cortex.llamacpp/linux-amd64-avx/v0.1.49

After app restart (and remounting AppImage contents?) this is dangling symlink and application does not try to refresh it. Manually removing it and starting app without this symlink fixes stuff (but only to next app restrt).

[zWhdmB5T]

Your issue looks very similar to mine, cf. #4697!

[preemeijer]

I've got the same issue with the AppImage op openSUSE Tumbleweed with all the releases of Jan (Stable, Beta and Nightly).

The workaround for me is before starting Jan.ai removing all the subdirectories under: /.config/Jan-nightly/data/engines/cortex.llamacpp/ using the rm -rf command.