Android demo app: Multilingual support?

[darlingtonplate]

Hello everyone. Today, I successfully was able to launch the android demo app on my physical device, however I noticed one thing: it doesn't seem to support any languages other than transcribing in English.

Either that, or I'm blind as I am particularly new to programming for Android. I'd also like to mention that the README.md file within examples/whisper.andriod fails to mention the requirement of downloading and unzipping the contents of examples/whisper from the ggml repository. Unless if this was an issue with my implementation.

[skillhacker-code]

Hey , Can you please tell me how to build the android app . I have no experience in android development . If you can please share the apk

[jaimebw]

Thanks for the help and the benchmark times. I've been able to build the app correctly yet the emulator seems incapable of running the model( with the base and the tiny models). I will try to run it on an old Samsung S9 and see how it goes.
Btw, I think that the issue with the build and having to add the examples/whisper library is due to this:

whisper.cpp/examples/whisper.android/app/src/main/jni/whisper/jni.c

Line 8 in 72af0f5

#include "whisper.h"

Basically, idk why but Android studio changes the path of the file to:

#include "examples/whisper.android/app/src/main/jni/whisper.h"

And provokes all the issues with the build.
@tinoue do you know why this might be happening?

[tinoue]

@jaimebw I have no include path problem. The include path is specified here:

whisper.cpp/examples/whisper.android/app/src/main/jni/whisper/Whisper.mk

Lines 14 to 18 in 72af0f5

	LOCAL_CFLAGS += -DSTDC_HEADERS -std=c11 -I $(WHISPER_LIB_DIR)
	LOCAL_CPPFLAGS += -std=c++11
	LOCAL_SRC_FILES := $(WHISPER_LIB_DIR)/ggml.c \
	$(WHISPER_LIB_DIR)/whisper.cpp \
	$(LOCAL_PATH)/jni.c

Make sure you open whisper.cpp/examples/whisper.android from Android Studio.

[darlingtonplate]

Btw, I think that the issue with the build and having to add the examples/whisper library is due to this:

Yeah, I think so too. Previous builds refused to build without having the library.
I haven't tested it on virtualized hardware, but I'd recommend you to test it on physical hardware either way, as it it more representative of actual performance

[jaimebw]

FYI, just tested in a Samsung Galaxy S8 and it took 1 minute and 25 seconds to transcribe the sample audio using the tiny model. Thanks again for all the help 😊😊

[jaimebw]

Try to add some Toast, or use the log library in the example app to see what's going on.

[tinoue]

@darlingtonplate For now you should hard-code 2-characters language parameter params.language at:
https://github.com/ggerganov/whisper.cpp/blob/master/examples/whisper.android/app/src/main/jni/whisper/jni.c#L182

Available languages: https://github.com/ggerganov/whisper.cpp/blob/master/whisper.cpp#L119

[darlingtonplate]

Spectacular! Thanks, I felt like I wasn't searching in the correct place.

[sudipa23]

I've tried to build the apk from the android demo of whisper.cpp. but I got the following error : [CXX1405] error when building with ndkBuild using D:\whisper_cpp\whisper.android\app\src\main\jni\whisper\Android.mk: C++ build system [configure] failed while executing:

can anyone please help me on that

[rjpikus]

I wonder if there is a c++ config file, or c++ libs needed, I do not know, dealing my errors and will keep this in mind. Forging ahead.

[sudipa23]

finally worked in my android phone. Need to set up my NDK location.as the code uses C++ and in android we need NDK toolset to deal with the code written in C++ .

[rjpikus]

Explain how you got working?
Add the files from ggml to jni?
or no add files from ggml?

[sudipa23]

as I mentioned earlier that I got an issue in my NDK location and that also caused because I had white space in my SDK location path, so the NDK location file path can not accessing that even after installing NDK(step by step ) after fixing this issue ,the build is successful. But even after build is successful the app is not recognizing anything then I figure out that the model (ggml-base.bin) file need to download from its original site which is https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-base.bin. the models that are uploaded in this repo is not the actual models it's for demo.

[tumuyan]

I have made a ci script to build Android demo with model & language choose.

https://github.com/tumuyan/whisper.cpp/blob/master/.github/workflows/build-android.yml