Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feat]: Speed up App #130

Open
bi4key opened this issue Dec 8, 2024 · 1 comment
Open

[Feat]: Speed up App #130

bi4key opened this issue Dec 8, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@bi4key
Copy link

bi4key commented Dec 8, 2024

Description
App is Simple and Usefull, but when I compared generate response to app ChatterUI ( https://github.com/Vali-98/ChatterUI )

Then app ChatterUI is about 4x faster generate response.. I could believed when I test this first time.

I don't know how he do this but speed is huge.

I don't use special GGUF for ARM, I use normal GGUF like: https://huggingface.co/unsloth/Llama-3.2-1B-Instruct-GGUF/blob/main/Llama-3.2-1B-Instruct-Q4_K_M.gguf

Use Case
My observation show maybe PocketPal have some not optimized code for CPU integration or use only 50% of CPU Power.

Add support to more threads for CPU to faster app responses and optimized code to use full potential of phone CPU.

My phone: Pixel 6a.

@bi4key bi4key added the enhancement New feature or request label Dec 8, 2024
@bi4key
Copy link
Author

bi4key commented Dec 11, 2024

New Update App Version 1.6.0 (39) have some speed boost and good visual update.

So now App have good progress! Thx for your work!
Last my post is now outdated ;D about speed.


But now I have the same bug like that:
#134

App: Version 1.6.0 (39) - app from Github
Phone: Pixel 6a (GrapheneOS) | Android 15
Bug: keyboard hide input box

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant