-
|
Is it possible to build or offer a wasm file support for iOS? |
Beta Was this translation helpful? Give feedback.
Answered by
guinmoon
Jul 1, 2023
Replies: 1 comment 1 reply
-
|
After a slight change in ggml-metal.m, I was able to run this ORCA model on an iPhone. Works very well. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
With metal, the output is slightly slow at the beginning, but then it works faster than on the CPU. And the phone heats up noticeably less. |
Beta Was this translation helpful? Give feedback.
Answer selected by
FNsi
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
After a slight change in ggml-metal.m, I was able to run this ORCA model on an iPhone. Works very well.