Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LiteRT runtime build not working for Linux+Aarch64 #5

Open
mansnils opened this issue Sep 27, 2024 · 3 comments
Open

LiteRT runtime build not working for Linux+Aarch64 #5

mansnils opened this issue Sep 27, 2024 · 3 comments

Comments

@mansnils
Copy link

There is no aarch64 linux wheel for ai-edge-litert.
https://pypi.org/project/ai-edge-litert/#files

For tensorflow there is e.g. CPython 3.11 manylinux: glibc 2.17+ ARM64
https://pypi.org/project/tensorflow/#files

It appears not to be possible to build natively for aarch64+linux from source (using the ci/build_pip_package_with_bazel.sh script):

How to reproduce on Linux+Aarch64:
./ci/build_pip_package_with_bazel.sh

Building TFL runtime in tensorflow on Linux+Aarch64 works:
./tensorflow/lite/tools/pip_package/build_pip_package_with_cmake.sh

@byarbrough
Copy link

byarbrough commented Oct 15, 2024

Bummed that I cannot install on the Pi 4 running Linux raspberrypi 6.6.51+rpt-rpi-v8 #1 SMP PREEMPT Debian 1:6.6.51-1+rpt3 (2024-10-08) aarch64 GNU/Linux

But the docs do still say to use

pip install tflite-runtime

https://ai.google.dev/edge/litert/microcontrollers/python

@AllanKamimura
Copy link

yeah..... it's really curious how a library aimed for edge-runtime don't have an arm64 build available
I asked if they have a date planned for the release of the linux/arm64 build, but didn't get any answer

in the end, I build it myself using that ci script and it is working 🙃
python 3.11
linux/arm64

ai_edge_litert_nightly-1.0.1.dev20241024-cp311-cp311-linux_aarch64.zip

well, use it at your own discretion 😅

@johnthagen
Copy link

aarch64 wheels are needed to make ai-edge-litert a true replacement for tflite-runtime, which provides manylinux_2_34_aarch64.whl wheels.

Another example where this is needed is for macOS ARM64 local development within containers-- this requires an ARM64 Linux wheel when installing into the container.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants