Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No such file or directory #105

Open
Alpslee opened this issue May 6, 2024 · 3 comments
Open

No such file or directory #105

Alpslee opened this issue May 6, 2024 · 3 comments

Comments

@Alpslee
Copy link

Alpslee commented May 6, 2024

I run it on macbook m2 air, when run:
python tools/download_model.py --model VILA_7B_awq_int4_CLIP_ViT-L --QM QM_ARM

I got this:
Start downloading the model to ./LLaMA2_7B_chat_awq_int4.zip.
172KB [00:00, 267.55KB/s]

File downloaded successfully: ./LLaMA2_7B_chat_awq_int4.zip
The md5sum of the file does not match the expected md5sum. Expected: af20c96de302c503a9fcfd5877ed0600, got: fd4917f2c0669b14a56d5be6a370bc75

then run:
make chat -j
./chat
TinyChatEngine by MIT HAN Lab: https://github.com/mit-han-lab/TinyChatEngine
Using model: LLaMA2_7B_chat
Using AWQ for 4bit quantization: https://github.com/mit-han-lab/llm-awq
Loading model... No such file or directory: INT4/models/LLaMA_7B_2_chat/decoder/embed_tokens/weight.bin
libc++abi: terminating due to uncaught exception of type char const*
zsh: abort ./chat

@MoonBlvd
Copy link

File downloaded successfully: ./LLaMA2_7B_chat_awq_int4.zip
The md5sum of the file does not match the expected md5sum. Expected: af20c96de302c503a9fcfd5877ed0600, got: fd4917f2c0669b14a56d5be6a370bc75

your downloaded zip are not unzipped correctly, maybe try manually unzip?

@harpreetsahota204
Copy link

I'm facing this error as well, but for LLaMA_3_8B_Instruct_awq_int4. It's not possible to download manually because you need to request access

@yuanjunze
Copy link

hello, I am also facing the same problem. Model LLaMA_3_8B_Instruct_awq_int4. Have you guys solve this problem? Really appreciate if you could give me some advice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants