Efficient-Large-Model/VILA1.5-13b weird outputs

[jhjangjh]

I am running inference with the Efficient-Large-Model/VILA1.5-13b model.

When using the Efficient-Large-Model/VILA1.5-3b and Efficient-Large-Model/Llama-3-VILA1.5-8B models, the results are generated correctly without any issues.

However, when running inference with the 13B model, I get weird outputs like the ones shown in the image.

Is anyone else experiencing this issue?

[Lyken17]

this usually because you set the wrong conv template. Could you use vicuna_v1 instead?

[jhjangjh]

I've used both default llava_v0 and vicuna_v1, but the results are the same..