[Fix] handle prompt length for multi-GPU#87

Merged

hppRC merged 10 commits intodevfrom fix/handle_prompt_length_for_multi_gpus

Dec 9, 2024

+25-1

Commits on Aug 30, 2024

Commits on Nov 21, 2024

Merge pull request #82 from sbintuitions/dev
akiFQC
authored

Commits on Dec 6, 2024

turn prompt_length from int into tensor
hppRC
committed