Skip to content

Enable concatenation of unpadded prompts and a few other optimizations#1178

Open
sixiang-google wants to merge 1 commit intomainfrom sixiang-prefill-packing

Commits

Commits on Jan 17, 2025