Awesome work! #3
Description
I will be playing with this, as I have a vested interest in seeing proper constraints implemented in LLMs which solve the issues that you outline with the technique I was using (namely, that filter-assisted decoding is greedy).
Super cool to see a bunch of MIT researchers citing my work, I'm honored!