Interesting params in https://github.com/mapmeld/transformers/blob/main/src/transformers/generation_utils.py
is_constraint_gen_mode
Unsupported:
- https://arxiv.org/abs/2203.11370 time control
- https://github.com/rosewang2008/language_modeling_via_stochastic_processes
- https://github.com/XiangLi1999/ContrastiveDecoding
Issues:
There is a rankgen pip package, but it has its own encoder/decoder and requires from a set of t5 models.
Supported but should be linked:
https://huggingface.co/blog/introducing-csearch contrastive search
use in code: https://twitter.com/moyix/status/1606103262138011649