Live Streaming - Avoid regurgitating previously spoken details

[matbee-eth]

Any strategies that youre aware of to reduce the amount of repetition in the responses? I'm doing a streaming audio+video prompt with streaming output. It tends to just say the same thing even if adds nothing of value. Is there a way to keep the responses to "changes" between last inference?

[YuzaChongyi]

Could you provide an example to illustrate what specific type of repetition you are referring to?

[franz101]

@matbee-eth what code / framework are you using?

[matbee-eth]

I'm using Transformers with my own framework