https://www.aidancooper.co.uk/constrained-decoding/
A Guide to Structured Generation Using Constrained Decoding
Aidan Cooper
Apr 8, 2024
“…there are techniques that ensure language models only return outputs that conform to your requirements. This article serves as a practitioner’s guide for perhaps the most powerful of these techniques: constrained decoding.”