Brief

Researchers have developed Constrained Adaptive Rejection Sampling (CARS), a new method for generating outputs from language models that must adhere to specific constraints. CARS improves upon traditional rejection sampling by adaptively pruning constraint-violating continuations, thereby increasing efficiency and reducing wasted computation. This approach ensures that generated samples precisely follow the desired constrained distribution while maintaining diversity, as demonstrated in experiments with program fuzzing and molecular generation. AI