Verbalized Sampling: The Prompting Breakthrough Unlocking LLM Diversity
Stanford researchers identify 'typicality bias' as the root cause of LLM mode collapse and introduce Verbalized Sampling—a training-free prompting technique that boosts creative output diversity by 1.6-2.1x. This psychologically grounded approach enhances poems, jokes, and dialogues while maintaining factual accuracy, with greater benefits for advanced models.