Award-winning ICML 2025 research reveals fundamental limitations in next-token prediction for creative tasks. By introducing diffusion models and seed-conditioning techniques, researchers achieve breakthrough performance in open-ended problem-solving while addressing autoregressive models' memorization pitfalls.