Mathematicians reveal surprising insights from closed-door AI testing sessions, exposing both the impressive capabilities and fundamental limitations of reasoning models like ChatGPT and Gemini when tackling advanced math problems. Behind the hype, researchers discovered AI struggles with geometric intuition and genuine problem-solving despite excelling at pattern matching.