How does Chain of Thought decompose complex tasks?
A new research paper explores how Chain of Thought (CoT) reasoning in large language models can be understood as a tree-structured decomposition of classification tasks. The study reveals that prediction error scales with the number of possible answers, and that splitting complex tasks into smaller classification problems can significantly reduce this error. Researchers identified a critical threshold for the 'degree' of decomposition, below which deeper thinking is detrimental and above which an optimal depth exists to minimize error, beyond which further depth offers no improvement. AI
IMPACT Provides a theoretical framework for understanding and optimizing Chain of Thought reasoning in LLMs, potentially leading to more efficient and effective complex task decomposition.