前瞻:基于神经符号原始编程的可验证推理 / Forethought: Verifiable Reasoning from Neurosymbolic Primitive Programming
1️⃣ 一句话总结
本文提出一种名为Forethought的神经符号推理系统,通过将推理过程转化为可验证的显式程序(而非依赖大模型内部的黑盒思维链),显著提升了小模型的推理准确率,并让它们在与专用推理模型竞争时,只需极少的后训练投入,同时保持步骤可审计性和模型无关性。
Current agentic workflows usually involve decomposing user requests into sequences of tool calls with correctly resolved parameters, the results of which are processed through reasoning traces in the language model's context window. The prevailing route to improve such reasoning is test-time scaling, which trains models to search over long chains of thought; but the resulting capability is entangled in model weights, is not verifiable step-by-step, and is costly at inference. We present Forethought, a neurosymbolic reasoning system that instead treats reasoning as an explicit, verifiable program, that builds from a library of symbolic and neural primitives which are composed through a domain-specific language. The result are reasoning programs, which are concrete representations of the model's work, and as such can be inspected and modified before deployment. Instantiated as a tool-calling execution kernel and evaluated across five benchmarks, Forethought improves base-model accuracy by about 30% relative and outperforms vanilla prompting, reinforcement learning scaffolds, and prompt-evolution methods, enabling small models to match or exceed frontier models capabilities. In a direct comparison, a non-reasoning model augmented with Forethought competes with a dedicated reasoning model while requiring roughly three orders of magnitude less post-training investment, and remains model-agnostic and auditable.
前瞻:基于神经符号原始编程的可验证推理 / Forethought: Verifiable Reasoning from Neurosymbolic Primitive Programming
本文提出一种名为Forethought的神经符号推理系统,通过将推理过程转化为可验证的显式程序(而非依赖大模型内部的黑盒思维链),显著提升了小模型的推理准确率,并让它们在与专用推理模型竞争时,只需极少的后训练投入,同时保持步骤可审计性和模型无关性。
源自 arXiv: 2607.04096