CORTEX:用于可信三维胸部CT多模态大语言模型的结构化推理基准 / CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMs
1️⃣ 一句话总结
本文提出了一个名为CORTEX的结构化推理基准,通过模拟放射科医生四步诊断流程(理解任务、观察影像、推理诊断、合成答案),为三维胸部CT的问答和报告生成任务提供可验证的推理标注,从而帮助训练和评估更可信、可解释的医疗AI模型。
Reasoning in multimodal large language models (MLLMs) has shown strong promise in medical imaging. However, this reasoning is usually free-form text judged only by its final answer, making it hard to interpret and verify, especially in 3D radiology, where a diagnosis should be traceable to evidence in the scan. Existing chest CT question-answering datasets compound this by reducing expert radiology reports to answer-only pairs, dropping the reasoning that links findings to conclusions and omitting the patient history clinicians rely on. As a result, reasoning-capable 3D chest CT MLLMs remain out of reach, as neither the structured supervision needed to train them nor the protocol needed to verify their reasoning yet exists. We introduce CORTEX (Clinically Organized Reasoning and sTructured EXplanation), a structured reasoning benchmark for 3D chest CT. For each question, CORTEX restores the missing reasoning as a four-stage diagnostic trace mirroring a radiologist's workflow: task understanding, visual observation, diagnostic reasoning, and answer synthesis. We generate these traces using frontier large language models with broad medical and general-domain knowledge, then filter and verify them with a stage-level evaluation protocol combining automated rubric scoring with expert radiologist review. Crucially, both the reasoning structure and evaluation rubrics are designed in close collaboration with clinicians. Built on CT-RATE, a large, publicly available chest CT dataset without reasoning annotations, CORTEX comprises 76,177 validated reasoning traces across open-ended VQA, closed-ended VQA, and report generation, providing both the structured supervision and the stage-level evaluation protocol needed to build and evaluate trustworthy reasoning models for 3D chest CT. Our dataset and evaluation code will be made publicly available upon acceptance.
CORTEX:用于可信三维胸部CT多模态大语言模型的结构化推理基准 / CORTEX: A Structured Reasoning Benchmark for Trustworthy 3D Chest CT MLLMs
本文提出了一个名为CORTEX的结构化推理基准,通过模拟放射科医生四步诊断流程(理解任务、观察影像、推理诊断、合成答案),为三维胸部CT的问答和报告生成任务提供可验证的推理标注,从而帮助训练和评估更可信、可解释的医疗AI模型。
源自 arXiv: 2606.27264