菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-16
📄 Abstract - GT-PCQA: Geometry-Texture Decoupled Point Cloud Quality Assessment with MLLM

With the rapid advancement of Multi-modal Large Language Models (MLLMs), MLLM-based Image Quality Assessment (IQA) methods have shown promising generalization. However, directly extending these MLLM-based IQA methods to PCQA remains challenging. On the one hand, existing PCQA datasets are limited in scale, which hinders stable and effective instruction tuning of MLLMs. On the other hand, due to large-scale image-text pretraining, MLLMs tend to rely on texture-dominant reasoning and are insufficiently sensitive to geometric structural degradations that are critical for PCQA. To address these gaps, we propose a novel MLLM-based no-reference PCQA framework, termed GT-PCQA, which is built upon two key strategies. First, to enable stable and effective instruction tuning under scarce PCQA supervision, a 2D-3D joint training strategy is proposed. This strategy formulates PCQA as a relative quality comparison problem to unify large-scale IQA datasets with limited PCQA datasets. It incorporates a parameter-efficient Low-Rank Adaptation (LoRA) scheme to support instruction tuning. Second, a geometry-texture decoupling strategy is presented, which integrates a dual-prompt mechanism with an alternating optimization scheme to mitigate the inherent texture-dominant bias of pre-trained MLLMs, while enhancing sensitivity to geometric structural degradations. Extensive experiments demonstrate that GT-PCQA achieves competitive performance and exhibits strong generalization.

顶级标签: multi-modal model evaluation natural language processing
详细标签: point cloud quality assessment multimodal llm instruction tuning geometry-texture decoupling low-rank adaptation 或 搜索:

GT-PCQA:一种基于多模态大语言模型的、几何与纹理解耦的点云质量评估方法 / GT-PCQA: Geometry-Texture Decoupled Point Cloud Quality Assessment with MLLM


1️⃣ 一句话总结

本文提出了一种名为GT-PCQA的新方法,它通过结合2D-3D联合训练和几何纹理解耦策略,成功利用多模态大语言模型来准确评估点云质量,解决了现有方法因数据不足和模型偏重纹理而忽略几何结构缺陷的难题。

源自 arXiv: 2603.14951