菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-23
📄 Abstract - Selective Capability Unlearning in End-to-End Spoken Language Understanding

Modern spoken language understanding (SLU) systems are increasingly deployed in real-world settings, where specific functionalities may need to be removed due to policy or safety constraints. In SLU, a functionality corresponds to an intent and its associated slot-generation behavior. However, in autoregressive models, suppressing a target intent does not eliminate the conditional mapping that generates slots conditioned on that intent. When the intent prefix is externally supplied, the model can reconstruct the original intent-slot structure. We identify this structural failure as \textbf{\emph{capability persistence}}. We propose \textit{\underline{B}inding \underline{S}ubspace (BSU)}, a representation-level framework that isolates and attenuates intent-conditioned directions underlying this mapping. Across SLU benchmarks, BSU substantially reduces forced-prefix recoverability while preserving retained performance.

顶级标签: natural language processing audio machine learning
详细标签: spoken language understanding unlearning safety representation learning intent classification 或 搜索:

端到端口语理解中的选择性能力遗忘 / Selective Capability Unlearning in End-to-End Spoken Language Understanding


1️⃣ 一句话总结

本文针对口语理解系统中政策或安全要求需删除特定功能(如意图识别)时,现有模型无法彻底遗忘其关联槽位生成能力的问题,提出了一种名为BSU(绑定子空间)的表层调控方法,通过识别并削弱模型中与目标意图相关的隐藏方向,有效阻止模型通过外部前缀恢复已删除功能,同时保持其他性能不受影响。

源自 arXiv: 2606.24063