RowNet:用于表格型回归的记忆转换器 / RowNet: A Memory Transformer for Tabular Regression
1️⃣ 一句话总结
RowNet提出了一种新颖的神经网络架构,通过将待预测房产与一个存储已知房产信息的记忆库进行逐对相似度对比,并利用注意力机制和多专家混合模块,更准确地预测单位面积房价,从而克服了传统表格回归方法难以有效学习特征交互和参考相似案例的局限。
Real estate valuation is a structured regression problem in which prices are governed by heterogeneous feature types, sparse regional effects, nonlinear interactions, and the practical logic of comparable properties. Standard multilayer perceptrons treat each row as an isolated vector and must learn locality, scale sensitivity, and categorical matching from supervision alone. Gradient-boosted decision trees provide strong tabular baselines, but their feature-centric splitting mechanism does not explicitly model the retrieval of similar historical observations. This paper presents RowNet, a retrieval-based neural architecture for real estate price-per-square-meter prediction. RowNet represents a query property through pairwise similarity features against a memory bank of labeled properties. A first retrieval layer estimates a coarse target from feature-only similarities. A second layer augments the memory comparison with target-consistency features and uses multiple learned attention heads to retrieve complementary comparable sets. A final mixture-of-experts module combines learned gating, residual correction, entropy regularization, and head-diversity regularization to produce the prediction.
RowNet:用于表格型回归的记忆转换器 / RowNet: A Memory Transformer for Tabular Regression
RowNet提出了一种新颖的神经网络架构,通过将待预测房产与一个存储已知房产信息的记忆库进行逐对相似度对比,并利用注意力机制和多专家混合模块,更准确地预测单位面积房价,从而克服了传统表格回归方法难以有效学习特征交互和参考相似案例的局限。
源自 arXiv: 2606.04445