菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-01
📄 Abstract - MT-EditFlow: Reinforcement Learning for Multi-Turn Image Editing with Flow Matching

Recent breakthroughs in instruction-based image editing have captured significant attention, as models are now capable of handling real-world editing demands with the practicality required by everyday users. However, editing models trained primarily for single-turn edits often break down in multi-turn editing--the natural interactive setting where a user iteratively refines an image based on the model's own previous outputs. This failure stems from the all-or-nothing requirement, where a single failed turn compromises the entire sequence, and error propagation, where exposure bias leads to compounding editing errors. To address these challenges, we introduce MT-EditFlow, a flow-matching reinforcement learning framework designed to optimize reward signals for sequential image editing. MT-EditFlow integrates a multi-turn perspective with a multi-reward formulation to provide a unified structure applicable to both GRPO and NFT-based reinforcement learning methods. We systematically analyze and optimize the reward signal by investigating effective scoring strategies for turn-level aggregation, VLM reasoning modes to trade off reward bias and variance, and advantage fusion levels to prevent reward hacking. Our findings reveal that broadcasting the aggregated advantage across the entire editing trajectory effectively bridges the gap between local planning and global multi-turn task success. Extensive experiments demonstrate that MT-EditFlow significantly improves performance across diverse base models. Notably, it boosts FLUX.1-Kontext-dev by 6.85 points in turn-3 overall performance, surpassing state-of-the-art open-source models such as Qwen-Image-Edit. By maintaining high marginal success rates and reducing exposure bias, MT-EditFlow provides a foundation for more reliable and natural human-AI collaboration in visual content creation.

顶级标签: machine learning multi-modal reinforcement learning
详细标签: image editing multi-turn editing flow matching exposure bias reward optimization 或 搜索:

MT-EditFlow:基于强化学习和流匹配的多轮图像编辑框架 / MT-EditFlow: Reinforcement Learning for Multi-Turn Image Editing with Flow Matching


1️⃣ 一句话总结

本文提出MT-EditFlow框架,利用强化学习和流匹配技术,通过优化多轮编辑中的奖励信号,有效解决单轮编辑模型在多轮交互中因错误累积而性能崩溃的问题,显著提升了图像编辑的连续可靠性和成功率。

源自 arXiv: 2606.01985