PHAC:可提示的人体非模态补全 / PHAC: Promptable Human Amodal Completion
1️⃣ 一句话总结
这篇论文提出了一种新方法,让用户可以通过简单的点或框来提示AI如何补全被遮挡的人体图像,既能准确遵循用户指令(如指定姿势),又能完美保留图像中原本可见的部分。
Conditional image generation methods are increasingly used in human-centric applications, yet existing human amodal completion (HAC) models offer users limited control over the completed content. Given an occluded person image, they hallucinate invisible regions while preserving visible ones, but cannot reliably incorporate user-specified constraints such as a desired pose or spatial extent. As a result, users often resort to repeatedly sampling the model until they obtain a satisfactory output. Pose-guided person image synthesis (PGPIS) methods allow explicit pose conditioning, but frequently fail to preserve the instance-specific visible appearance and tend to be biased toward the training distribution, even when built on strong diffusion model priors. To address these limitations, we introduce promptable human amodal completion (PHAC), a new task that completes occluded human images while satisfying both visible appearance constraints and multiple user prompts. Users provide simple point-based prompts, such as additional joints for the target pose or bounding boxes for desired regions; these prompts are encoded using ControlNet modules specialized for each prompt type. These modules inject the prompt signals into a pre-trained diffusion model, and we fine-tune only the cross-attention blocks to obtain strong prompt alignment without degrading the underlying generative prior. To further preserve visible content, we propose an inpainting-based refinement module that starts from a slightly noised coarse completion, faithfully preserves the visible regions, and ensures seamless blending at occlusion boundaries. Extensive experiments on the HAC and PGPIS benchmarks show that our approach yields more physically plausible and higher-quality completions, while significantly improving prompt alignment compared with existing amodal completion and pose-guided synthesis methods.
PHAC:可提示的人体非模态补全 / PHAC: Promptable Human Amodal Completion
这篇论文提出了一种新方法,让用户可以通过简单的点或框来提示AI如何补全被遮挡的人体图像,既能准确遵循用户指令(如指定姿势),又能完美保留图像中原本可见的部分。
源自 arXiv: 2603.14741