Mobile Fitting Room: On-device Virtual Try-on via Diffusion Models
<|reference_start|>Mobile Fitting Room: On-device Virtual Try-on via Diffusion Models: The growing digital landscape of fashion e-commerce calls for interactive and user-friendly interfaces for virtually trying on clothes. Traditional try-on methods grapple with challenges in adapting to diverse backgrounds, poses, and subjects. While newer methods, utilizing the recent advances of diffusion models, have achieved higher-quality image generation, the human-centered dimensions of mobile interface delivery and privacy concerns remain largely unexplored. We present Mobile Fitting Room, the first on-device diffusion-based virtual try-on system. To address multiple inter-related technical challenges such as high-quality garment placement and model compression for mobile devices, we present a novel technical pipeline and an interface design that enables privacy preservation and user customization. A usage scenario highlights how our tool can provide a seamless, interactive virtual try-on experience for customers and provide a valuable service for fashion e-commerce businesses.<|reference_end|>
@article{blalock2024mobile,
    title={Mobile Fitting Room: On-device Virtual Try-on via Diffusion Models},
    author={Justin Blalock, David Munechika, Harsha Karanth, Alec Helbling,
  Pratham Mehta, Seongmin Lee, Duen Horng Chau},
    journal={arXiv preprint arXiv:2402.01877},
    year={2024},
    archivePrefix={arXiv},
    eprint={2402.01877},
    primaryClass={cs.HC cs.AI cs.LG}
}