--- title: Virtual Staging AI emoji: ๐Ÿ  colorFrom: blue colorTo: green sdk: gradio app_file: virtual_staging_app.py pinned: false hardware: zero-gpu --- # ๐Ÿ  Virtual Staging AI - 2-Stage Pipeline **Advanced AI Interior Design with YOLO Detection & ControlNet Refinement** ๋นˆ ๋ฐฉ ์‚ฌ์ง„์„ ์—…๋กœ๋“œํ•˜๋ฉด 2๋‹จ๊ณ„ AI ํŒŒ์ดํ”„๋ผ์ธ์ด ์ „๋ฌธ์ ์ธ ์ธํ…Œ๋ฆฌ์–ด ๋””์ž์ธ์„ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค. ## โœจ ์ฃผ์š” ๊ธฐ๋Šฅ ### ๐ŸŽฏ 2-Stage Architecture 1. **Stage 1**: ControlNet์œผ๋กœ ์ดˆ๊ธฐ ๊ฐ€๊ตฌ ๋ฐฐ์น˜ ์ƒ์„ฑ 2. **Stage 2**: YOLO๋กœ ๊ฐ€๊ตฌ ์˜์—ญ ํƒ์ง€ โ†’ ControlNet์œผ๋กœ ํ’ˆ์งˆ ๊ฐœ์„  ### ๐Ÿ  ์ง€์› ๊ณต๊ฐ„ & ์Šคํƒ€์ผ - **4๊ฐ€์ง€ ๊ณต๊ฐ„ ํƒ€์ž…**: Living Room, Bedroom, Kitchen, Dining Room - **4๊ฐ€์ง€ ๋””์ž์ธ ์Šคํƒ€์ผ**: Modern, Scandinavian, Industrial, Traditional - **16๊ฐ€์ง€ ์กฐํ•ฉ**: ๊ฐ ๊ณต๊ฐ„๋ณ„ ๋ชจ๋“  ์Šคํƒ€์ผ ์ง€์› ## ๐Ÿš€ ๋ฐฐํฌ & ์‹คํ–‰ ### 1. Hugging Face Spaces (์ถ”์ฒœ) ```bash # 1. huggingface.co์—์„œ ์ƒˆ Space ์ƒ์„ฑ (GPU ํ™˜๊ฒฝ) # 2. ๋ชจ๋“  ํŒŒ์ผ ์—…๋กœ๋“œ (virtual_staging_app.py๊ฐ€ ๋ฉ”์ธ) # 3. @spaces.GPU ์ž๋™ ํ™œ์„ฑํ™”๋กœ GPU ๊ฐ€์† ``` ### 2. ๋กœ์ปฌ ๊ฐœ๋ฐœ ํ™˜๊ฒฝ ```bash # ๊ฐ€์ƒํ™˜๊ฒฝ ์ƒ์„ฑ ๋ฐ ์˜์กด์„ฑ ์„ค์น˜ python3 -m venv spacely_local source spacely_local/bin/activate pip install -r requirements_virtual_staging.txt # ๋กœ์ปฌ ์‹คํ–‰ python run_virtual_staging.py ``` ## ๐ŸŽฏ ์‚ฌ์šฉ๋ฒ• 1. **์ด๋ฏธ์ง€ ์—…๋กœ๋“œ**: ๋นˆ ๋ฐฉ ์‚ฌ์ง„์„ ์—…๋กœ๋“œ (๋“œ๋ž˜๊ทธ ์•ค ๋“œ๋กญ ์ง€์›) 2. **๊ณต๊ฐ„ ์„ ํƒ**: Living Room, Bedroom, Kitchen, Dining Room ์ค‘ ์„ ํƒ 3. **์Šคํƒ€์ผ ์„ ํƒ**: Modern, Scandinavian, Industrial, Traditional ์ค‘ ์„ ํƒ 4. **์ƒ์„ฑ ์‹œ์ž‘**: AI๊ฐ€ 2๋‹จ๊ณ„ ํŒŒ์ดํ”„๋ผ์ธ์œผ๋กœ ์ „๋ฌธ ์ธํ…Œ๋ฆฌ์–ด ์ƒ์„ฑ ## ๐Ÿ”ง ๊ธฐ์ˆ  ์Šคํƒ ### ๐Ÿง  AI ๋ชจ๋ธ - **Base Model**: Realistic Vision V3.0 VAE (Stable Diffusion) - **ControlNet**: Segmentation + MLSD ๋“€์–ผ ์ œ์–ด - **Object Detection**: YOLOv8n (๊ฐ€๊ตฌ ์˜์—ญ ์ž๋™ ํƒ์ง€) ### ๐Ÿ’ป ํ”„๋ ˆ์ž„์›Œํฌ - **์›น UI**: Gradio 5.41.0 - **๋”ฅ๋Ÿฌ๋‹**: PyTorch, Diffusers, Transformers - **์ด๋ฏธ์ง€ ์ฒ˜๋ฆฌ**: OpenCV, PIL, Ultralytics ## ๐Ÿ“ฑ ๋ฐฐํฌ ํ”Œ๋žซํผ ๋น„๊ต | ํ”Œ๋žซํผ | ์žฅ์  | ๋‹จ์  | ๋น„์šฉ | |--------|------|------|------| | **Hugging Face Spaces** | ๋ฌด๋ฃŒ GPU, ์‰ฌ์šด ๋ฐฐํฌ, ๊ณต๊ฐœ URL | ์ œํ•œ์  ๋ฆฌ์†Œ์Šค | ๋ฌด๋ฃŒ | | **Google Colab** | ๊ฐ•๋ ฅํ•œ GPU, ๋น ๋ฅธ ์‹คํ–‰ | ์„ธ์…˜ ์ œํ•œ, ์ผ์‹œ์  | ๋ฌด๋ฃŒ/Pro | | **AWS/GCP** | ํ™•์žฅ์„ฑ, ์ปค์Šคํ„ฐ๋งˆ์ด์ง• | ๋ณต์žกํ•œ ์„ค์ • | ์œ ๋ฃŒ | | **Replicate** | API ํ˜•ํƒœ, ํ™•์žฅ์„ฑ | ์‚ฌ์šฉ๋Ÿ‰ ๊ธฐ๋ฐ˜ ๊ณผ๊ธˆ | ์œ ๋ฃŒ | ## ๐ŸŽจ ์ปค์Šคํ„ฐ๋งˆ์ด์ง• ### ์ƒˆ๋กœ์šด ๊ณต๊ฐ„ ํƒ€์ž… ์ถ”๊ฐ€ ```python self.office_templates = { "์ƒˆ๋กœ์šดํƒ€์ž…": "your custom prompt here", # ... ๊ธฐ์กด ํƒ€์ž…๋“ค } ``` ### ํ”„๋กฌํ”„ํŠธ ํ’ˆ์งˆ ํ–ฅ์ƒ ```python self.quality_suffix = "professional interior design, corporate style, clean, modern, functional, well-lit, 4K, high quality" ``` ## ๐Ÿ—๏ธ 2-Stage Architecture ```mermaid flowchart TD A[Empty Room Image] --> B[Stage 1: ControlNet Layout Generation] B --> C[Initial Furnished Image] C --> D[Stage 2: YOLO Furniture Detection] D --> E[Furniture Region Masks] E --> F[Stage 2: ControlNet Refinement] F --> G[Final High-Quality Result] ``` ### ๐Ÿš€ Benefits Over Single-Stage | Aspect | Single-Stage | 2-Stage Virtual Staging | |--------|-------------|----------------------| | Quality | โญโญโญ | โญโญโญโญโญ | | Furniture Detection | Manual masking | Automatic YOLO detection | | Refinement | None | Targeted region refinement | | Consistency | Variable | High | | Control | Limited | Precise furniture control | --- ## ๐Ÿ“š ํ”„๋กœ์ ํŠธ ๊ธฐ์› ์ด ํ”„๋กœ์ ํŠธ๋Š” [ArvidWartenberg/virtual-staging](https://github.com/ArvidWartenberg/virtual-staging) ์ ‘๊ทผ๋ฒ•์„ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•˜์—ฌ YOLO ํ†ตํ•ฉ๊ณผ Hugging Face Spaces ์ตœ์ ํ™”๋ฅผ ์ถ”๊ฐ€ํ•œ ์™„์ „ํ•œ ์žฌ๊ตฌํ˜„์ž…๋‹ˆ๋‹ค. ### ์ฃผ์š” ๊ฐœ์„ ์‚ฌํ•ญ - ๐Ÿ” **YOLO v8 ํ†ตํ•ฉ**: ์ž๋™ ๊ฐ€๊ตฌ ์˜์—ญ ํƒ์ง€ - ๐ŸŽจ **์Šคํƒ€์ผ ํ…œํ”Œ๋ฆฟ**: 4๊ฐœ ๊ณต๊ฐ„ ร— 4๊ฐœ ์Šคํƒ€์ผ = 16๊ฐ€์ง€ ์กฐํ•ฉ - ๐Ÿš€ **HF Spaces ์ตœ์ ํ™”**: @spaces.GPU์™€ ๋ฉ”๋ชจ๋ฆฌ ์ตœ์ ํ™” - ๐Ÿ’พ **๊ตฌ์กฐ ๋ณด์กด**: ํ–ฅ์ƒ๋œ ๋ฐฐ๊ฒฝ/๊ตฌ์กฐ๋ฌผ ๋ณด์กด ๋กœ์ง Original virtual-staging approach by [ArvidWartenberg](https://github.com/ArvidWartenberg) โค๏ธ Enhanced with YOLO integration by Spacely Team