Sketch2Prototype: Rapid Conceptual Design Exploration and Prototyping with Generative AI
<|reference_start|>Sketch2Prototype: Rapid Conceptual Design Exploration and Prototyping with Generative AI: Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches, rapidly generates text, image, and 3D modalities for enhanced early-stage design exploration. We show that using text as an intermediate modality outperforms direct sketch-to-3D baselines for generating diverse and manufacturable 3D models. We find limitations in current image-to-3D techniques, while noting the value of the text modality for user-feedback and iterative design augmentation.<|reference_end|>
@article{edwards2024sketch2prototype:,
    title={Sketch2Prototype: Rapid Conceptual Design Exploration and Prototyping
  with Generative AI},
    author={Kristen M. Edwards, Brandon Man, Faez Ahmed},
    journal={arXiv preprint arXiv:2405.12985},
    year={2024},
    archivePrefix={arXiv},
    eprint={2405.12985},
    primaryClass={cs.HC cs.AI cs.CV}
}