--- license: mit title: 3d-Model-Playground sdk: static emoji: 👀 colorFrom: yellow colorTo: purple --- # 3D Model Playground Control 3D models using hand gestures and voice commands in real-time. An interactive web app built with threejs, mediapipe computer vision, web speech API, and rosebud AI. - Say "drag", "rotate", "scale", or "animate" to change the interaction mode - Pinch fingers to control the 3D model - Drag/drop a new 3D model onto the page to import it (GLB/GLTF format) [Video](https://youtu.be/_I1E44Fp1Es?si=lR2otqR_-ZGdIGXT) | [Live Demo](https://collidingscopes.github.io/3d-model-playground/) ## Requirements - Modern web browser with WebGL support - Camera / microphone access ## Technologies - **Three.js** for 3D rendering - **MediaPipe** for hand tracking and gesture recognition - **Web Speech API** for speech recognition - **HTML5 Canvas** for visual feedback - **JavaScript** for real-time interaction ## Setup for Development ```bash # Clone this repository git clone https://github.com/collidingScopes/3d-model-playground # Navigate to the project directory cd 3d-model-playground # Serve with your preferred method (example using Python) python -m http.server ``` Then navigate to `http://localhost:8000` in your browser. ## License MIT License ## Credits - Three.js - https://threejs.org/ - MediaPipe - https://mediapipe.dev/ - Rosebud AI - https://rosebud.ai/ - Quaternius 3D models - https://quaternius.com/ ## Related Projects I've released several computer vision projects (with code + tutorials) here: [Fun With Computer Vision](https://www.funwithcomputervision.com/) You can purchase lifetime access and receive the full project files and tutorials. I'm adding more content regularly :) You might also like some of my other open source projects: - [Particular Drift](https://collidingScopes.github.io/particular-drift) - Turn photos into flowing particle animations - [Liquid Logo](https://collidingScopes.github.io/liquid-logo) - Transform logos and icons into liquid metal animations - [Video-to-ASCII](https://collidingScopes.github.io/ascii) - Convert videos into ASCII pixel art ## Contact - Instagram: [@stereo.drift](https://www.instagram.com/stereo.drift/) - Twitter/X: [@measure_plan](https://x.com/measure_plan) - Email: [stereodriftvisuals@gmail.com](mailto:stereodriftvisuals@gmail.com) - GitHub: [collidingScopes](https://github.com/collidingScopes) ## Donations If you enjoyed this, feel free to buy me a coffee. My name is Alan, and I enjoy building open source software for computer vision, games, and more. This would be much appreciated during late-night coding sessions! [![Buy Me A Coffee](https://www.buymeacoffee.com/assets/img/custom_images/yellow_img.png)](https://www.buymeacoffee.com/stereoDrift)