3D model control using hand gestures and voice commands

by getToTheChopinon 5/30/2025, 2:04 PMwith 3 comments

by getToTheChopinon 5/30/2025, 2:04 PM

3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser

Created with threejs, mediapipe computer vision, and web speech API

3D model from Quaternius

Here's the live demo if you want to try: https://rosebud.ai/p/93986db5-4d99-437f-9e8b-c8d742e131da

Any feedback would be appreciated!

by nimzoLarsenon 5/30/2025, 2:21 PM

That’s awesome. Can you import new 3D models?