Designing a shader using voice and hand gestures

by getToTheChopinon 6/19/2025, 12:51 AMwith 1 comments

by getToTheChopinon 6/19/2025, 12:51 AM

This is a computer vision experiment, using voice + hand gestures to control a shader animation.

This uses a liquid Chladni pattern, with controls for color and wave frequency / amplitude.

Created using threejs, mediapipe computer vision, and web speech API.