Using hand gestures and voice commands to control a 3D data visualization

by getToTheChopinon 5/29/2025, 6:47 PMwith 2 comments

by sargstuffon 5/30/2025, 1:51 AM

4d sudoku!

?? side list of selectable group colors

?? verbal "set operators" (intersection, difference, union,symetric difference) based on verbally selected item tag names vs. "hand pick" color group/group items to perform set operation.

"blinking" objects/object connectors involved in set operation. Results forming new "color group" of copy of originals vs. moving originals into group per set result. ??

Associate color/group with "gravity well" spot.

by getToTheChopinon 5/29/2025, 6:47 PM

Created using threejs, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library