WebGPU in Chrome Canary now supports float16 for faster local LLM inference

by NiekvdMaason 9/5/2023, 4:29 AMwith 5 comments

by no_timeon 9/5/2023, 6:55 AM

I hope they gate webGPU behind a per domain allow/deny notification like they do with location and camera access.

This whole thing is just begging to be exploited by cryptominers.

by NiekvdMaason 9/5/2023, 4:31 AM

To test, run Chrome Canary with:

  --enable-dawn-features=allow_unsafe_apis,disable_robustness
Then, open: https://webllm.mlc.ai/#chat-demo