Ask HN: Has anyone made a LLM chatbot small enough to run entirely in a browser?

Google has an experimental API in Chrome using Gemini Nano: https://developer.chrome.com/docs/ai/built-in

A walkthrough showing it in action: https://afficone.com/blog/window-ai-new-chrome-feature-api/

https://huggingface.co/spaces/webml-community/llama-3.2-webg...