• This site is a private, non-commercial website. As such, you're welcome here as long as you were invited. If you would like an invite, reach out to Cliff Spark

Show HN: WebGPU enables local LLM in the browser – demo site with AI chat

  • Thread starter Thread starter andreinwald
  • Start date Start date
A

andreinwald

Browser LLM demo working on JavaScript and WebGPU. WebGPU is already supported in Chrome, Safari, Firefox, iOS (v26) and Android.
Demo, similar to ChatGPT Browser LLM
Code GitHub - andreinwald/browser-llm: Browser LLM demo working on JavaScript and WebGPU
  • No need to use your OPENAI_API_KEY - its local model that runs on your device
  • No network requests to any API
  • No need to install any program
  • No need to download files on your device (model is cached in browser)
  • Site will ask before downloading large files (llm model) to browser cache
  • Hosted on Github Pages from this repo - secure, because you see what you are running


Comments URL: Show HN: WebGPU enables local LLM in the browser – demo site with AI chat | Hacker News

Points: 117

# Comments: 41

Continue reading...
 
Back
Top