run llms and slms on your hardware & browser
webgl electron-app webgpu privacy-enhancing-technologies inference-engine ondeviceai on-device-ai llamacpp local-ai node-llama-cpp ollama-app quantizedai offline-inference privateai
-
Updated
Oct 25, 2025 - TypeScript