A modest local setup.
- Node.js24 or newer
- OllamaRunning locally
- Starter chat modelllama3.2:3b
- Embedding modelnomic-embed-text
- Server binding127.0.0.1
- AccountNot required
Model quality and speed vary with hardware. Larger models are not automatically better for an undersized machine.