ollama on ubuntu 24.04
On Ubuntu 24.04, Ollama runs as a background systemd service by default, which means setting environment variables in your regular ~/.bashrc will not apply to Ollama unless you configure them inside its service override file. Step 1: Configure Ollama on Ubuntu 24.04 Run this command in your terminal to open the systemd override editor for Ollama: bash sudo systemctl edit ollama.service Wees voorzichtig met code. Add the following lines inside the [Service] section (at the top of the file, above the existing comments): ini [Service] Environment="OLLAMA_FLASH_ATTENTION=1" Environment="OLLAMA_KV_CACHE_TYPE=q8_0" Environment="OLLAMA_CONTEXT_LENGTH=16384" Wees voorzichtig met code. Save and exit the editor (Ctrl+O, Enter, Ctrl+X if using nano), then reload and restart the Ollama service: bash sudo systemctl daemon-reload sudo systemctl restart ollama Wees voorzichtig met code. Step 2: Verify It Fits 100% in Your RTX 3060 VRAM 1. Trigger a prompt from your IDE e...