https://coolscript.net/index.php?action=history&feed=atom&title=Ollama_Systemd_Unit_File_Sample Ollama Systemd Unit File Sample - Revision history 2026-06-02T16:17:37Z Revision history for this page on the wiki MediaWiki 1.40.1 https://coolscript.net/index.php?title=Ollama_Systemd_Unit_File_Sample&diff=1147&oldid=prev Admin: Created page with "== Ollama systemd override (annotated) == === Resource limits === <code> MemoryMax=16G # hard RAM cap (kills process if exceeded)<br> MemoryHigh=14G # soft limit (throttling before hard cap)<br> CPUQuota=400% # limit to ~4 CPU cores </code> === File descriptors === <code> LimitNOFILE=1048576 # prevent "too many open files" </code> === Restart / stability === <code> Restart=on-failure # restart only on crashes<br> RestartSec=3 # delay before restart<br> StartLimitInter..." 2026-04-30T16:29:13Z <p>Created page with &quot;== Ollama systemd override (annotated) == === Resource limits === &lt;code&gt; MemoryMax=16G # hard RAM cap (kills process if exceeded)&lt;br&gt; MemoryHigh=14G # soft limit (throttling before hard cap)&lt;br&gt; CPUQuota=400% # limit to ~4 CPU cores &lt;/code&gt; === File descriptors === &lt;code&gt; LimitNOFILE=1048576 # prevent &quot;too many open files&quot; &lt;/code&gt; === Restart / stability === &lt;code&gt; Restart=on-failure # restart only on crashes&lt;br&gt; RestartSec=3 # delay before restart&lt;br&gt; StartLimitInter...&quot;</p> <p><b>New page</b></p><div>== Ollama systemd override (annotated) ==<br /> <br /> === Resource limits ===<br /> &lt;code&gt;<br /> MemoryMax=16G # hard RAM cap (kills process if exceeded)&lt;br&gt;<br /> MemoryHigh=14G # soft limit (throttling before hard cap)&lt;br&gt;<br /> CPUQuota=400% # limit to ~4 CPU cores<br /> &lt;/code&gt;<br /> <br /> === File descriptors ===<br /> &lt;code&gt;<br /> LimitNOFILE=1048576 # prevent &quot;too many open files&quot;<br /> &lt;/code&gt;<br /> <br /> === Restart / stability ===<br /> &lt;code&gt;<br /> Restart=on-failure # restart only on crashes&lt;br&gt;<br /> RestartSec=3 # delay before restart&lt;br&gt;<br /> StartLimitIntervalSec=60&lt;br&gt;<br /> StartLimitBurst=5 # avoid infinite restart loops<br /> &lt;/code&gt;<br /> <br /> === IO / disk behavior ===<br /> &lt;code&gt;<br /> IOSchedulingClass=best-effort&lt;br&gt;<br /> IOSchedulingPriority=4<br /> &lt;/code&gt;<br /> <br /> === Optional CPU pinning ===<br /> &lt;code&gt;<br /> <br /> CPUAffinity=0 1 2 3 # bind to specific cores<br /> &lt;/code&gt;<br /> <br /> === Security (light sandboxing) ===<br /> &lt;code&gt;<br /> NoNewPrivileges=true&lt;br&gt;<br /> PrivateTmp=true&lt;br&gt;<br /> ProtectSystem=full&lt;br&gt;<br /> ProtectHome=true<br /> &lt;/code&gt;<br /> <br /> === Logging ===<br /> &lt;code&gt;<br /> StandardOutput=journal&lt;br&gt;<br /> StandardError=journal&lt;br&gt;<br /> LogRateLimitIntervalSec=0<br /> &lt;/code&gt;<br /> <br /> === Ollama tuning ===<br /> &lt;code&gt;<br /> Environment=&quot;OLLAMA_NUM_PARALLEL=2&quot; # concurrent requests&lt;br&gt;<br /> Environment=&quot;OLLAMA_MAX_LOADED_MODELS=1&quot; # avoid VRAM exhaustion&lt;br&gt;<br /> Environment=&quot;OLLAMA_KEEP_ALIVE=5m&quot; # unload after idle&lt;br&gt;<br /> <br /> Environment=&quot;OLLAMA_HOST=127.0.0.1&quot; # bind local only<br /> &lt;/code&gt;<br /> <br /> == Minimal working example ==<br /> &lt;code&gt;<br /> [Service]&lt;br&gt;<br /> MemoryMax=16G&lt;br&gt;<br /> CPUQuota=400%&lt;br&gt;<br /> LimitNOFILE=1048576&lt;br&gt;<br /> Restart=on-failure&lt;br&gt;<br /> RestartSec=3&lt;br&gt;<br /> Environment=&quot;OLLAMA_NUM_PARALLEL=2&quot;&lt;br&gt;<br /> Environment=&quot;OLLAMA_MAX_LOADED_MODELS=1&quot;<br /> &lt;/code&gt;</div> Admin