Ollama

https://github.com/ollama/ollama
https://github.com/ollama/ollama/blob/main/docs/linux.md

Ollama是一个开源的大型语言模型服务,启动并运行 Llama 2，Mistral，Gemma 和其他大型语言模型。

安装

curl -fsSL https://ollama.com/install.sh | sh

>>> Installing ollama to /usr/local/bin...
[sudo] password for wy: 
>>> Creating ollama user...
>>> Adding ollama user to render group...
>>> Adding ollama user to video group...
>>> Adding current user to ollama group...
>>> Creating ollama systemd service...
>>> Enabling and starting ollama service...
Created symlink /etc/systemd/system/default.target.wants/ollama.service → /etc/systemd/system/ollama.service.
>>> NVIDIA GPU installed.

使用

ollama run llama2

ollama list