olivebot/test/ollama/README.md
2024-12-11 15:29:38 +08:00

38 lines
925 B
Markdown
Raw Permalink Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

1、在[ollama官网下载](https://ollama.com/download)安装ollama到本地或者服务器上
2、拉取常见模型(多选一)
```
ollama pull llama2:latest #meta开源模型
ollama pull phi:latest #微软开源模型
ollama pull gemma:latest #google开源模型
ollama pull yi:latest #01开源模型
ollama pull qwen:latest #阿里开源模型
```
3、修改系统配置文件system.conf
本地配置
```
chat_module=ollama_api
ollama_ip = 127.0.0.1
ollama_model = phi:latest # llama2:latest , yi:lastest , pi:latest , gemma:latest (开源大语言模型多选1)
```
服务配置
```
chat_module=ollama_api
ollama_ip = xxx.xxx.xxx.xxx #服务器IP地址
ollama_model = phi:latest # llama2:latest , yi:lastest , pi:latest , gemma:latest (开源大语言模型多选1多选1)
```
4、启动ollama服务
```
python main.py
```
备注ollama接口由亿嘉和具身智能算法工程师陈张提供