2024-10-26 11:34:55 +08:00
|
|
|
|
|
2022-06-20 11:05:10 +08:00
|
|
|
|
<div align="center">
|
|
|
|
|
<br>
|
2024-10-26 11:34:55 +08:00
|
|
|
|
<img src="readme/icon.png" alt="Fay">
|
|
|
|
|
<h1>FAY</h1>
|
|
|
|
|
<h3>Fay数字人框架</h3>
|
|
|
|
|
</div>
|
2023-12-14 10:38:08 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
!!重要通知:我们会在2024年12月31日前把Fay的三个版本合并成1个,并致力提供更稳定更全面的功能。
|
2023-12-14 10:38:08 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
我们致力于思考面向终端的数字人落地应用,并通过完整代码把思考结果呈现给大家。Fay数字人框架,向上适配各种数字人模型技术,向下接入各式大语言模型,并且便于更换诸如TTS、ASR等模型,为单片机、app、网站提供全面的数字人应用接口。
|
2024-10-31 00:01:40 +08:00
|
|
|
|
更新日志:https://qqk9ntwbcit.feishu.cn/wiki/UlbZwfAXgiKSquk52AkcibhHngg
|
|
|
|
|
文档:https://qqk9ntwbcit.feishu.cn/wiki/JzMJw7AghiO8eHktMwlcxznenIg
|
2022-06-20 11:05:10 +08:00
|
|
|
|
|
2024-10-09 17:52:15 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
## **功能特点**
|
2024-01-29 18:59:43 +08:00
|
|
|
|
|
2024-03-11 21:10:05 +08:00
|
|
|
|
|
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
- 完全开源,商用免责
|
|
|
|
|
- 支持全离线使用
|
|
|
|
|
- 支持毫秒级回复
|
|
|
|
|
- 自由匹配数字人模型、大语言模型、ASR、TTS模型
|
|
|
|
|
- 支持数字人自动播报模式(虚拟教师、虚拟主播、新闻播报)
|
|
|
|
|
- 支持任意终端使用:单片机、app、网站、大屏、成熟系统接入等
|
|
|
|
|
- 支持多用户多路并发
|
|
|
|
|
- 提供文字沟通接口、声音沟通接口、数字人模型接口、管理控制接口、自动播放接口
|
|
|
|
|
- 支持语音指令灵活配置执行
|
|
|
|
|
- 支持自定义知识库、自定义问答对、自定义人设信息
|
|
|
|
|
- 支持唤醒及打断对话
|
|
|
|
|
- 支持服务器及单机模式
|
|
|
|
|
- 支持机器人表情输出
|
2024-09-20 00:04:07 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
###
|
2024-10-16 20:49:17 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
## **Fay数字人框架**
|
2024-10-16 20:49:17 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
![](readme/chat.png)
|
2024-10-16 20:48:44 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
![](readme/controller.png)
|
2024-10-16 20:48:44 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
## **源码启动**
|
2024-10-16 20:48:44 +08:00
|
|
|
|
|
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
### **环境**
|
|
|
|
|
- Python 3.9、3.10、3.11、3.12
|
|
|
|
|
- Windows、macos、linux
|
2024-10-09 17:52:15 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
### **安装依赖**
|
2024-10-09 17:52:15 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
```shell
|
|
|
|
|
pip install -r requirements.txt
|
|
|
|
|
```
|
2024-10-09 17:52:15 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
### **配置**
|
|
|
|
|
+ 依照说明修改 `./system.conf` 文件
|
2024-10-09 17:52:15 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
### **启动**
|
|
|
|
|
启动Fay控制器
|
|
|
|
|
```shell
|
|
|
|
|
python main.py
|
|
|
|
|
```
|
2024-10-09 17:52:15 +08:00
|
|
|
|
|
2024-09-25 21:55:17 +08:00
|
|
|
|
|
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
## **或docker 启动**
|
2024-09-20 00:04:07 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
1. 下载助理版
|
|
|
|
|
https://github.com/xszyou/Fay
|
|
|
|
|
2. 修改 `./system.conf` 文件
|
|
|
|
|
3. 删除requirements.txt下pyqt5~=5.15.6
|
2024-09-20 00:04:07 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
build (修改配置文件后,需要重新build)
|
|
|
|
|
```shell
|
|
|
|
|
docker build -t fay ./fay-assistant-edition
|
|
|
|
|
```
|
|
|
|
|
run
|
|
|
|
|
```shell
|
|
|
|
|
docker run -it --rm -p 5000:5000 -p 10001:10001 -p 10002:10002 -p 10003:10003 fay
|
|
|
|
|
```
|
2024-04-01 18:09:27 +08:00
|
|
|
|
|
2024-09-11 18:31:18 +08:00
|
|
|
|
|
2024-10-26 11:42:52 +08:00
|
|
|
|
## **高级玩法**
|
2024-09-11 18:31:18 +08:00
|
|
|
|
|
2024-10-26 11:42:52 +08:00
|
|
|
|
![](readme/interface.png)
|
2024-09-11 18:31:18 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
### ***使用数字人(非必须)***
|
2024-09-11 18:31:18 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
ue: https://github.com/xszyou/fay-ue5
|
2024-09-11 18:31:18 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
unity:https://qqk9ntwbcit.feishu.cn/wiki/Se9xw04hUiss00kb2Lmci1BVnM9
|
2024-09-11 18:31:18 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
metahuman-stream(2d):https://qqk9ntwbcit.feishu.cn/wiki/Ik1kwO9X5iilnGkFwRhcnmtvn3e
|
2024-09-11 18:31:18 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
duix(android):https://qqk9ntwbcit.feishu.cn/wiki/Ik1kwO9X5iilnGkFwRhcnmtvn3e()
|
2024-09-04 18:24:46 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
aibote(windows cpu克隆人):[https://qqk9ntwbcit.feishu.cn/wiki/ULaywzVRti0HXWkhCzacoSPAnIg
|
2024-09-04 18:24:46 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
### ***集成到自家产品(非必须)***
|
|
|
|
|
接口:https://qqk9ntwbcit.feishu.cn/wiki/Mcw3wbA3RiNZzwkexz6cnKCsnhh
|
2024-09-04 18:24:46 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
### **联系**
|
2022-06-20 11:05:10 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
**交流群及资料教程**关注公众号 **fay数字人**(**请先star本仓库**)
|
2023-01-31 12:40:36 +08:00
|
|
|
|
|
2024-10-26 11:34:55 +08:00
|
|
|
|
![](readme/gzh.jpg)
|