OliveSensorAPI/docs/quick_start_EN.md

1. Deployment Environment

• Operating system: Ubuntu 22.04.4 LTS
• CPU: Intel (R) Xeon (R) CPU E 5-2650, 32G
• Graphics card: NVIDIA RTX 4060Ti 16G, NVIDIA-SMI 535.104.05 Driver Version: 535.104.05 CUDA Version: 12.2
• Python 3.11.5

2. Default Deployment Steps

• 1. Clone the code or manually download the code and place it on the server:

git clone https://github.com/SmartFlowAI/EmoLLM.git

• 2. Install Python dependencies:

# cd EmoLLM
# pip install -r requirements.txt

• 3. Install the oss2 library for automatic model download (missing from the requirements.txt file):

# pip install oss2

• 4. Important:Download the model catalog, select the model you want to use, to download the model catalog manually, go to openxlab (like EmoLLM_Model) or Huggingface or other platforms, Place all files in the EmoLLM/model directory. Note that this step is mandatory, otherwise the automatic download will report an error, The package download does not download the full LFS (like pytorch_model-00001-of-00008.bin) file, just a reference to it.
• 5. Download the model, specifically the pytorch_model-XXX.bin file in the model,
     models can be downloaded manually or automatically.
• 5.1. Models can be downloaded manually from openxlab or other platforms, put all the files in the EmoLLM/model directory, and then modify the web_demo-aiwei.py or web_internlm2.py files (whichever one is called by app.py) by commenting out the following code at the beginning, to prevent the script from automatically re-downloading the model：

# download(model_repo='ajupyter/EmoLLM_aiwei',
#        output='model')

• 5.2. Automatic model download, There are three files in the EmoLLM directory, app.py、web_demo-aiwei.py、web_internlm2.py, app.py calls the last two scripts. Comment out the other script if you want to call it. Run:

# python ./app.py

• Note: By default, web_demo-aiwei.py automatically downloads the ajupyter/EmoLLM_aiwei model of openxlab platform, and web_internlm2.py downloads the jujimeizuo/EmoLLM_Model model. The script will automatically download the model to EmoLLM/model directory, after the download is completed and run successfully, follow the manual download operation in 5.1 to modify the web_demo-aiwei.py or web_internlm2.py file to comment out the download code, so as to prevent re-downloading in the next run. 6、 Run app.py and wait for the model to download and load. Then access the model web page through your browser by going to: http://0.0.0.0:7860 address. You can modify the app.py file to change the web page access port.

7. Use of other models, EmoLLM offers several versions of the open source model, uploaded to openxlab、Huggingface, and other platforms. There are roles such as the father's boyfriend counselor, the old mother's counselor, and the gentle royal psychiatrist. There are several models to choose from such as EmoLLM_internlm2_7b_full, EmoLLM-InternLM7B-base-10e and so on. Current review [EmoLLM_internlm2_7b_ful] (https://openxlab.org.cn/models/detail/ajupyter/EmoLLM_internlm2_7b_full) model works better. You can repeat steps 4 and 5 to download the model manually or automatically in the EmoLLM/model directory or modify the download function in web_demo-aiwei.py or web_internlm2.py to download the model automatically.