A lightweight dialogue system based on local knowledge base and ChatYuan
First download this repository:
git clone https://github.com/tiansztiansz/langchain-chatyuan.git
Then switch to the project directory:
cd langchain-chatyuan
Installation dependencies:
pip install -r requirements.txt
Please note that this project also requires the punkt package of nltk_data, please download and unzip it to \\wsl.localhost\Ubuntu\home\tiansz\nltk_data\tokenizers\punkt
similar path.
Run the main program:
python3 main.py
The program will look for the 【Answer】 and 【Source】 of the question Can this project run in colab
from the local docs/FAQ.md
file
question:
本项目能否在colab中运行
answer:
可以尝试使用 chatglm-6b-int4 模型在 colab 中运行。需要注意的是,如需在 colab 中运行 Web UI,需将webui.py中demo.queue(concurrency_count=3).launch(server_name='0.0.0.0', share=False, inbrowser=False)中参数share设置为True。
[Document(page_content="Q5: 本项目可否在 colab 中运行? A5: 可以尝试使用 chatglm-6b-int4 模型在colab 中运行,需要注意的是,如需在 colab 中运行 Web UI,需将webui.py中demo.queue(concurrency_count=3).launch(\n server_name='0.0.0.0', share=False, inbrowser=False)中参数share设置为True。", metadata={'source': './docs/FAQ.md', 'filename': 'FAQ.md', 'file_directory': './docs', 'filetype': 'text/markdown', 'page_number': 1, 'category': 'Title', 'score': 198})]