Recommended if you have some experience with the command-line.
On Windows, I additionally recommend carrying out the installation on WSL instead of the base system: WSL installation guide.
https://docs.conda.io/en/latest/miniconda.html
On Linux or WSL, it can be automatically installed with these two commands:
curl -sL "https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh" > "Miniconda3.sh"
bash Miniconda3.sh
Source: https://educe-ubc.github.io/conda.html
sudo apt install build-essential
conda create -n textgen python=3.10.9
conda activate textgen
| System | GPU | Command |
|---|---|---|
| Linux/WSL | NVIDIA | pip3 install torch torchvision torchaudio |
| Linux | AMD | pip3 install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm5.4.2 |
| MacOS + MPS (untested) | Any | pip3 install torch torchvision torchaudio |
The up to date commands can be found here: https://pytorch.org/get-started/locally/.
- MacOS users: oobabooga/text-generation-webui#393
- AMD users: https://rentry.org/eq3hg
git clone https://github.com/Synthintel0/MyGirlGPT
cd MyGirlGPT/opendan-text-generation-webui
pip install -r requirements.txt
python download-model.py TehVenom/Pygmalion-Vicuna-1.1-7b
pip install -r extensions/openai/requirements.txt
cp .env_template .env
Edit following env in the .env file
OPENAI_API_KEY='YOUR OPENAI API KEY'
SD_ADDRESS='SD WEBUI API ADDRESS'
python server.py --listen --chat --character Cherry --extensions openai --model TehVenom_Pygmalion-Vicuna-1.1-7b
Now GTP_SERVER used in TelegramBot is available on the port 5001.
If you want to change server port, just set OPENEDAI_PORT in the .env file.