Skip to content

Latest commit

 

History

History
 
 

python

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
README.md
README.md
 
 
models.py
models.py
 
 
server.py
server.py
 
 

README.md

Python Server for External Models

Requirements

conda create --name lean-copilot python=3.10 python numpy
conda activate lean-copilot
pip install torch --index-url https://download.pytorch.org/whl/cu121  # Depending on whether you have CUDA and the CUDA version; see https://pytorch.org/.
pip install fastapi uvicorn loguru transformers openai

Running the Server

uvicorn server:app --port 23337