llama2psp

A quick homebrew for running llama2.c on the PSP.

Prerequisites

You will need docker and can use the ticky/pspdev docker image.

docker pull ticky/pspdev

How to build

• Clone this repo and cd into the repo folder.

Run:

docker run -it --rm -v "$PWD:/src" ticky/pspdev make

Installation

• Put the EBOOT.PBP in the following directory PSP/GAME/llama2psp/EBOOT.PBP as well as the model named model.bin and tokenizer named tok.bin

• Models and tokenizer have to be in the llama2.c format and can be downloaded here

• Due to the hardware limitations of the PSP, I used the smallest 260k model and its tokenizer.