TODO.
This project was inspired by this post.
The implementation is based on the work available in karpathy/llama2.c.
For the build process, you will need to install ps3toolchain. Make sure it works on your system before proceeding.
After that, it will be necessary to clone karpathy/llama2.c:
git clone https://github.com/karpathy/llama2.c
Download a Llama2 model checkpoint. For example:
wget https://huggingface.co/karpathy/tinyllamas/resolve/main/stories15M.bin -O model.bin
Then, clone this repository:
git clone https://github.com/gusteivos/llama2.ps3.c.git
Copy the required files into the llama2.ps3.c
repository:
cp llama2.c/tokenizer.bin llama2.ps3.c/data/
cp model.bin llama2.ps3.c/data/
Navigate to the repository folder:
cd llama2.ps3.c/
Before using make
to compile the main project, compile and install some modifications made to the PS3 SDK:
make -C psl1ght/ all
Now, compile the main project:
make
The simplest way to run this project is to use RPCS3. Install and configure it by following the instructions available here.
Once RPCS3 is set up, run the compiled project using:
rpcs3 ./llama2.ps3.c.self