OSSForks/ollama
1
0
Fork 0
mirror of https://github.com/zebrajr/ollama.git synced 2025-12-06 12:19:56 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
c5bafaff54
ollama/server
History
Bruce MacDonald c5bafaff54 package server with client
2023-06-23 18:38:22 -04:00
..
build.py package server with client 2023-06-23 18:38:22 -04:00
README.md build server executable 2023-06-23 17:23:30 -04:00
requirements.txt build server executable 2023-06-23 17:23:30 -04:00
server.py package server with client 2023-06-23 18:38:22 -04:00

README.md

Server

🙊

Installation

If using Apple silicon, you need a Python version that supports arm64:

wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
bash Miniforge3-MacOSX-arm64.sh

Get the dependencies:

pip install llama-cpp-python
pip install -r requirements.txt

Building

python3 build.py

Running

Put your model in models/ and run:

python server.py

API

POST /generate

model: string - The name of the model to use in the models folder. prompt: string - The prompt to use.