OSSForks/localGPT
1
0
Fork 0
mirror of https://github.com/zebrajr/localGPT.git synced 2025-12-06 00:20:19 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #832 from jxmai/patch-1

Browse Source 
Restore context windows size to 8096 tokens in contants config
This commit is contained in:
PromptEngineer 2024-11-04 07:57:27 -08:00 committed by GitHub
commit b48c62e7b3
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
constants.py
View File

@ -29,7 +29,7 @@ CHROMA_SETTINGS = Settings(
)
# Context Window and Max New Tokens
CONTEXT_WINDOW_SIZE = 2048
CONTEXT_WINDOW_SIZE = 8096
MAX_NEW_TOKENS = CONTEXT_WINDOW_SIZE # int(CONTEXT_WINDOW_SIZE/4)
#### If you get a "not enough space in the buffer" error, you should reduce the values below, start with half of the original values and keep halving the value until the error stops appearing