TheBloke
/

LLongMA-2-7B-GGML

Model card Files Files and versions

This model LLongMA-2-7B ha 8K contest?

#2

by mirek190 - opened Jul 21, 2023

Do I properly understand it?
If yes then under llama.cpp I just need --ctx-size 8186 ?

I'd say use
-c 8192 --rope-freq-base 10000 --rope-freq-scale 0.5"
As TheBloke wrote.

Ohh I see right now ... thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment