Can't get past <|assistant|>

#1
by pedrostu - opened

The runs looks like this

llama-cli --hf-repo trysem/IndicTrans3-beta-Q4_K_M-GGUF --hf-file indictrans3-beta-q4_k_m.gguf -p "The meaning to life and the universe is"

common_download_file_single_online: using cached file: /home/prashant/.cache/llama.cpp/trysem_IndicTrans3-beta-Q4_K_M-GGUF_indictrans3-beta-q4_k_m.gguf

Loading model...  


β–„β–„ β–„β–„
β–ˆβ–ˆ β–ˆβ–ˆ
β–ˆβ–ˆ β–ˆβ–ˆ  β–€β–€β–ˆβ–„ β–ˆβ–ˆβ–ˆβ–„β–ˆβ–ˆβ–ˆβ–„  β–€β–€β–ˆβ–„    β–„β–ˆβ–ˆβ–ˆβ–ˆ β–ˆβ–ˆβ–ˆβ–ˆβ–„ β–ˆβ–ˆβ–ˆβ–ˆβ–„
β–ˆβ–ˆ β–ˆβ–ˆ β–„β–ˆβ–€β–ˆβ–ˆ β–ˆβ–ˆ β–ˆβ–ˆ β–ˆβ–ˆ β–„β–ˆβ–€β–ˆβ–ˆ    β–ˆβ–ˆ    β–ˆβ–ˆ β–ˆβ–ˆ β–ˆβ–ˆ β–ˆβ–ˆ
β–ˆβ–ˆ β–ˆβ–ˆ β–€β–ˆβ–„β–ˆβ–ˆ β–ˆβ–ˆ β–ˆβ–ˆ β–ˆβ–ˆ β–€β–ˆβ–„β–ˆβ–ˆ β–ˆβ–ˆ β–€β–ˆβ–ˆβ–ˆβ–ˆ β–ˆβ–ˆβ–ˆβ–ˆβ–€ β–ˆβ–ˆβ–ˆβ–ˆβ–€
                                    β–ˆβ–ˆ    β–ˆβ–ˆ
                                    β–€β–€    β–€β–€

build      : b7490-5182dd64c
model      : trysem_IndicTrans3-beta-Q4_K_M-GGUF_indictrans3-beta-q4_k_m.gguf
modalities : text

available commands:
  /exit or Ctrl+C     stop or exit
  /regen              regenerate the last response
  /clear              clear the chat history
  /read               add a text file


> The meaning to life and the universe is

<|assistant|>
<|assistant|>
<|assistant|>
<|assistant|>

Have you experienced this? I got this with other quants too :{

Sign up or log in to comment