trysem

/

IndicTrans3-beta-Q4_K_M-GGUF

like 0

The runs looks like this

llama-cli --hf-repo trysem/IndicTrans3-beta-Q4_K_M-GGUF --hf-file indictrans3-beta-q4_k_m.gguf -p "The meaning to life and the universe is"

common_download_file_single_online: using cached file: /home/prashant/.cache/llama.cpp/trysem_IndicTrans3-beta-Q4_K_M-GGUF_indictrans3-beta-q4_k_m.gguf

Loading model...  


▄▄ ▄▄
██ ██
██ ██  ▀▀█▄ ███▄███▄  ▀▀█▄    ▄████ ████▄ ████▄
██ ██ ▄█▀██ ██ ██ ██ ▄█▀██    ██    ██ ██ ██ ██
██ ██ ▀█▄██ ██ ██ ██ ▀█▄██ ██ ▀████ ████▀ ████▀
                                    ██    ██
                                    ▀▀    ▀▀

build      : b7490-5182dd64c
model      : trysem_IndicTrans3-beta-Q4_K_M-GGUF_indictrans3-beta-q4_k_m.gguf
modalities : text

available commands:
  /exit or Ctrl+C     stop or exit
  /regen              regenerate the last response
  /clear              clear the chat history
  /read               add a text file


> The meaning to life and the universe is

<|assistant|>
<|assistant|>
<|assistant|>
<|assistant|>

Have you experienced this? I got this with other quants too :{