Kal'tsit / Cat3.8-27B

QUANTIZED BY: UnstableLlama

Information

exl3 quantizations of Cat3.8-27B, an exllama community model by Kal'tsit, finetuned from Qwen3.8-27B, via exllamav3.

Repo Data

REVISION	GiB	KL DIV	PPL
3.00bpw	12.53	0.0244	1.7197
4.00bpw	15.36	0.0066	1.6874
6.00bpw	21.04	0.0007	1.6747
bf16	51.75	0.0000	1.6765

CLI Download

hf download UnstableLlama/Cat3.8-27B-exl3-6.00bpw --local-dir ./Cat3.8-27B-exl3-6.00bpw

Safetensors

Model size

11B params

Tensor type

BF16

F16

I16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for UnstableLlama/Cat3.8-27B-exl3-6.00bpw

Base model

Finetuned

Quantized

(3)

this model