EXL3 quantization of Jan-v2-VL-high, 6 bits per weight.

Downloads last month
9
Safetensors
Model size
4B params
Tensor type
F16
路
I16
路
BF16
路
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for isogen/Jan-v2-VL-high-exl3-6bpw

Quantized
(13)
this model