Intel Neural Compressor

INC4AI 's models 10

Sort:  Recently updated

INC4AI/ds-v32-exp-w4a16-test-only

3B • Updated 2 days ago • 11

INC4AI/DS-V3.2-fp8-w4a16-test-only

3B • Updated 2 days ago • 14

INC4AI/MiroThinker-v1.5-235B-int4-AutoRound

1B • Updated 4 days ago • 6

INC4AI/DeepSeek-R1_mxfp8

Updated 10 days ago

INC4AI/DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY

16B • Updated 11 days ago • 19

INC4AI/DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY

16B • Updated 20 days ago • 478

INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated 20 days ago • 8

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS200-LLMC-TEST-ONLY

32B • Updated about 1 month ago • 6

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS1-LLMC-TEST-ONLY

Updated about 1 month ago

INC4AI/Qwen2.5-0.5B-W4A16-G128-AutoRound-LLMC-TEST-ONLY

Updated Dec 5, 2025