FP8 LLMs for vLLM Collection Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! β’ 42 items β’ Updated about 13 hours ago β’ 76
