Running on A100 230 Omnilingual ASR Media Transcription π 230 Transcribe audio or video into text in any language
view post Post 6634 Run DeepSeek-V3.1 locally on 170GB RAM with Dynamic 1-bit GGUFs!πGGUFs: unsloth/DeepSeek-V3.1-GGUFThe 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.Guide: https://docs.unsloth.ai/basics/deepseek-v3.1 See translation β€οΈ 19 19 π₯ 9 9 π 5 5 + Reply
Qwen/Qwen3-235B-A22B-Instruct-2507-FP8 Text Generation β’ 235B β’ Updated Sep 17, 2025 β’ 506k β’ 139
baidu/ERNIE-4.5-300B-A47B-2Bits-Paddle Text Generation β’ 92B β’ Updated Sep 11, 2025 β’ 58 β’ 19
Qwen3 Collection Qwen's new Qwen3 models. In Unsloth Dynamic 2.0, GGUF, 4-bit and 16-bit Safetensor formats. Includes 128K Context Length variants. β’ 79 items β’ Updated 4 days ago β’ 258