Models

OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc

11B • Updated Apr 24 • 11 • 1

bartowski/Llama-3.3-70B-Instruct-exl2

Text Generation • Updated Dec 20, 2024 • 23 • 3

etemiz/Llama-3.1-70B-Instruct-GGUF

71B • Updated Dec 19, 2024 • 48

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Text Generation • 11B • Updated Jan 3 • 14

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8

Text Generation • 71B • Updated Jan 3 • 14

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF

Text Generation • 71B • Updated Jan 19 • 17

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 18

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 51

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 19 • 23

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF

Text Generation • 71B • Updated Jan 19 • 141

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 24

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 334 • 1

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF

Text Generation • 71B • Updated Jan 19 • 28

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 36

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 65

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF

Text Generation • 71B • Updated Jan 19 • 41

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF

Text Generation • 71B • Updated Jan 19 • 27

tensorblock/Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 9 • 242

context-labs/neuralmagic-llama-3.1-70b-instruct-FP8

Text Generation • 71B • Updated Feb 24 • 9

necva/replicate-IEPile-Llama3.1-70B

73B • Updated Mar 10 • 10

necva/replica-IEPile-Llama3.1-70B

73B • Updated Mar 10 • 7

turboderp/Llama-3.1-70B-Instruct-exl3

Updated Nov 1 • 36 • 1

jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP

11B • Updated Jun 19 • 10

jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP

15B • Updated Jun 19 • 10

jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP

19B • Updated Jun 19 • 8

RedHatAI/Llama-3.1-70B-Instruct-NVFP4

Text Generation • 41B • Updated 23 days ago • 282

RedHatAI/Llama-3.1-70B-Instruct-NVFP4A16

Text Generation • 41B • Updated Jun 30 • 11

Hyun9junn/Llama-3.1-70B-Instruct-W4A4KV4-FlatQuant

36B • Updated Sep 30 • 11

TevunahAi/Llama-3.1-70B-Instruct-Ultra-Hybrid

Text Generation • 22B • Updated 10 days ago • 37