sail
/

longspec-Llama-3-8B-Instruct-262k

Text Generation

text-generation-inference

Model card Files Files and versions

This repository contains the LongSpec model described in LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification.

Code: https://github.com/sail-sg/LongSpec

Downloads last month: 21

Safetensors

Model size

0.3B params

Tensor type

F32

·

Paper for sail/longspec-Llama-3-8B-Instruct-262k

LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification

Paper • 2502.17421 • Published Feb 24, 2025