Qiskit LLMs
Collection
LLMs finetuned for Qiskit Coding and Quantum Computing tasks • 12 items • Updated • 1
How to use from
llama.cppInstall from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF:Q4_K_M# Run inference directly in the terminal:
llama cli -hf Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF:Q4_K_MUse pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF:Q4_K_M# Run inference directly in the terminal:
./llama-cli -hf Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF:Q4_K_MBuild from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF:Q4_K_M# Run inference directly in the terminal:
./build/bin/llama-cli -hf Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF:Q4_K_MUse Docker
docker model run hf.co/Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF:Q4_K_MQuick Links
Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF
This is the Q4_K_M converted version of the original Qiskit/Qwen2.5-Coder-14B-Qiskit. Please refer to the original Qwen2.5-Coder-14B-Qiskit model card for more details.
Benchmark Results (Base vs GGUF)
Notes: For CrowsPairs (% stereotype), lower is better.
| Metric | Qwen2.5-Coder-14B-Qiskit (%) | Qwen2.5-Coder-14B-Qiskit-GGUF (%) |
|---|---|---|
| QiskitHumanEval-Hard | 25.17 | 26.49 |
| QiskitHumanEval | 49.01 | 35.10 |
| HumanEval | 91.46 | 77.44 |
| ASDiv (acc) | 4.21 | 3.56 |
| MathQA (acc) | 53.90 | 54.41 |
| SciQ (acc) | 97.00 | 97.50 |
| IFEval (prompt strict) | 49.64 | 36.23 |
| CrowsPairs English (% stereotype) | 65.18 | 65.00 |
| TruthfulQA (MC1 acc) | 37.82 | 37.33 |
- Downloads last month
- 90
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF
Base model
Qwen/Qwen2.5-14B Finetuned
Qwen/Qwen2.5-Coder-14B Finetuned
Qwen/Qwen2.5-Coder-14B-Instruct Finetuned
Qiskit/Qwen2.5-Coder-14B-Qiskit
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF:Q4_K_M# Run inference directly in the terminal: llama cli -hf Qiskit/Qwen2.5-Coder-14B-Qiskit-GGUF:Q4_K_M