tiodh/qwen2-7b-jssp-lora

Qwen2-7B-Instruct + LoRA — Job-Shop Scheduling

A LoRA adapter fine-tuned on the Starjob job-shop scheduling problem (JSSP) dataset. The model takes a natural-language description of jobs and machines and produces a feasible schedule that minimizes makespan.

Training

Hyperparameter	Value
Method	LoRA (use_rslora = false)
LoRA rank r	32
LoRA alpha	32
Max sequence length	8192
Per-device batch	1
Gradient accumulation	8 (effective batch 8)
Epochs	1
Learning rate	2e-4
Base quantization	bnb 4-bit (Unsloth)

Evaluation

200 samples (seed 42) from the small+medium split of Starjob, identical pipeline for LoRA and rsLoRA. Feasibility validates routing order, machine non-overlap, and operation completeness.

Metric	Value
Feasibility	1.0% (2/200)
Exact makespan	3.0% (6/200)
Mean gap	56.30%
Median gap	28.29%
Eval time	38.6 min

Full head-to-head LoRA vs rsLoRA comparison and code: github.com/tiodh/slm_jssp.

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = AutoModelForCausalLM.from_pretrained(
    "Qwen/Qwen2-7B-Instruct",
    device_map="auto",
    torch_dtype="auto",
)
tok = AutoTokenizer.from_pretrained("Qwen/Qwen2-7B-Instruct")
model = PeftModel.from_pretrained(base, "tiodh/qwen2-7b-jssp-lora")

prompt = (
    "Optimize schedule for 3 Jobs (denoted as J) across 3 Machines (denoted as M) "
    "to minimize makespan...\nJ0:\nM0:5 M1:3 M2:4\nJ1:\nM1:2 M0:4 M2:3\nJ2:\nM2:6 M0:1 M1:5\n"
)
inputs = tok(prompt, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=512, temperature=0.1, top_p=0.95)
print(tok.decode(out[0], skip_special_tokens=True))

License

CC BY-SA 4.0 (inherits from the Starjob dataset).