Surgical video understanding
Collection
LoRA adapters, supervised baselines, and LemonFM linear probes trained for the SDSC x Chicago Booth surgical video understanding leaderboard. • 27 items • Updated
How to use skblv/yolov12m-surgvu-instruments with ultralytics:
from huggingface_hub import hf_hub_download
from ultralytics import YOLO
# pick the weights file from this repo's "Files and versions" tab
weights = hf_hub_download("skblv/yolov12m-surgvu-instruments", "<weights>.pt")
model = YOLO(weights)
source = 'http://images.cocodataset.org/val2017/000000039769.jpg'
model.predict(source=source, save=True)Supervised YOLOv12-m detector trained for the 17 SurgVU instruments, then scored as multi-label presence.
This is the “YOLOv12-m” row on the Instruments tab of the SDSC × Chicago Booth surgical video understanding leaderboard.
This closed-set example mirrors the leaderboard format, not a text-input API for this checkpoint.
[surgical frame]
Which instruments are visible in this robotic surgical frame?
Select every matching label.
- bipolar dissector
- bipolar forceps
- cadiere forceps
- clip applier
- force bipolar
- grasping retractor
- monopolar curved scissors
- needle driver
- permanent cautery hook/spatula
- potts scissors
- prograsp forceps
- stapler
- suction irrigator
- synchroseal
- tenaculum forceps
- tip-up fenestrated grasper
- vessel sealer
Full SurgVU validation split (95% bootstrap CI):
| Metric | Value |
|---|---|
| Exact match | 51.75% (50.97–52.51) |
| Micro-averaged F1 | 75.34% (74.87–75.82) |
Derived from Ultralytics YOLO weights; distributed under AGPL-3.0.
Research baseline only. Not a medical device.