Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,25 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
tags:
|
| 4 |
+
- diffusion
|
| 5 |
+
- image-to-image
|
| 6 |
+
- depth-estimation
|
| 7 |
+
- optical-flow
|
| 8 |
+
- amodal-segmentation
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Scaling Properties of Diffusion Models for Perceptual Tasks
|
| 12 |
+
|
| 13 |
+
### CVPR 2025
|
| 14 |
+
|
| 15 |
+
**Rahul Ravishankar\*, Zeeshan Patel\*, Jathushan Rajasegaran, Jitendra Malik**
|
| 16 |
+
|
| 17 |
+
[[Paper](https://arxiv.org/abs/2411.08034)] 路 [[Project Page](https://scaling-diffusion-perception.github.io/)]
|
| 18 |
+
|
| 19 |
+
|
| 20 |
+
In this paper, we argue that iterative computation with diffusion models offers a powerful paradigm for not only generation but also visual perception tasks. We unify tasks such as depth estimation, optical flow, and amodal segmentation under the framework of image-to-image translation, and show how diffusion models benefit from scaling training and test-time compute for these perceptual tasks. Through a careful analysis of these scaling properties, we formulate compute-optimal training and inference recipes to scale diffusion models for visual perception tasks. Our models achieve competitive performance to state-of-the-art methods using significantly less data and compute.
|
| 21 |
+
|
| 22 |
+
|
| 23 |
+
## Getting started
|
| 24 |
+
|
| 25 |
+
You can download our DiT-MoE Generalist model [here](https://huggingface.co/zeeshanp/scaling_diffusion_perception/blob/main/dit_moe_generalist.pt). Please see instructions on how to use our model in the [GitHub README](https://github.com/scaling-diffusion-perception/scaling-diffusion-perception)路
|