runtime error

Exit code: 1. Reason: ": 0.0002, "auto_resume": true, "resume": "results/NextDiT_2B_GQA_patch2_Adaln_Refiner_bs16_lr2e-4_bf16_id-1024-muti_res_all_data_v4/checkpoints/0002000", "init_from": "/mnt/petrelfs/gaopeng/qinqi/lumina2/results/NextDiT_2B_GQA_patch2_Adaln_Refiner_bs16_lr2e-4_bf16_id-1024-muti_res_all_data+high-quality_urtra_continue/checkpoints/0022000", "grad_clip": 2.0, "wd": 0.0, "qk_norm": true, "caption_dropout_prob": 0.1, "snr_type": "lognorm", "no_shift": false } Creating lm: Gemma-2-2B Downloading shards: 0%| | 0/3 [00:00<?, ?it/s] Downloading shards: 33%|███▎ | 1/3 [00:03<00:06, 3.42s/it] Downloading shards: 67%|██████▋ | 2/3 [00:07<00:03, 3.54s/it] Downloading shards: 100%|██████████| 3/3 [00:08<00:00, 2.41s/it] Downloading shards: 100%|██████████| 3/3 [00:08<00:00, 2.70s/it] Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s] Loading checkpoint shards: 100%|██████████| 3/3 [00:00<00:00, 3.66it/s] Creating DiT: NextDiT_2B_GQA_patch2_Adaln_Refiner load model load model finish ZeroGPU tensors packing: 0%| | 0.00/10.8G [00:00<?, ?B/s] ZeroGPU tensors packing: 47%|████▋ | 5.02G/10.8G [00:01<00:01, 5.00GB/s] ZeroGPU tensors packing: 100%|██████████| 10.8G/10.8G [00:01<00:00, 6.51GB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 571, in <module> main() File "/home/user/app/app.py", line 567, in main demo.queue().launch(server_name="0.0.0.0") File "/usr/local/lib/python3.10/site-packages/spaces/zero/gradio.py", line 163, in launch task(*task_args, **task_kwargs) File "/usr/local/lib/python3.10/site-packages/spaces/zero/__init__.py", line 29, in startup client.startup_report(utils.self_cgroup_device_path(), gpu_size) File "/usr/local/lib/python3.10/site-packages/spaces/utils.py", line 37, in self_cgroup_device_path raise Exception # pragma: no cover Exception

Container logs: