RedditPP Mascot

RedditPP

r/comfyui • … • u/a_beautiful_rhind

Breaking up checkpoints. Comfy casting woes.

I have recently tried to break up several checkpoints in comfyui. Using load checkpoint, load diffusion model and saving the results to disk.

For wan:

The T2V model will not cast to any precision. It always copies the FP8 scaled weights and saves those regardless if I choose the loading precision like FP16, FP8E5, etc.

The I2V model seems to allow me to save the DiT in BF16/FP16/FP32/etc. To me this makes zero sense.

For chroma:

The scaled FP8 checkpoint will only save as non scaled FP8 E4 or E5, by default it loads as BF16 in the load checkpoint and that's that. Double sized file or lost precision.

model weight dtype torch.bfloat16, manual cast: None model_type FLUX

It's T5 on the other hand, saved as scaled no problem.

Using scaled fp8: fp8 matrix mult: False, scale input: False CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16

What has changed in Comfy that I cannot wrangle this anymore? Is there another node that I could use to not recast the model or some command line switch? Can't just go get the separate file because it's a merged ckpt.

— 0