u/Achso998

▲ 10 r/comfyui

So in the last couple of days I tried Video Generation with LTX2.3 on my RX 6800 and 32gb of DDR5 RAM on Linux. I had Confyui with ROCM 7.2 installed, but no matter what even with low quantization I got OOM Errors every time I wanted to generate any Videos. No matter of which workflow. So I wanted to share how I solved this for people with similar problems.

I thought it was because I had an RDNA 2 AMD card or something, but then I noticed that it fails every time on the Video VAE Decode. That was because the other used models weren't unloaded even if not needed and I couldn't get them unloaded during Generation even with custom Nodes.

The Trick here is to directly save the Audio and Video Latents to a .latent file with the native SaveLatent Note and then end the generation. Then unload all models with the manager or restart the server and in an other workflow Load the Latents (Must be in ComfyUI/input) and the VAEs for them and Create the Video. This way you have enough VRAM free to Decode the Latents without a OOM Error, even if this is a unhandy way.

I hope this helps if someone is experiencing similar problems!

TL;DR: Save the Latents instead of encoding them and unload all Models from the Manager to free up your Memory. Then Encode them in a extra workflow and create your video with or without audio there to prevent oom Errors.

reddit.com
u/Achso998 — 13 days ago
▲ 3 r/LocalLLM+1 crossposts

I thought of upgrading my RX 6800 for Local LLMs (Mostly Agentic Coding) and Video Generation on Linux.

I focused on the AMD PRO R9700 32gb and the PRO W7900 48gb because performance on Linux is very good with AMD and both cards have a great amount of VRAM.

But I've seen no comparisons of which card is better. On the one hand the W7900 has more VRAM with a higher Memory Bandwidth, but the R9700 on the other hand is on RDNA 4 and has fp8 support. So I'm unsure which card to buy for better Inference, also given the price difference of almost 2000€ in my Region. And a Dual GPU setup is sadly not viable with my PSU and Motherboard/Airflow.

If you have any experiences with both cards please let me know which is the better buy!

reddit.com
u/Achso998 — 13 days ago