u/LLMA-O

i tried to upgrade to rocm 7.2.3 and torch 2.10 because "why not" and i have ooms with the same scripts that worked with rocm 7.2.1 and torch 2.9.1

for example a simple script i used to batch generate audio by converting audio tokens back to wavs with Qwen3TTSTokenizer...

i tried all the possible environ combinations also as some ai suggested: torch.backends.cuda.enable_mem_efficient_sdp(False) torch.backends.cuda.enable_flash_sdp(False)

even tried to add cg collect, emptycache after calling decode but it still oom

the script literally just batch decode some thousand token-encoded audios back to wavs 4 at time.

the whole encoded tensors are 53mb and i keep them on ram anyway, i move 4 of them on gpu in the batch loop

ps.

7800xt + wsl on win 10