u/36BrickHunter

Hello everyone,
I'm planning a multi-GPU setup featuring 12 Intel Arc Pro B70 graphics cards, as I require a massive amount of VRAM for a large, unquantized LLM model. However, I've heard that issues tend to arise once you use more than four of these cards—specifically regarding PCIe bandwidth and driver compatibility. Has anyone here dealt with this specific Intel Arc Pro challenge before and can offer advice on how to get it running stably? I'm currently unsure which motherboard and CPU I should choose. Does anyone have tips for building a stable setup, or recommendations for specific boards known to work well in this context? I'd appreciate hearing about any relevant experiences before I dive in. Thanks, everyone!

Hello everyone,

I am planning a multi-GPU rig setup featuring 12 Intel Arc Pro B70 graphics cards, as I require a massive amount of VRAM for a large, unquantized LLM model.
(probably Llama 70b)

However, I have heard that issues arise once you utilize more than four of these cards—specifically regarding
PCIe bandwidth and driver-related problems.

After extensive research, it has become clear to me that the root cause likely lies with Intel's driver support rather than the CPU or motherboard itself. Consequently, I am not only unsure about which CPU and motherboard to select, but also whether a different choice of CPU or motherboard could even help resolve this issue.

Has anyone here encountered this specific Intel Arc Pro problem before and can confirm whether there are any driver updates or workarounds available? I would greatly appreciate hearing about any relevant experiences before I commit to this investment.

Thanks, everyone!