H100/H200 still seem to be where larger AI workloads are going despite the higher cost, while RTX setups look much more practical for smaller inference and testing workloads
Might just be me, but planning GPU setups feels a bit more unpredictable recently
Between availability, timelines, and changing demand, things don’t seem as straightforward as before
Curious if others are seeing the same or if it’s just my perspective
Might just be what I’m seeing, but scaling GPU setups seems a bit more complex lately with demand picking up again
Trying to understand what usually becomes the limiting factor in real setups
Is it more around power/cooling, availability, networking, or something else?
Curious what people here have run into