Achieved 5+ tok/s on a 148GB MoE model with a single H200. Reproduced over 30+ cycles with max_diff = 0.0 accuracy.
-Related patent filing in progress.-
더 대단한것도 있지롱
u/Any_Band_7814 — 14 days ago
Achieved 5+ tok/s on a 148GB MoE model with a single H200. Reproduced over 30+ cycles with max_diff = 0.0 accuracy.
-Related patent filing in progress.-
더 대단한것도 있지롱