Source item
Open original source ↗$1,000 for whoever comes up with the best name replacement for InferenceMAX
InferenceMAX 2.0 dropping soon but we have to rename it because HBO MAX sent us a cease and desist.
We have all NVIDIA GPUs from h100 to GB300 on large MoEs with SOTA optimizations like Disagg PD tested