Source item
Open original source ↗Only NVIDIA, AWS, Google have successfully deployed rack scale architecture
Trn3 is the 2nd after Nvidia with switched scale up topology, which is better for frontier mixture of experts models
AWS Trainium3 course corrects on software
Switch design choices are... interesting
Quoted context
These are the quoted author’s words.
AWS Trainium3 Deep Dive, A Potential Challenger Approaching, Step-Function Software & System Improvements, “Amazon Basics” GB200 NVL36x2, NL72x2/NL32x2 Scale Up Rack Architecture, Optimized Perf per TCO, Trainium4 https://t.co/HFCLkibtS4 https://t.co/CcN45pFw36
SemiAnalysis_ ↗