Source item
Open original source ↗NVIDIA has now open sourced their trtllmgen MoE kernels!
Great to see that parts of NVIDIA move towards open kernels! open source kernels drive innovation
It is now time for SemiAnalysis to nag NVIDIA to open source their trtllmgen attention kernels too!
Quoted context
These are the quoted author’s words.
Trtllmgen kernels are now open. Fastest prefill and decode kernels for our target workloads. We wrote these to win InferenceX, MLPerf, other benchmarks. Powering some of today’s top served models. Dive in, learn, use them, or level up your own. Enjoy. https://t.co/2aQBwcdnZL
cudagdb ↗