TileRT is pushing NVIDIA GPUs into a new regime of ultra-high-interactivity inference, with a specialized decode engine delivering hundreds of tokens per second per user. In its disaggregated prefill/decode architecture, Mooncake Transfer Engine provides the high-performance data path for moving KV cache from vLLM prefill nodes to TileRT decode nodes. Read the full deep dive from SemiAnalysis: #LLMInference# #TileRT# #vLLM# #Mooncake#

ALERT🚨🚨: AMD MI355 is 1.42x FASTER THAN GB300 NVL72. THIS IS ACHIEVED USING THE TILERT SOFTWARE, WHICH GETS 1330 p90 tok/s/user on long context workloads! Thanks to AMD leadership for providing an MI350 cluster to TileRT maintainers, enabling them to achieve this great result!

ALERT🚨: GB300 NVL72 @sgl_project can get close to 1000 tok/s/user on DeepSeek Flash v4.1 by aggressively fusing kernels together!! TileRT started this trend in the ecosystem of megakernel engines on OSS frontier models! Glad to see SGLang widely adopting it! Great work by the SGLang, @radixark, and NVIDIA teams on pushing performance!

How GLM5.3 Sparse Attention Affects HBM Memory Usage GLM-5.3, KV Cache Offloading, HiSparse, AgentX TileRT, InferenceX DeepSeek Sparse Attention, IndexShare, Single-rollout Asynchronous Optimization, Cybersecurity

SemiAnalysis corporate socials are so odd. One day, it's the deepest thing about Tensor Core cycles per instruction & tileRT, and then the next, it's some AI-generated strawberry cartoon Love Island giga slop.

.@tylerthecreator is No. 9 on Billboard's Top Artists of 2025 ranking.⁠ 📈 ⁠ Tyler, The Creator was one of three acts to earn two No. 1 albums this year: 'CHROMOKOPIA' led for three weeks and 'Don’t Tap the Glass,' his most recent and fourth career No. 1, spent a week on top in August.⁠ Full year-end #Artist100# ➡️

.@tylerthecreator is still one of pop music's biggest mavericks — and his latest album 'CHROMAKOPIA' offers his most vulnerable, personal music yet. Read his cover story for the #BillboardNo1s# issue:

All 14 songs from @tylerthecreator's Chromakopia chart on this week's #Hot100#. 📈 Two songs land in the top 10, earning Tyler the first two top 10 hits of his career. Details: