Zhilin at GTC: Introducing Attention Residuals Learning selective memory, rather than mechanically accumulating everything, is the beauty of attention. Many of you have probably read Attention Is All You Need, the 2017 Transformer paper that brought “human-like” attention into the model’s field of view. From that point on, models no longer simply read everything in a mechanical way. Instead, they began to develop a sense of what matters more and what matters less across the text, choosing to retain the more important information. Recently, Kimi applied this idea of attention to the temporal dimension, then rotated it 90 degrees into the model’s depth dimension. This allows the model to have attention not only over time, but also throughout the process of information transmission across layers—giving it a more intelligent way to understand and process information.

When Zhu Zhili was looking for a base to set up an artificial intelligence film studio in China two years ago, there was just one clear choice: the southern city of Shenzhen with its vast tech ecosystem. This year, AI filmmaker Zhu said he has fielded calls from officials in cities and industrial parks across China, all with the same pitch: bring your AI film business here

Moonshot AI CEO Yang Zhilin surprised some of his Carnegie Mellon professors by choosing to return to China. Now, his Beijing-based startup’s latest private funding round values it at $50 billion. 🔗

Moonshot AI CEO Yang Zhilin surprised some of his Carnegie Mellon professors by choosing to return to China. Now, his Beijing-based startup’s latest private funding round values it at $50 billion.

Much to local farmers’ delight, Zuili plums have yielded a bumper harvest in Jiaxing, east China's Zhejiang Province. With an estimated cultivation history of over 2,500 years, the fruit stands out for its translucent amber-colored flesh and sweet, juicy taste.

Discover how Kimi K2.5 pushes the boundaries of AI training at scale at #NVIDIAGTC#. Join Zhilin Yang, Founder & CEO of @Kimi_Moonshot to explore the strategies driving their massive-scale pre-training. 🗓️ Tues. March 17 | 11:00 a.m. - 11:40 a.m. PDT Add to your schedule:

BREAKING: Six Neuralink patients are now sharing their thoughts through one public 𝕏 account, @Shivolink Shivolink is a nonprofit research experiment run by MIT students and backed by Neuralink’s Shivon Zilis. The six participants live in different parts of the world but post through one shared identity. How it works: • A neural interface reads the words a participant intends to say • The signal is converted into text • The participant chooses what to share • The message appears on the shared X account The participants remain anonymous, and no medical records, facial images or precise locations are published. Neuralink’s research is deeply misunderstood and believes projects like this can demonstrate its real potential. Shivolink is not a Neuralink product or clinic. It is a powerful independent experiment showing how brain-computer interfaces could give people with disabilities a direct voice, greater independence and a new way to connect with the world.