Zhilin at GTC: Introducing Attention Residuals Learning selective memory, rather than mechanically accumulating everything, is the beauty of attention. Many of you have probably read Attention Is All You Need, the 2017 Transformer paper that brought “human-like” attention into the model’s field of view. From that point on, models no longer simply read everything in a mechanical way. Instead, they began to develop a sense of what matters more and what matters less across the text, choosing to retain the more important information. Recently, Kimi applied this idea of attention to the temporal dimension, then rotated it 90 degrees into the model’s depth dimension. This allows the model to have attention not only over time, but also throughout the process of information transmission across layers—giving it a more intelligent way to understand and process information.

🇺🇸Shivon Zilis said she was “let go” by Elon Musk “with no warning” just 1 week after they were still telling each other “love you”. The announcement came after it was noticed that Musk unfollowed her on X. She and Musk have 4 children together through IVF: twins in 2021, a daughter in 2024, and a son in 2025. She posted that she is hurting, hopes they can stay friends and co-parents, and will keep cheering for him. Musk has 14 children with 4 women.

When Zhu Zhili was looking for a base to set up an artificial intelligence film studio in China two years ago, there was just one clear choice: the southern city of Shenzhen with its vast tech ecosystem. This year, AI filmmaker Zhu said he has fielded calls from officials in cities and industrial parks across China, all with the same pitch: bring your AI film business here

Moonshot AI CEO Yang Zhilin surprised some of his Carnegie Mellon professors by choosing to return to China. Now, his Beijing-based startup’s latest private funding round values it at $50 billion. 🔗

Moonshot AI CEO Yang Zhilin surprised some of his Carnegie Mellon professors by choosing to return to China. Now, his Beijing-based startup’s latest private funding round values it at $50 billion.

Turing Award winner Andrew Yao and Moonshot AI founder Zhilin Yang have co-authored a new paper. They're asking a question: Can today's frontier LLMs do real theoretical computer science research? To find out, the team built TCSExam, a new benchmark for AI research. It covers four areas: • Theorem Proving • Solver Engineering • Mathematical Constructions • Open Conjectures Unlike typical benchmarks, TCSExam doesn't just test whether a model can solve a problem. It checks whether its work actually holds up. The team put together 100 tasks for the Full test and 20 for Lite, evaluating 8 agents on Full and 9 on Lite. Every submission is checked by the Lean kernel or an executable checker. Here's what they found. On theorem proving, GPT-6 Astra hit a 70% success rate with no hints. Kimi K3.1 Pro came second at 38.3%. No other model scored above 11.7%. Constructions results: GPT-6 Astra scored 104.9%, beating the existing reference results. Kimi K3 also pushed two records forward: • Graph theory: 630 edges in a 124-vertex graph with no 3- or 4-cycles, up from 629. • Quantum error correction: Improved a code's parameters from [[25,7,5]] to [[25,7,6]]. What about problems that are still unsolved? The team tested 30 open conjectures. No model independently solved any of them from start to finish. AI isn't ready to do frontier research on its own. But it's already producing results that researchers can check and build on.

There's been a lot of "it's over" about Yang Zhilin returning from the US and founding Moonshot in China. Will there be as much "we're so back" about Nathan Chen leaving Moonshot for the Bay Area?

Much to local farmers’ delight, Zuili plums have yielded a bumper harvest in Jiaxing, east China's Zhejiang Province. With an estimated cultivation history of over 2,500 years, the fruit stands out for its translucent amber-colored flesh and sweet, juicy taste.