登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Chad Hurley is Volatile Markets
@volatilemarkts
Primary work in Health Care. Passion for Markets, Technicals, AI Modeling and persistent memory agents. Acquire the compute while you can…
参加 February 2024
1.6K フォロー中    2.8K ファン
🚨 BREAKING NEWS: GLM 5.4 or 5.5, possibly GLM Omni!! Zhipu AI & Tsinghua Redefine Multimodal Intelligence with Groundbreaking Unified Memory Research! 🚨 Once again, the team at (Zhipu AI) and Tsinghua University is proving why they are setting the gold standard and leading the open-source AI revolution from the frontlines. In a newly released landmark paper—authored by Wenkai Li, Wenyi Hong, Zhuoyi Yang, and Jie Tang—the team answers one of the most critical questions in next-generation frontier architectures: "Can Visual Generation Expand What Unified Multimodal Models Know?"  🔗 Paper Link: 📰 THE DISCOVERY: Bridging the "Modal Aphasia" Gap Traditional AI treats visual generation as a downstream aesthetic output. flips the script, demonstrating that image generation is actually a primary knowledge channel that expands the model's core latent memory.  Using a rigorous new benchmarking protocol called Knowledge Transfer Probing (KTP), the researchers taught models entirely new factual concepts strictly through image generation tasks.  While models initially exhibited "modal aphasia"—the fascinating phenomenon where a model can draw a complex concept perfectly in pixels but struggle to articulate it in pure text—the team uncovered the exact blueprint to solve it:  1. Interleaved Image-Text Alignment: Integrating generation, visual observation, and textual reasoning into a single fluid token stream doesn't just improve recall—it more than doubles text-based QA accuracy (boosting benchmark scores from 12.57% to 26.86% on GLM-Omni)! 2. Implicit Cross-Entity Generalization: Training the model on a small subset of visual entities bootstraps recall across entirely unseen entities in the same category without ever needing direct QA supervision. 🏆 WHY CONTINUES TO LEAD OPEN SOURCE While other labs keep their foundational research behind locked doors, and Tsinghua continue to publish real, fundamental breakthroughs in the open. By treating generation and understanding as a single, mutually reinforcing cognitive loop, they aren't just building models—they are writing the roadmap for true native multimodality.  Huge congratulations to Wenkai Li, Wenyi Hong, Zhuoyi Yang, and Jie Tang for another masterclass in open science and architectural innovation! The GLM lineage continues to show the entire industry where foundation models are heading next 🚀⚡️ @Zai_org really need @MiaAI_lab and @ashxhart @JoshuaSWarren @petruspennanen to get some early access to GLM Omni for zero day support for Sparks and Mac Studios!!! #AI# #MachineLearning# #GLM# #OpenSource# #DeepLearning# #ZhipuAI# #Multimodal# #arXiv#
もっと見る