Our GTC takeaway is clear: NVIDIA is betting hard on open.
- NemoClaw turns OpenClaw into enterprise infrastructure.
- Nemotron 4 will be open-sourced.
- Nemotron Coalition puts eight labs on a shared open frontier model.
This is what we've been building toward. Open infrastructure for open intelligence is the direction the biggest AI companies are taking.
Zhilin at GTC: Introducing Attention Residuals
Learning selective memory, rather than mechanically accumulating everything, is the beauty of attention.
Many of you have probably read Attention Is All You Need, the 2017 Transformer paper that brought “human-like” attention into the model’s field of view. From that point on, models no longer simply read everything in a mechanical way. Instead, they began to develop a sense of what matters more and what matters less across the text, choosing to retain the more important information.
Recently, Kimi applied this idea of attention to the temporal dimension, then rotated it 90 degrees into the model’s depth dimension. This allows the model to have attention not only over time, but also throughout the process of information transmission across layers—giving it a more intelligent way to understand and process information.
The AI compute scaling showcased at #GTC# is incredible. But in Web3 trading, an AI is only as powerful as the data pipeline feeding it.
We built Derivio’s proprietary Data Stream Engine to solve this exact bottleneck—delivering real-time, high-fidelity on-chain data for the Agentic era. ⚡️🛠️
AI models are getting faster (#GTC#), but conventional on-chain data is still lagging.
To unlock true Agentic trading, you need purpose-built infrastructure. That’s why Derivio engineered a high-performance data engine from the ground up.
Better data → Better signals → Seamless execution. 📊⛓️