Ali Hatamizadeh
@ahatamiz1
LLM Tech Lead & Staff Research Scientist @NVIDIA
Co-creator of Gated DeltaNet & Gated DeltaNet-2
加入 June 2015
180 正在关注 4.1K 粉丝
a better recurrence is all you need:
S_t = (I - k_t (b_t . k_t)^T) Diag(exp(g_t)) S_{t-1} + k_t (w_t . v_t)^T
#gdn2#
热门用户
