注册并分享邀请链接,可获得视频播放与邀请奖励。

Jon Durbin
@jon_durbin
Human. Backend dev
加入 December 2012
146 正在关注    7.4K 粉丝
Still chugging along great, EDA seems much better! Also 7 host failures so far with automatic expert ownership failover. I did experiment also with triadic linear attention adapted to EDA and it didn't seem to have much benefit (probably skill issue on my part):
显示更多
EDA is superior to GDN-2 as it turns out, it avoids the failure mechanism entirely (so far), and the new run (lambda) is blowing past this one (kappa). Might add in triadic EDA next for better long context capability.
显示更多