注册并分享邀请链接,可获得视频播放与邀请奖励。

Cheryl Wu
@cherylwoooo
Econ PhD student @Yale | research scholar @GovAIOrg | @nsf grf | previously @uchicago undergrad | 📷 | 🎹 | 🍪 | Views are my own
加入 July 2021
1.1K 正在关注    3.9K 粉丝
I appreciate this as an initial step toward more transparent reporting on RSI. But there is still much further data we need to fully understand RSI. In particular, OAI disclosed some evidence about the inference compute usage, number of experiments/researcher, and to a lesser extent, how researchers interact with models of different capabilities (see the green boxes in the diagram). However, the evidence they provided is just on the input side (tokens, lines of code). We urgently need to know how these inputs get turned into algorithmic improvements and [probably internally deployed] AI capabilities. Even just a simple time series on those outcome variables would be extremely valuable. You can then know, as AI helps researchers do more AI R&D, how the corresponding algorithm efficiency grows (the blue arrow C -> A dot). Right now we are missing this key puzzle piece.
显示更多
0
8
116
16
转发到社区