가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Peter Richtarik
@peter_richtarik
Building the foundations of Optimization and AI. Lived in 🇸🇰🇺🇸🇧🇪🇬🇧🇸🇦
가입 December 2015
689 팔로잉 중    9.7K
Every single review I have handled at NeurIPS as an AC is **much worse** than a well executed AI review. By "much worse" I do not mean 20% or 50%. I mean a factor of about 10-100. At least - 10x more mathematical issues are caught, - 10x more missing key citations are caught, - 10x more novelty claims are invalidated with evidence, - 10x more issues with the experiments are observed, - 10x more typos and grammatical issues are fixed, - 10x more inconsistencies are found, and so on. In many cases I have handled over the last 10 years, the human reviews are so bad in comparison that the improvement factor is closer to 100. (The best human reviews I received over the years are worse than an AI review I can generate today, but still entirely good enough to make the correct decision. On the other hand, an AI review is often an almost comprehensive summary of all key issues --- something a human almost never has time to deliver --- and such feedback is immensely useful to the authors) At this point, we would be much better to just 1) give one very thorough ChatGPT review to all submitted papers (I am mainly talking about my fields - optimization, AI, machine learning), automatically, and 2) keep asking for a revision or two (to keep the duration of the process within some bounds) until the number of issues decreases to an extent when the AI reviewer is satisfied, in a given time-frame (eg, 1 month). 3) At that point, a human AC can make a decision (to keep an eye on this all should anything go wrong). The role of the AC would be merely to observe and manage the process, and make a final decision, based on the trajectory of the revisions. I can't believe I am saying this -- AI reviews were a nonsense idea even a year ago. The current AI reviews are super-human.
더 보기