Close to what we are setting up with two-phase review with quick rejection phase 1 (no rebuttal). And phase 1 reviewers need to validate/rebut an AI generated review. That, and all submissions are public, non-official reviewers can also comment live
Let’s say 50,000 ICLR submissions × 3 reviews × 2 hours = 300,000 hours, or 150 person-years of expert labor.
Let’s use AI to fight AI slop. I would suggest adding an AI-only screening round, then send only the papers that pass to human reviewers.
Let’s not break the system.