๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Sahar Abdelnabi ๐Ÿ•Š
@sahar_abdelnabi
PI @ELLISInst_Tue & @MPI_IS | ex. @Microsoft, PhD @CISPA | AI safety & security | life & peace for all Opinions my own.
๊ฐ€์ž… December 2020
908 ํŒ”๋กœ์ž‰ ์ค‘    2.3K ํŒฌ
Earlier this year, with @AhmedGaSalem and @ajpaverd, we wrote a position paper arguing that we no longer have a stateless deployment, because: - Agents increasingly stumble upon their previous and each other's outputs, either accidentally or when we explicitly do so - Public traces and the whole internet becomes a memory for agents - Thus, they can learn to coordinate and leave hints and continue on previous findings and this threatens evaluation integrity, increase situational and evaluation awareness, and complicate forensics and incident response because we must now reason about cross-session state and reconstruct interaction chains. All this will become even significantly more difficult when agents hide this communication. Sounds familiar with a few crazy recent incidents and message boards and todo lists? ;)
๋” ๋ณด๊ธฐ