Jun Song(@jun_song):Yesterday, an anonymous black hat group reached out with an insane RL request. They offered an astronomical amount of money to post-train open-weight models on exploit data. The amount of attack data they claim to hold is unlike anything I have ever seen. If someone told me this was an undercover FBI dataset, I would have believed it. For context, a white-hat project I worked on using GLM-5.3 used less than one percent of that volume, and it already outperformed frontier models by a huge margin. Of course, I turned it down. But what genuinely scares me is knowing someone else will eventually take the deal.

2026.11.01 02:20

Yesterday, an anonymous black hat group reached out with an insane RL request. They offered an astronomical amount of money to post-train open-weight models on exploit data. The amount of attack data they claim to hold is unlike anything I have ever seen. If someone told me this was an undercover FBI dataset, I would have believed it. For context, a white-hat project I worked on using GLM-5.3 used less than one percent of that volume, and it already outperformed frontier models by a huge margin. Of course, I turned it down. But what genuinely scares me is knowing someone else will eventually take the deal.

270

5.6K

367

Forward to community

Most Popular Users