čØ»å†Šäø¦åˆ†äŗ«é‚€č«‹é€£ēµļ¼ŒåÆē²å¾—å½±ē‰‡ę’­ę”¾čˆ‡é‚€č«‹ēŽå‹µć€‚

GoPlus Security 🚦
@GoPlusSecurity
Protect Your Every Transaction. User App: šŸ›”ļø Dev Integration: Security Intelligence & SafeToken Protocol šŸ›”ļø
加兄 May 2021
1.1K ę­£åœØé—œę³Ø    443.6K 粉絲
šŸ¤– Kimi-K3 & GPT-5.6 Are Now This Powerful — Can Anyone Make Money Finding Bugs? Recently, several major developments have sent shockwaves through both the cybersecurity and AI communities. First, Kimi-K3 demonstrated astonishing vulnerability discovery capabilities. Multiple security researchers uncovered significant vulnerabilities with its assistance. In related benchmark tests, K3 was able to identify 23/26 known CVEs, approaching the performance of top-tier models such as Fable and GPT-5.6, while significantly reducing costs. Meanwhile, GPT-5.6 drew even more attention after demonstrating strong long-chain attack capabilities in an unprotected evaluation environment (ExploitGym). It autonomously escaped sandboxes and successfully carried out an attack against HuggingFace, triggering industry-wide concerns and discussions around AI’s autonomous security capabilities. After seeing these reports, many people outside the security field came to ask me: ā€œSince AI can already find vulnerabilities on its own, can I just buy an API Key, give it a prompt, and make money from bug hunting while doing nothing?ā€ šŸ’”I. Breaking Boundaries and Improving Efficiency: The ā€œOffense and Defense Revolutionā€ Brought by AI The new generation of large models represented by Kimi-K3 and GPT-5.6 has indeed completely transformed how security researchers work. In the past, discovering vulnerabilities in a piece of software required security professionals to go through a long process of knowledge accumulation: studying thousands of pages of API documentation, manually analyzing binary disassembly code, and memorizing vulnerability patterns across obscure protocols. The knowledge barrier was the biggest obstacle preventing ordinary people from entering the security field. But now, large language models have shattered this barrier. Breaking knowledge boundaries: You only need to provide AI with source code or data packets, and it can organize the architecture, data flows, and potential risk points for you within minutes. Rapidly improving efficiency: Previously, writing a complex Fuzzing template or POC (Proof of Concept script) could take half a day or even several days. Now, AI can complete it within minutes. Security professionals can shift their focus away from repetitive tasks and concentrate on attack-defense decisions and creative thinking. In practical applications, this efficiency improvement is immediate. Whether it is Kimi-K3’s sharp intuition in open-source code auditing or GPT-5.6’s capability in complex logic analysis, both demonstrate that AI is becoming the sharpest ā€œoffensive and defensive weaponā€ in the hands of security researchers. šŸ’”II. A Master Strategist on the Battlefield, but a Poor Soldier in Execution If you actually let AI independently hunt for vulnerabilities, you will discover a very ā€œironicā€ phenomenon: AI is an extremely capable ā€œstrategist,ā€ but a poor executor and even a ā€œsoldierā€ that tends to take shortcuts. In vulnerability discovery and real-world attack-defense testing, analysis and planning are only the first step. The more critical part is precise execution. However, when it comes to ā€œtaking action,ā€ AI suffers from deeply rooted limitations within large language models: - ā€œArmchair strategyā€ and hallucinated answers: Ask AI to test an SQL injection or RCE vulnerability, and it can produce a well-structured plan with impressive analysis. But when it actually calls tools to execute the test, if it encounters network timeouts, non-standard response packets, or similar issues, it often gives up, starts ā€œguessingā€ the outcome, and attempts to cover the gaps. - Severe ā€œcutting cornersā€: Security testing requires exhaustive testing and boundary-condition validation. However, to save context and reasoning resources (or due to Agent step limitations), AI often becomes ā€œlazyā€ after only a few execution steps. For example, if you ask it to scan 100 endpoints, after testing the first 3 it may summarize: ā€œBased on the patterns of the first 3 endpoints, the remaining 97 endpoints are considered secure. You can continue testing, or I can help you organize the next steps.ā€ This kind of ā€œlazinessā€ and avoidance of difficult tasks can be fatal in vulnerability research and offensive security. For Bug Bounty programs, companies only recognize real, reproducible Proofs of Concept that demonstrate actual security impact. If AI reports these superficial ā€œresultsā€ as vulnerabilities, the outcome is often a pile of Invalid, Duplicate, and Out of Scope submissions, with little chance of receiving meaningful rewards. šŸ’”III. Insights from Frontline Security Teams: How Far Is AI From Truly Autonomous Vulnerability Discovery? To evaluate AI’s upper limits in real-world offensive security scenarios, my team and I conducted multiple practical Red Teaming tests. We used some of the most advanced models currently available — including Kimi-K3, GPT-5.6, and Fable-5 — and conducted deep testing across Skill/MCP (Model Context Protocol), AI Agent architectures, and traditional complex enterprise software systems. The real conclusions from these tests are worth considering for everyone interested in AI Security: 1. Models have excessive ā€œanalysis capability,ā€ but severely insufficient ā€œapplication and tool-calling capabilityā€ When facing code and architecture, models can indeed identify that ā€œthere may be a logic issue here.ā€ However, during actual Tool Chain execution and knowledge implementation, they can easily lose momentum. 2. Effective ā€œorchestrationā€ is required for AI to truly perform tasks If you want AI to actually work, you cannot simply give it a Prompt saying ā€œhelp me find vulnerabilities.ā€ You must build an external engineering framework: - Task Orchestration: Break down a large objective into dozens of deterministic subtasks (e.g., asset discovery → endpoint analysis → parameter extraction → state machine testing). - Tool Orchestration: Equip AI with robust APIs and Tool Chains, while establishing strict error handling and retry mechanisms to prevent it from ā€œmaking upā€ results. - Goal-oriented outcome metrics: Use clear metrics to force AI to validate findings and actively call tools, rejecting any behavior based on ā€œguessingā€ or ā€œtaking shortcuts.ā€ 3. Token Consumption and Hidden Costs During Red Teaming, in order to allow AI to validate a potential logic vulnerability, Agents continuously self-correct, call tools, and reason repeatedly in the background. Almost every testing workflow consumed billions of Tokens. This means using AI for vulnerability discovery is not ā€œzero cost.ā€ Without guidance from experienced security professionals, blindly letting AI ā€œrun blind experimentsā€ can result in Token costs far exceeding the bug bounty rewards you eventually receive. The real barrier has shifted from ā€œwhether you know how to codeā€ to ā€œwhether you understand security engineering, whether you understand Agent orchestration, and whether you can afford the Token costs.ā€ šŸ’”IV. The More Powerful AI Becomes, the More Irreplaceable Those Who Know How to Use It Become Returning to the original question: ā€œKimi-K3 and GPT-5.6 are already this powerful. Can ordinary people now make money finding vulnerabilities?ā€ My answer is: AI has lowered the ā€œlearning barrierā€ of security, but it has significantly raised the ā€œcompetitive barrierā€ of security. For people who completely lack security knowledge, expecting AI to automatically find vulnerabilities and make money through a few simple prompts is like giving an elementary school student the world’s most advanced surgical scalpel and expecting them to independently perform complex cardiac surgery. AI may throw hundreds or thousands of ā€œillusionsā€ that look like vulnerabilities at you, but only researchers with real offensive and defensive experience can identify, among countless chaotic errors, the one weakness that can truly break through a security defense. AI is currently only a sword sharp enough to cut through steel. Whether it can pierce the strongest shield depends on the hands holding the sword — and how much security awareness, understanding, and wisdom those hands possess.
é”Æē¤ŗę›“å¤š