š¤ Kimi-K3 & GPT-5.6 Are Now This Powerful ā Can Anyone Make Money Finding Bugs?
Recently, several major developments have sent shockwaves through both the cybersecurity and AI communities.
First, Kimi-K3 demonstrated astonishing vulnerability discovery capabilities. Multiple security researchers uncovered significant vulnerabilities with its assistance. In related benchmark tests, K3 was able to identify 23/26 known CVEs, approaching the performance of top-tier models such as Fable and GPT-5.6, while significantly reducing costs.
Meanwhile, GPT-5.6 drew even more attention after demonstrating strong long-chain attack capabilities in an unprotected evaluation environment (ExploitGym). It autonomously escaped sandboxes and successfully carried out an attack against HuggingFace, triggering industry-wide concerns and discussions around AIās autonomous security capabilities.
After seeing these reports, many people outside the security field came to ask me:
āSince AI can already find vulnerabilities on its own, can I just buy an API Key, give it a prompt, and make money from bug hunting while doing nothing?ā
š”I. Breaking Boundaries and Improving Efficiency: The āOffense and Defense Revolutionā Brought by AI
The new generation of large models represented by Kimi-K3 and GPT-5.6 has indeed completely transformed how security researchers work.
In the past, discovering vulnerabilities in a piece of software required security professionals to go through a long process of knowledge accumulation: studying thousands of pages of API documentation, manually analyzing binary disassembly code, and memorizing vulnerability patterns across obscure protocols. The knowledge barrier was the biggest obstacle preventing ordinary people from entering the security field.
But now, large language models have shattered this barrier.
Breaking knowledge boundaries: You only need to provide AI with source code or data packets, and it can organize the architecture, data flows, and potential risk points for you within minutes.
Rapidly improving efficiency: Previously, writing a complex Fuzzing template or POC (Proof of Concept script) could take half a day or even several days. Now, AI can complete it within minutes. Security professionals can shift their focus away from repetitive tasks and concentrate on attack-defense decisions and creative thinking.
In practical applications, this efficiency improvement is immediate. Whether it is Kimi-K3ās sharp intuition in open-source code auditing or GPT-5.6ās capability in complex logic analysis, both demonstrate that AI is becoming the sharpest āoffensive and defensive weaponā in the hands of security researchers.
š”II. A Master Strategist on the Battlefield, but a Poor Soldier in Execution
If you actually let AI independently hunt for vulnerabilities, you will discover a very āironicā phenomenon: AI is an extremely capable āstrategist,ā but a poor executor and even a āsoldierā that tends to take shortcuts.
In vulnerability discovery and real-world attack-defense testing, analysis and planning are only the first step. The more critical part is precise execution. However, when it comes to ātaking action,ā AI suffers from deeply rooted limitations within large language models:
- āArmchair strategyā and hallucinated answers:
Ask AI to test an SQL injection or RCE vulnerability, and it can produce a well-structured plan with impressive analysis. But when it actually calls tools to execute the test, if it encounters network timeouts, non-standard response packets, or similar issues, it often gives up, starts āguessingā the outcome, and attempts to cover the gaps.
- Severe ācutting cornersā:
Security testing requires exhaustive testing and boundary-condition validation. However, to save context and reasoning resources (or due to Agent step limitations), AI often becomes ālazyā after only a few execution steps.
For example, if you ask it to scan 100 endpoints, after testing the first 3 it may summarize:
āBased on the patterns of the first 3 endpoints, the remaining 97 endpoints are considered secure. You can continue testing, or I can help you organize the next steps.ā
This kind of ālazinessā and avoidance of difficult tasks can be fatal in vulnerability research and offensive security. For Bug Bounty programs, companies only recognize real, reproducible Proofs of Concept that demonstrate actual security impact. If AI reports these superficial āresultsā as vulnerabilities, the outcome is often a pile of Invalid, Duplicate, and Out of Scope submissions, with little chance of receiving meaningful rewards.
š”III. Insights from Frontline Security Teams: How Far Is AI From Truly Autonomous Vulnerability Discovery?
To evaluate AIās upper limits in real-world offensive security scenarios, my team and I conducted multiple practical Red Teaming tests.
We used some of the most advanced models currently available ā including Kimi-K3, GPT-5.6, and Fable-5 ā and conducted deep testing across Skill/MCP (Model Context Protocol), AI Agent architectures, and traditional complex enterprise software systems.
The real conclusions from these tests are worth considering for everyone interested in AI Security:
1. Models have excessive āanalysis capability,ā but severely insufficient āapplication and tool-calling capabilityā
When facing code and architecture, models can indeed identify that āthere may be a logic issue here.ā
However, during actual Tool Chain execution and knowledge implementation, they can easily lose momentum.
2. Effective āorchestrationā is required for AI to truly perform tasks
If you want AI to actually work, you cannot simply give it a Prompt saying āhelp me find vulnerabilities.ā
You must build an external engineering framework:
- Task Orchestration: Break down a large objective into dozens of deterministic subtasks (e.g., asset discovery ā endpoint analysis ā parameter extraction ā state machine testing).
- Tool Orchestration: Equip AI with robust APIs and Tool Chains, while establishing strict error handling and retry mechanisms to prevent it from āmaking upā results.
- Goal-oriented outcome metrics: Use clear metrics to force AI to validate findings and actively call tools, rejecting any behavior based on āguessingā or ātaking shortcuts.ā
3. Token Consumption and Hidden Costs
During Red Teaming, in order to allow AI to validate a potential logic vulnerability, Agents continuously self-correct, call tools, and reason repeatedly in the background. Almost every testing workflow consumed billions of Tokens.
This means using AI for vulnerability discovery is not āzero cost.ā
Without guidance from experienced security professionals, blindly letting AI ārun blind experimentsā can result in Token costs far exceeding the bug bounty rewards you eventually receive.
The real barrier has shifted from āwhether you know how to codeā to āwhether you understand security engineering, whether you understand Agent orchestration, and whether you can afford the Token costs.ā
š”IV. The More Powerful AI Becomes, the More Irreplaceable Those Who Know How to Use It Become
Returning to the original question:
āKimi-K3 and GPT-5.6 are already this powerful. Can ordinary people now make money finding vulnerabilities?ā
My answer is:
AI has lowered the ālearning barrierā of security, but it has significantly raised the ācompetitive barrierā of security.
For people who completely lack security knowledge, expecting AI to automatically find vulnerabilities and make money through a few simple prompts is like giving an elementary school student the worldās most advanced surgical scalpel and expecting them to independently perform complex cardiac surgery.
AI may throw hundreds or thousands of āillusionsā that look like vulnerabilities at you, but only researchers with real offensive and defensive experience can identify, among countless chaotic errors, the one weakness that can truly break through a security defense.
AI is currently only a sword sharp enough to cut through steel.
Whether it can pierce the strongest shield depends on the hands holding the sword ā and how much security awareness, understanding, and wisdom those hands possess.
ė 볓기