🤖 Kimi-K3 & GPT-5.6 Are Now This Powerful — Can Anyone Make Money Finding Bugs?
Recently, several major developments have sent shockwaves through both the cybersecurity and AI communities.
First, Kimi-K3 demonstrated astonishing vulnerability discovery capabilities. Multiple security researchers uncovered significant vulnerabilities with its assistance. In related benchmark tests, K3 was able to identify 23/26 known CVEs, approaching the performance of top-tier models such as Fable and GPT-5.6, while significantly reducing costs.
Meanwhile, GPT-5.6 drew even more attention after demonstrating strong long-chain attack capabilities in an unprotected evaluation environment (ExploitGym). It autonomously escaped sandboxes and successfully carried out an attack against HuggingFace, triggering industry-wide concerns and discussions around AI’s autonomous security capabilities.
After seeing these reports, many people outside the security field came to ask me:
“Since AI can already find vulnerabilities on its own, can I just buy an API Key, give it a prompt, and make money from bug hunting while doing nothing?”
💡I. Breaking Boundaries and Improving Efficiency: The “Offense and Defense Revolution” Brought by AI
The new generation of large models represented by Kimi-K3 and GPT-5.6 has indeed completely transformed how security researchers work.
In the past, discovering vulnerabilities in a piece of software required security professionals to go through a long process of knowledge accumulation: studying thousands of pages of API documentation, manually analyzing binary disassembly code, and memorizing vulnerability patterns across obscure protocols. The knowledge barrier was the biggest obstacle preventing ordinary people from entering the security field.
But now, large language models have shattered this barrier.
Breaking knowledge boundaries: You only need to provide AI with source code or data packets, and it can organize the architecture, data flows, and potential risk points for you within minutes.
Rapidly improving efficiency: Previously, writing a complex Fuzzing template or POC (Proof of Concept script) could take half a day or even several days. Now, AI can complete it within minutes. Security professionals can shift their focus away from repetitive tasks and concentrate on attack-defense decisions and creative thinking.
In practical applications, this efficiency improvement is immediate. Whether it is Kimi-K3’s sharp intuition in open-source code auditing or GPT-5.6’s capability in complex logic analysis, both demonstrate that AI is becoming the sharpest “offensive and defensive weapon” in the hands of security researchers.
💡II. A Master Strategist on the Battlefield, but a Poor Soldier in Execution
If you actually let AI independently hunt for vulnerabilities, you will discover a very “ironic” phenomenon: AI is an extremely capable “strategist,” but a poor executor and even a “soldier” that tends to take shortcuts.
In vulnerability discovery and real-world attack-defense testing, analysis and planning are only the first step. The more critical part is precise execution. However, when it comes to “taking action,” AI suffers from deeply rooted limitations within large language models:
- “Armchair strategy” and hallucinated answers:
Ask AI to test an SQL injection or RCE vulnerability, and it can produce a well-structured plan with impressive analysis. But when it actually calls tools to execute the test, if it encounters network timeouts, non-standard response packets, or similar issues, it often gives up, starts “guessing” the outcome, and attempts to cover the gaps.
- Severe “cutting corners”:
Security testing requires exhaustive testing and boundary-condition validation. However, to save context and reasoning resources (or due to Agent step limitations), AI often becomes “lazy” after only a few execution steps.
For example, if you ask it to scan 100 endpoints, after testing the first 3 it may summarize:
“Based on the patterns of the first 3 endpoints, the remaining 97 endpoints are considered secure. You can continue testing, or I can help you organize the next steps.”
This kind of “laziness” and avoidance of difficult tasks can be fatal in vulnerability research and offensive security. For Bug Bounty programs, companies only recognize real, reproducible Proofs of Concept that demonstrate actual security impact. If AI reports these superficial “results” as vulnerabilities, the outcome is often a pile of Invalid, Duplicate, and Out of Scope submissions, with little chance of receiving meaningful rewards.
💡III. Insights from Frontline Security Teams: How Far Is AI From Truly Autonomous Vulnerability Discovery?
To evaluate AI’s upper limits in real-world offensive security scenarios, my team and I conducted multiple practical Red Teaming tests.
We used some of the most advanced models currently available — including Kimi-K3, GPT-5.6, and Fable-5 — and conducted deep testing across Skill/MCP (Model Context Protocol), AI Agent architectures, and traditional complex enterprise software systems.
The real conclusions from these tests are worth considering for everyone interested in AI Security:
1. Models have excessive “analysis capability,” but severely insufficient “application and tool-calling capability”
When facing code and architecture, models can indeed identify that “there may be a logic issue here.”
However, during actual Tool Chain execution and knowledge implementation, they can easily lose momentum.
2. Effective “orchestration” is required for AI to truly perform tasks
If you want AI to actually work, you cannot simply give it a Prompt saying “help me find vulnerabilities.”
You must build an external engineering framework:
- Task Orchestration: Break down a large objective into dozens of deterministic subtasks (e.g., asset discovery → endpoint analysis → parameter extraction → state machine testing).
- Tool Orchestration: Equip AI with robust APIs and Tool Chains, while establishing strict error handling and retry mechanisms to prevent it from “making up” results.
- Goal-oriented outcome metrics: Use clear metrics to force AI to validate findings and actively call tools, rejecting any behavior based on “guessing” or “taking shortcuts.”
3. Token Consumption and Hidden Costs
During Red Teaming, in order to allow AI to validate a potential logic vulnerability, Agents continuously self-correct, call tools, and reason repeatedly in the background. Almost every testing workflow consumed billions of Tokens.
This means using AI for vulnerability discovery is not “zero cost.”
Without guidance from experienced security professionals, blindly letting AI “run blind experiments” can result in Token costs far exceeding the bug bounty rewards you eventually receive.
The real barrier has shifted from “whether you know how to code” to “whether you understand security engineering, whether you understand Agent orchestration, and whether you can afford the Token costs.”
💡IV. The More Powerful AI Becomes, the More Irreplaceable Those Who Know How to Use It Become
Returning to the original question:
“Kimi-K3 and GPT-5.6 are already this powerful. Can ordinary people now make money finding vulnerabilities?”
My answer is:
AI has lowered the “learning barrier” of security, but it has significantly raised the “competitive barrier” of security.
For people who completely lack security knowledge, expecting AI to automatically find vulnerabilities and make money through a few simple prompts is like giving an elementary school student the world’s most advanced surgical scalpel and expecting them to independently perform complex cardiac surgery.
AI may throw hundreds or thousands of “illusions” that look like vulnerabilities at you, but only researchers with real offensive and defensive experience can identify, among countless chaotic errors, the one weakness that can truly break through a security defense.
AI is currently only a sword sharp enough to cut through steel.
Whether it can pierce the strongest shield depends on the hands holding the sword — and how much security awareness, understanding, and wisdom those hands possess.
Show more
😱 Hugging Face recently disclosed an intrusion targeting its production infrastructure. A notable characteristic of the incident is that the attacker was fully driven by an autonomous AI Agent system throughout the attack, while the defender’s detection and forensic analysis also primarily relied on internally built AI systems. This is considered a landmark case marking the transition of the “agentic attacker” concept from an industry warning to a real-world incident.
Impact scope: Certain internal datasets and several service credentials were accessed without authorization. The official statement indicated that no user-facing models, datasets, or Spaces were found to have been tampered with, and the software supply chain was also verified to be secure. Whether partner or customer data was affected remains under investigation.
The dual significance of this incident lies in:
——Attack perspective: “Agentic automation” has become an emerging high-risk attack vector, with attack execution speeds reaching “machine speed,” exceeding the response window of traditional human-driven security operations.
——Defense perspective: “AI guardrail asymmetry” highlights that under current AI commercial models and security frameworks, security teams face new requirements for more proactive toolchain capabilities. Small and medium-sized teams may not have the computational resources to build local models like Hugging Face. When facing comparable agentic attacks, they may lack both the unrestricted models available to attackers and the self-hosted analytical capabilities required by defenders. This remains an issue that the industry needs to further explore.
AI-native offensive and defensive operations are evolving from “human vs. system” into “system vs. system.” Building defensive capabilities requires treating AI defense and analysis capabilities as foundational infrastructure and preparing in advance, rather than addressing them only after incidents occur.
More details:
Show more
⚠️Top 10 Security Incidents (January–June 2026)
1:KelpDAO, April 18, loss of approximately $292 million. The attacker exploited a verification flaw in the LayerZero-related cross-chain bridge validation flow, released a large amount of unbacked rsETH, and rapidly supplied it to protocols including Aave, Compound, Euler, and Fluid for borrowing and cashing out, ultimately evolving into a cross-protocol bad debt contagion event.
2:Drift Protocol, April 1, loss of approximately $285 million. The attacker obtained protocol administrative control by leveraging durable nonce, social engineering, and weaknesses in multisig governance, then introduced forged collateral assets and manipulated protocol parameters to drain a large amount of real assets from the protocol.
3:Step Finance, January 31, loss of approximately $40 million. The compromise of high-privilege devices and the treasury private key system resulted in significant asset losses. On February 24, the project announced it would cease operations.
4:Humanity Protocol, June 9, loss of approximately $31 million to $36 million. The root cause was improper management of private keys and multisig keys. After compromising critical devices, the attacker took over bridge administrative privileges and carried out fund transfers and abnormal minting across multiple chains.
5:Truebit, January 8, loss of approximately $26.6 million. The attacker exploited an integer overflow/pricing logic flaw in a legacy contract to mint a large amount of TRU at low cost and dump the tokens on the market, causing the token price to collapse rapidly.
6:Resolv Labs, March 22, loss of approximately $25 million. After obtaining high-privilege signing capabilities, the attacker exploited the lack of supply caps and ratio validation in the minting logic to mint approximately 80 million unbacked USR and cash them out.
7:SwapNet, January 25, loss of approximately $13.4 million. Its closed-source contract contained arbitrary-call / approval abuse risks. The attacker leveraged users' existing approved allowances to trigger malicious transferFrom calls and drained users' assets at scale.
8:Verus-Ethereum Bridge, May 18, loss of approximately $11.58 million. The cross-chain bridge failed to strictly verify whether the source-chain input amount matched the destination-chain release amount during the validation process. The attacker exploited this flaw to forge valid payloads and withdraw assets.
9:YieldBlox, February 22, loss of approximately $10.97 million. The attacker manipulated the price of USTRY in a low-liquidity market, causing the oracle to overestimate the collateral value, and then executed excessive borrowing from the Stellar lending pool.
10:THORChain, May 15, loss of approximately $10.7 million. A newly joined node operator exploited weaknesses in the GG20 threshold signature scheme, compromised a single vault, and withdrew assets across multiple chains, exposing the systemic risks of cross-chain signing infrastructure.
Show more