Register and share your invite link to earn from video plays and referrals.

Search results for RateLimiting
RateLimiting community
One keyword maps to one global community path.
Create community
People
Not Found
Tweets including RateLimiting
A curious phenomenon: recently, people have been flocking to join Anthropic, while at the same time, a multitude of users are railing against the company (citing account bans, rate limiting, and built-in detection backdoors)...
Show more
# Practices for Embedding AI Agents in Software # Tool Gateway / MCP Broker 🎯 The Hook Your AI agent calls multiple tools directly? That's a distributed security nightmare waiting to happen. A single gateway layer turns chaos into a controlled chokepoint. 🔥 The Problem When agents call external tools and MCP servers directly, authorization, rate limiting, and logging scatter across every integration. Prompt injection can sneak malicious arguments past individual tools, and audit trails become impossible to reconstruct when logs are spread across a dozen services. 💡 The Pattern Route all tool calls through a single gateway that enforces authorization, input sanitization, rate limiting, and audit logging in one place. Use dynamic scoping to expose only the tools relevant to the current task and user permissions, keeping the LLM's selection space narrow. Apply asymmetric policies: write operations get fine-grained per-operation authorization and HITL approval, while read operations use lighter category-level checks. Adding or removing tools becomes a configuration change, not a code deployment. ✅ When to Use Use when: - The agent calls multiple tools, at least one with side effects - User input or external data flows into tool arguments (low input trust) - You need an audit trail of who called what, with which arguments, and under whose authority Don't use when: - There's only one read-only tool and gateway overhead isn't justified - All tools are trusted internal services in an experimental environment where prototype speed matters more ⚠️ Pitfalls - The gateway itself becomes a single point of failure. Design health checks and a degraded mode (e.g., read-only fallback) - Never enforce authorization or sanitization via prompts. "Don't use this tool" instructions are trivially bypassed by injection - Session-level rate limits alone won't stop distributed attacks. Add a global rate limit layer on top 🔧 Implementation Approach - Define gateway policies declaratively (e.g., YAML), specifying type (read/write), authorization granularity, rate limits, sanitization rules, and log levels per tool - Dynamically scope tools exposed to the LLM based on task type, user permissions, and conversation phase, excluding irrelevant tools from the selection space - Design health checks and a degraded mode (read-only fallback) so the system survives gateway failures without total shutdown - Normalize schemas across MCP servers at the gateway layer, presenting a consistent interface to agents regardless of backend differences - Route high-risk code execution to sandboxed environments and use short-lived permission leases for long-running sessions #AIAgents# #SoftwareArchitecture#
Show more
LLM providers are trying to build enterprise guardrails directly into their products, but it won't work. Companies don't run on a single LLM any more, they're often using a mix of frontier models plus open-source and specialized vertical models spread across various use cases. Model providers can improve their guardrails, but that won't fix the fragmentation problem. The industry tried this before! In the early microservices era, every team baked auth, rate limiting, and logging directly into their apps, which worked fine until you had hundreds of services and no consistent enforcement or unified observability. We abstracted the connectivity logic to the traffic layer back then, and you need to do it again with AI. Effective AI governance (token budgets, permissions, compliance, etc) can't live inside a single model. You need a neutral layer that sits in front of everything. A "Switzerland for AI" as Khozema Shipchandler called it. A single control tower that manages all traffic regardless of source.
Show more
Following recent bridge exploits, Lido contributors are publishing the security principles behind wstETH’s multi-chain strategy, and why @chainlink CCIP was selected as the official cross-chain solution. The analysis covers how Chainlink CCIP delivers strong decentralization, native safeguards, and issuer control as default protocol-level guarantees, which insulates wstETH from a number of attack vectors behind the Kelp / LayerZero exploit. This decision was made last November by the Network Expansion Committee, with CCIP securing wstETH via 16 independent node operators, native rate limiting, and no vendor lock-in over token contracts. Read the full breakdown from Lido contributors:
Show more
AI has solved 10 long-standing open problems in mathematics — all verified with machine-checked Lean 4 proofs. Title: Ten advances in mathematics and theoretical computer science URL: ❓ What problems were solved? 💡 Ten results spanning eight fields: high-dimensional sphere packing, existence of non-sofic groups, disproving Connes's rigidity conjecture, exponential parallel repetition for quantum games, polynomial-factor hardness for the closest vector problem (with post-quantum cryptography implications), Ehrhart's volume conjecture, multicolor Ramsey numbers, and extremal number conjectures (Erdős problems 146, 180, 183). Each problem had seen no progress on its main result for at least a decade. ❓ Which AI solved them? 💡 An internal evaluation version of Astra, OpenAI's next major unreleased model. Astra found the core proof structures; humans then prepared manuscripts and formalized the arguments using the same model. The total compute cost: roughly $2,000 at standard API rates — "theorem proving as a routine batch job any lab can run." ❓ Are these proofs actually correct? 💡 Every result ships with a machine-checkable Lean 4 certificate (mathlib + Lake, Apache-2.0, on GitHub). Running `lake exe cache get && lake build All` either compiles or it doesn't — correctness is resolved in minutes, not months of peer review. This is the strongest verification bar AI-produced mathematics has cleared at this scale. ❓ What does this mean for the future of math research? 💡 The significance is breadth, not a single lucky strike: eight fields, ten results. The bottleneck is no longer compute budget — it shifts to prompt design and result vetting. The rate-limiting step in mathematical discovery may soon be a human's ability to pose the right question and formalize the answer, not AI's ability to find it. #AIMath# #OpenAI#
Show more
Gartner just released a new Magic Quadrant, and it's forcing the industry to answer a tough question: What does AI governance actually mean? In the new MQ, Gartner formalized AI governance as a distinct enterprise buying category, and they project the market will be worth $1.4 trillion by 2030. But we have to be precise about what this category does and does NOT include. As outlined by Gartner, AI governance platforms are built for CISOs, compliance officers, legal teams, and risk functions. Their job is to manage things like dynamic risk scoring and compliance framework mapping (EU AI Act, NIST AI RMF, ISO 42001). This is the "what" part of AI governance. But it doesn't cover the "how". Gartner is explicit about this point: governance platforms do NOT enforce policy in isolation. They depend on something beneath them to make those decisions operational at runtime. That's the "how" layer, where @Kong lives. Applying AI governance at the traffic layer. Rate limiting, access controls, prompt inspection, PII sanitization, content filtering, etc. This is the enforcement infra that makes governance decisions scalable. It's like traffic law vs traffic lights. You can set broad policies, but you need the traffic layer enforcement to make it actually work. A policy that says "no PII crosses this boundary" does nothing until something in the request path actually checks and enforces it. So what is AI governance? It depends on who you are. CISOs can focus on the "what" layer, while builders need to obsess over the "how". Orgs have to treat governance and AI connectivity as complementary infrastructure decisions. One layer defines the rules. The other makes them real. Traffic law AND traffic lights.
Show more
Spent the last few days talking with optics folks and sitting through conference talks, industry side included. As AI models advance, hardware keeps picking up more of the upside. The evidence is simple — related government and private funding programs have exploded. More funding = a bigger industry. And that naturally pulls more students into the field. Not just Korea, the US is the same story. And once the industry grows and funding ramps, equipment orders follow. But with SiPh, it's not just any equipment that ramps. The layers where an optical dimension gets added tighten first. To play the SiPh ramp, you have to know the equipment stack. Purity of the SiPh signal rises as you go down the stack. L0. Front-end fab — litho/depo/etch $ASML, $AMAT, $LRCX, $KLAC. Biggest dollars, but photonics just rides on CMOS demand. Weak as a standalone SiPh signal. L1. Wafer-level optical + electrical probing — the real bottleneck. Coupling light into the wafer while probing electrically at the same time. FormFactor $FORM (CM300 + probe card, grating-coupler alignment). Optical alignment speed is the rate-limiting step for volume ramp. L2. Parametric / metrology layer — tunable lasers, OPM, LCA, high-speed BERT/scope for EAM/modulator bandwidth. Keysight-centric $KEYS, with Viavi $VIAV/EXFO/Anritsu alongside. L3. Burn-in / KGD / reliability — $AEHR (WaferPak/FOX). Once you go CPO, you can't let a single bad optical die into a multi-chip package, so KGD becomes mandatory. L4. Packaging / final / system-level ATE — fiber attach, optical packaging, and when volume hits, $KEYS/Advantest $ATEYY/ $TER. The bottlenecks sit at L1 (optical alignment) and L3 (KGD). The moment AI forces CPO, those two layers tighten first — and once volume breaks out, the ATE above gets pulled in next.
Show more