Codex is so slow you have to be cooking 5 things at the same time otherwise you will lose your mind.
On the bright side you can go about your day, go the gym, dictating into Codex remote all day and still effectively work an 18 hour day.
Show more
I'm going to have to fine tune a computer use model aren't I? FML
We are still waiting on the weights one year later… 🫠
We can finally share UI-TARS-2🥳🥳 — a native GUI agent trained with multi-turn agent RL
⚡️⚡️Key highlights (all-in-one model!):
💻Computer Use: 47.5 OSWorld · 50.6 WindowsAgentArena
📱Phone Use: 73.3 AndroidWorld
🛜Browser Use: 88.2% Online-Mind2Web
🎮Gameplay: ~60% human on 15 titles · strong on LMGame-Bench
🧑💻TerminalUse: 68.7 SWE-Bench · 45.3 TerminalBench
🔨Tool Use: 29.6 BrowseComp
Hybrid flows: GUI clicks + terminal cmds + API calls in one trace
Paper
Demo
Show more
I look at this video and can't believe how slow OpenAI models have become in 6 months. This same flow now would probably take 10-15 minutes with GPT-6, and is why I've been faffing around with Jev and UI-TARS for the past two days.
Show more
Ok, enough talking.
Introducing Wiretrap: Agentic Mobile App Reverse Engineering.
@teller connects to over 7000 financial institutions, providing developers with a single API to integrate against. We connect using private APIs discovered by reverse engineering their mobile apps.
This is a huge engineering cost (we have to analyze every app update to check for API changes), and obtaining accounts at those banks to be able to use their apps and map out the API interactions we need for our own API clients is an operational nightmare. Both are major blockers to supporting more institutions, countries, and product types, especially ones that are not practical to obtain at every bank, e.g. student loans and mortgages.
Wiretrap solves for both problems.
Wiretrap intercepts network requests a mobile app makes and injects symbolic responses that allow an agent to discover the underlying API contract by simply observing what the app does with them. It can override individual values to trigger different flows, allowing agents to completely map out an entire API without a single request hitting the bank.
Check out this brief video of an agent using phony credentials to log into Chase (the request is intercepted by Wiretrap and never hits Chase's API) to get to the account dashboard. Note the symbolic value "req_058.response.body.bankingAccountOverviews[0].
businessName" displayed in the app UI, representing the request and key path the value originated from allowing the agent to join what is displayed on screen with what "went over the wire".
Everything you see is inferred by observing how the app interacts with Wiretrap's symbolic responses.
Another
@teller world first :)
Show more
Not that you should, but if you must, you can store secrets in a binary and have them be extraordinarily difficult to extract, if you know what you’re doing. Case in point: AppStore FairPlay DRM has never been cracked, i.e. static, offline decryption on non-Apple hardware is still a research goal. Even versions predating hardware keys remain uncracked.
Show more
Flawed iOS Security: Client-side obfuscation
If you listen uncritically to everything you read on the internet, you might think you’re slick by obfuscating your strings. That’s certainly what I thought in 2019 when I first decided to be the resident security expert and added code like this to protect my Mixpanel API keys.
While it’s a little harder to read than raw strings, it’s still straightforward for a sufficiently motivated hacker to steal your keys. If you use an insecure approach such as base-64 encoding or XORing, it’s trivial to reverse engineer. Even with a decent algorithm and salt, attackers can use tools like Frida to extract your API keys from device memory at runtime.
Obfuscation provides security by obscurity, but this isn’t an effective approach. No matter how good your obfuscation is, that API key will eventually be decoded and sent across the network.
See the full blog post here:
Show more
Does anyone have a demo of jev browser use reliably filling out more than a couple of fields and clicking submit? I’m not seeing it being hugely dependable in UI traversal for anything non-trivial even after using the prompting techniques from the canonical repo.
Show more
PEOPLE ARE BUILDING SOME WILD STUFF WITH JEV
20 mind blowing projects worth checking out:
1. JEV-Ultrafast → browser agent
2. Fast-JEV-Compaction → context compression
3. JSON-Render → generative UI
4. Typesafe-MCP → use JEV with any client
5. JEV-MCP → judgment toolkit
6. Semdecide → CLI classifier
7. JEV-Codex-Router → model routing
8. Winnow → context garbage collection
9. JEV-Review → code review triage
10. Blink → repo navigator
11. Agent-Desktop → desktop automation
12. Typesafe-Mario → plays Super Mario
13. JEV-Drone → drone control
14. OneVOneJev → browser FPS
15. JEV-Trader → HFT market making
16. Prism → liquidity signal detection
17. Neo4Jev → knowledge graph traversal
18. JEV-Curate → training data screening
19. Canny → completion verification
20. KillMyIdea → startup idea scoring
if you're using JEV, these are worth exploring
pick one and start building
Show more
Did you know you can prompt an iOS app into existence from your phone using Codex remote control and install it on your phone over the air when Codex on your laptop has finished cooking? What a time to be a alive.
Show more
Defending against highly competent reverse engineers is genuinely a hard problem. You can do nearly everything correctly but one small mistake is a foot in the door. There is one blue team guy I came to know that used to work at Barclays Bank back in the day when I was reversing that app. He was unbelievably good, truly one of if not the best in the world, and caused me a lot of problems. Even still, I found one small mistake and was able to work forward from that and pop the whole thing. Just after they implemented brand new crypto in their app because I broke the old one 😂
Show more
Some people at
@stripe seem interested in Wiretrap. 👋🏻😎👍
Let me explain what is happening here:
- FDATA is a fintech lobbyist that wants 1033 open banking to happen.
- The current 1033 rule is preliminarily enjoined because it goes beyond the statute: the right is for principal consumers, agents, trustees, or representatives thereof. Not arms-length fintechs
- The AI agent boom happened and this lobby will now try to argue AI agents are common law agents, thereby being entitled to open banking access
Common-law agency requires the agent’s assent or consent to a fiduciary relationship. An AI is not a legal person capable of consent or assent.
Fintech lobby BTFO… AGAIN!
Show more
Absolutely wild to see actual practicing attorneys claim AI agents are common law agents. Didn't they read Restatement of Agency in law school? SMH
people are fickle and cruel. this happened in the space of less than one week.
What happened to Instinct? Went from a 11/10 product to 4/10.
Jev makes Wiretrap really fast, but it's still unable to decide a lot of stuff and hands off to a LLM way too much. Lots of perf gains still to be had. The end goal is to de novo map a private API contract in less than 10 minutes, and under a minute for app updates.
Show more
Made good progress on making Wiretrap economical on API pricing today, but LLMs are way too slow for UI traversal. Was about to reach for the Codex Spark model, but it was discontinued a few days ago!
Tomorrow's goal: Jev for UI traversal. If it works, it will absolutely RIP 🔥
Show more
Absolutely wild to see actual practicing attorneys claim AI agents are common law agents. Didn't they read Restatement of Agency in law school? SMH
I love Elixir but I don't use it much anymore. My main considerations now are:
1. Are models good at writing it
2. Is it the best fit for where it will be deployed
For HTTP apps I've being using TypeScript because models are great at it and it's deployable on Cloudflare Workers
Show more
I think people want to talk
people want to tap tap tap not just type type type
Free personal agents aren’t free. You pay with your soul.
I've seen a lot of frankly dumb takes on Instinct's raise.
The product is free, and the inference behind it is ludicrously expensive. For context, Anthropic's $200/month plan can cost $3-6K a month per user to service.
So why raise $350M, and potentially another $1B? Because if you're giving this away, you need an enormous balance sheet. And your biggest competitor has limitless cash AND compute (Muse).
Why invite-only? Partly hype. But mostly cost control. You can't let a million users onto a free, inference-heavy product overnight unless you're prepared to burn through a fortune in tokens (which Meta is doing).
Instinct might win the category or it might not. But seeing a billion-dollar valuation, saying it's the next Clubhouse, and calling it a VC hype cycle without running the math is lazy analysis. But hey, that's most VCs on X 🤷♂️
Show more
I will never stop being blown away by being greeted by my first name when I go to a store I don’t go to nearly anywhere enough for them to remember who I am. Only happens in Miami. People here are just next level good people.
Show more
One of my favourite Rolex watches. Total sleeper that nobody notices is a Rolex (unless you know horoglogical ball) and the white dial absolutely bangs.
Prince Harry and his Rolex Explorer II.
Made good progress on making Wiretrap economical on API pricing today, but LLMs are way too slow for UI traversal. Was about to reach for the Codex Spark model, but it was discontinued a few days ago!
Tomorrow's goal: Jev for UI traversal. If it works, it will absolutely RIP 🔥
Show more
Seismic CFAA ruling in the Ninth Circuit Court of Appeals in Amazon v. Perplexity.
Court struck down a preliminary injunction, holding that when an agent acts on a user’s behalf, the user (not the company that makes the agent) “accesses” a server for CFAA purposes.
If it stands, that reasoning sharply limits the CFAA as a tool to block user-directed services.
It's about time this happened. IMO, Ninth Circuit precedent (Power Ventures) has been in conflict with SCOTUS (Van Buren), creating unnecessary uncertainty for customers and litigation risk for third-party companies providing access to services without cooperation or consent of their operators
Show more