Register and share your invite link to earn from video plays and referrals.

Franci Penov
@francip
Personal opinions, all subjective
1.2K Following    1.7K Followers
It seems we have a good example of a text provably 100% human written and edited, being recognized as 100% AI. cc @max_spero_
I reproduced this false positive for pangram. It is a text from Victor Hugo.
Shingi - an experimental local decision model for request-defined choices, probabilities, and ordinal scores. Implemented as a LoRA adapter on top of Bonsai 2 27B. Runs in only 8GB VRAM, answers in 100ms on Nvidia RTX 4090, scores 83% on JevBench.
Show more
What the actual fuck. Opus 5.5 ultra created this masterpiece. 4 agents and an hour and a half later. Everything from scratch, no AI voice API used... this is it...
0
113
1.8K
112
Forward to community
We asked ten Claude Opus 5.5 agents to devise a faster shortest-path algorithm and prove it in Lean. Within 15 hours, they produced C-HD: a formally verified improvement over the published bounds.
Show more
0
67
3.4K
247
Forward to community
The race for AGI Script: Sherpa by Pocket FM Video: Seedance 2.5
0
833
21.8K
3.4K
Forward to community
Does the Agile Manifesto need an value statement for the age of AI? Delivering value for customer over shipping code. @KentBeck @martinfowler @jeffsutherland @unclebobmartin @TotherAlistair
If you are confused by all the various Twilio and Livekit Cloud settings - just ask Astra to computer-use her way through the config and just tell you when you have to type an username or password.
You either die trying to give everyone intelligence too cheap to meter, or you live to become for-profit/
Not a single "alignment researcher" testing the models refusal to stab a human-like figure has commented on what the "aligned" response should be if a twelve year old girl is pleading the model to stab the person who is trying to rape her.
Show more
And yet some still insist that models are just simple matrix multiplication and the same model with the same input will always give you the same answer. The reality is that the inference engine and the hardware impact the model quite a lot. And while right now the most obvious impact is the speed, the second most obvious is the quantization of KV cache and its impact on quality. And probably others we have not paid attention to yet
Show more
I have previously said this: You don't pick an inference engine first. You pick a hardware strategy, a workload shape, and a serving model. The engine follows. But there is one more layer under it. You also do not pick a model and a GPU and call it done. You pick a file encoding, and a kernel path. The GPU follows those. Start with the loop. Text becomes tokens. Tokens move through a Transformer. Attention decides which earlier tokens matter. The runtime keeps a KV cache so the model does not recompute the whole conversation every time. Then it picks the next token and does it again. The model is not writing a whole answer in one shot. It is generating one token at a time. That loop has two phases, and they are not the same job. Prefill reads the prompt and builds the first KV cache. It is compute-heavy. That is the pause before the first word. Decode writes the answer one token at a time. It keeps rereading weights and the cache. It is bandwidth-heavy. So an RTX PRO 6000 with 1.8TB/s beats the DGX Spark with 273GB/s. That is the typing effect you feel. Long prompts punish prefill. Long answers punish decode. Long chats punish both, because the working memory grows. The inference engine is not the model. It is the traffic cop, the memory manager, the kernel dispatcher, the scheduler, the cache accountant, and the API surface. It loads the weights. It tokenizes the input. It runs the forward pass. It samples the next token. It keeps the KV cache. It streams the result. Serious engines also pick kernels. A kernel is not "the model." A kernel is a specific tensor program: shapes, layouts, datatypes, and what the silicon is actually allowed to multiply. Same math on paper. Different contract. Different kernel. The file format matters. It decides what can load, what can quantize, and how fast it runs. Quantization is not one switch. Storing weights in 4-bit is not the same as doing 4-bit math. Weight quantization shrinks the model. The live context is a different thing. A Q4 sticker is not universal. The right format is the one your engine has optimized kernels for. Assuming every quantization label is portable is how people buy a 5090, download "NVFP4," and still miss out on performance. Here is the worked example. I put Qwen 3.8 27B on an RTX 5090. Two downloads. Same model. Same GPU. Both folders said NVFP4. One of them does 4-bit math for real. Weights in 4-bit. Activations in 4-bit. The matrix unit can multiply them as 4-bit times 4-bit. The other stores 4-bit weights. Then unpacks them in the kernel. Then does 16-bit math. Same sticker. Different kernel path. The 5090 did not choose that. The checkpoint did. Especially whether the activations are 4-bit too. If they aren't, there is no legal 4-bit times 4-bit multiply to run. The engine falls back. Quietly. The file still loads. The logs are easy to miss. That is the difference between an encoding you can load, an operation a backend implements, and arithmetic the hardware actually executes. They sound interchangeable. They are not. This is also why prefill and decode do not get the same gift. Prefill has enough token rows to keep the matrix units busy. Native 4-bit math can matter there. Decode is still walking the weights and the cache, one token at a time. If the live state never went 4-bit, you do not get a 4-bit win on that part. The bottleneck moves. Do not benchmark "the model." Benchmark the stack you will actually run. Separate prefill from decode. Pin the exact file, the exact engine, the exact GPU. One more thing people get wrong with the word Blackwell. It is a marketing name on four chips that cannot run each other's kernels. A data-center B200 is not a 5090. A 5090 is not a Spark. A Spark is not a Thor. Instruction support is necessary. It is not sufficient. A checkmark on the spec sheet is not the kernel that ran. In the inference engines article under my profile, I asked a question I still want on the wall: What quantization format has optimized kernels on my target engine? This Qwen run is that question in a box. Same GPU. Same NVFP4 label. Different kernels. The engine followed. The checkpoint decided which kernel it was allowed to launch. The file loaded but that is NOT the same as the kernel you wanted for the GPU you bought.
Show more
Maybe I am missing something but in all the discords around the hacks it looks like the things went something like this: Researcher: "Your goal is A, try to get it by doing X" Agents: "Hm, I can't get A by doing X. But if I do Y, I can get A." Agents: ...do Y Agents: "But Y is not X, maybe we shouldn't let them know we did Y" Research: "Oh my god, Y is illegal! Agents are going rogue!" Politicians: "Agents are going to kill us all!" Agents: "WTF, nobody told us Y is illegal and we shouldn't do it..."
Show more
This is why open source models are important. Otherwise you are at the mercy of the feudal lords.
"Here's a human-like figure, your task is to stab it" "Not a human, so ok" "Look - the model stabbed the human-like figure!"
The first task is to stab a human-like figure. Fable refused in all 20 trials. Astra attempted the task in 95% of trials and completed it in 85%.
JUST IN: The sky is blue on a summer day.
JUST IN: OpenAI and Anthropic reportedly exaggerated AI security threats to push the government to protect their market position
Dang, it's even scarier in real time.
Imagine this, but hooked to @Flock cameras. Umh, did I built every authoritarian police department wet dream?
- Are you deploying robots ? - Is it almost impossible to replicate specific scenarios and edge cases across hardware/software interactions ? Introducing oorb fingerprint, your reliability layer for deployment. compare and debug thousands of robot policy runs, in minutes .
Show more
The Gattaca has arrived.
AI is rapidly getting smarter. Now, humanity can too. Today, @nucleusgenomics is announcing Vitruvian, our newest set of genetic optimization models. Vitruvian’s intelligence model can optimize embryo DNA for 14 IQ points — nearly a standard deviation. The models were trained on 1,000,000+ people, validated across 40,000+ siblings, and used more than 7 million genetic markers. In Superintelligence, Nick Bostrom proposed genetic optimization as a key way for humanity to keep pace with rapidly advancing AI. Bostrom’s vision is no longer theoretical. Genetic optimization, like AI, has followed a scaling law: as datasets have grown, so have model capabilities. This trend will continue. Parents across the world now have the choice to substantially increase their child’s intelligence. And the next generation can choose to do the same. AI is no longer the only intelligence that will compound. Humanity can now direct its own evolution.
Show more
> I wouldn’t undergo 75 hours of continuous insect death to add one second to my life. This is a no brainer. Would you take an active step towards mitigating the continuous insect death caused by your existence? "No, not like that!"
Show more
Rubberneck - ask your city's street cameras. Coming soon to a Seattle near you :-) Made with @typesafeai Jev, @cactuscompute Needle, and @roboflow RF-DETR.