Cheng Lou
@_chenglou
Worked on: @reactjs, @messenger, @reasonml, @rescriptlang
Currently: @midjourney, Pretext, Freerange, Handwired
521 Following 78.8K Followers
Dear god it's inventing German from first principles
My dear friends, I’d like to show you my latest toy project
Introducing Handwired: turn your regular JavaScript code into a neural net!
- no training
- exact outputs vs the JS program
- fully differentiable
All runnable in a browser, without GPU
Show more
Replacing backprop with zeroth-order optimization is inevitable.
Introducing Noise: a speedrun for pretraining without backprop.
Last week we presented Dust, the first method to approach backprop with SGD for pretraining transformers. We think another 1,000x improvement on top of it is possible, and it will require *co-designing* credit assignment, optimizers, architectures, and eventually, hardware.
We built Noise to iterate on this faster.
Show more
Im already impressed by the actual first second of the game. You launch the executable, and you’re in the game. No splash pages, no menu, no loading. Immediately in game, playing. Amazing
we want to start testing a Midjourney MCP with a limited community. the intention is to find creative and technical people to push the boundaries of what our models can do. this is not for Midjourney in SaaS products, it's for purely artistic and creative endeavors. apply below!
Show more
Sufficiently complex rulesets become feelings
After six years in stealth, Atomic Machines is out. Our mission: on-demand, universal command of matter. First beachhead: the Matter Compiler, an AI-native manufacturing system that builds working micro-machines from code alone. No per-product tooling. No process development. Different code, different machine.
Show more
Denzel Washington already addressed this
“Start in the middle” oh wow
The newly minted Nobel Prize winner Anne Carson shared a book recommendation and some timeless writing advice at the 2024 National Book Awards.
What if,
for any scientific claim,
you can search 100M+ papers to find the strongest evidence for and against it
⚡️in 1 second?
That’s now possible with Evidence API! 🚀
For example, does drinking coffee reduce diabetes risk?
Show more
Goose: my latest programming language. Safer, faster and less memory than Rust/C++ for algorithms where tightly packed, flat data structures matter.
It can represent more kinds of data structures as flat, pointer-free bytes than any language I know.
1/
Show more
There was a Jeff Dean joke that Jeff Dean wrote the world’s first O(1/n) algorithm and this timeline has a chance of making it happen
based on my data analysis, integer multiplication will be linear time by tomorrow!
What’s going on with these results, is the universe having floating point errors??
You can do Fourier transforms in O(N log(N)^0.9999999999999) time. Fuck this gay chud universe
Mathematician @ElliotGlazer ranks the 5 remaining Millennium Prize Problems by which he thinks will fall next:
"It's been long expected that Navier-Stokes would be the easiest. I heard that when I was an undergrad over 10 years ago. That really was not that huge of an update for me."
"My personal ranking is, I think Yang-Mills is probably gonna end up being the easiest one, then BSD, Hodge, Riemann, and then P versus NP. I would bet on Yang-Mills coming next."
"Trust me, I'm a set theorist, which is why I have zero bias towards any one of those five."
Show more
The premature optimization of splitting animation work onto another process has done lots of harm to iOS (and web). For a brief while things were slightly smoother, but in exchange we ended up with uninterruptible animations and layout glitches from introducing unsolvable concurrency problems, plus various patches on top that ultimately make the system actually slower than if we just did things cleanly on main thread (or had access to proper multithreading in userland). Most tasteful UX cannot be decoupled in a computer sciency way
Smooth animations in general are great but calcifying the rendering pipeline for a decade is a huge cost
Show more
Remember how back in the crypto days folks asked "why can't we make these GPUs run useful work" and the typical answer is "making GPUs run useful work for money would defeat the purpose" and it turns out that's completely wrong in an important way
Show more
the flashlight method of comparing two projections of the same embeddings 🔦
2M points in webgl, color by spread/compaction, umaps aligned by procrustes.
I've had fun visualizing ml concepts with manim. Here’s a small two-layer MLP, where each layer computes h = ReLU(Wx+b).
This viz lets you see that every connection is a single weight value.
Show more
this is the coolest fucking menu ive ever seen in a game
Aah yes, the forbidden reverse Naruto run
