Modal
@modal
AI infrastructure that developers love 💚
Run inference, sandboxes, batch processing, training, and many other things on Modal
164 Following 36.9K Followers
Excited to be speaking at Modal Runtime alongside an insanely stacked group of speakers!
Will be talking about how we're making agents on faster, cheaper, and more reliable using @modal!
Show more
. @modal moves mountains to make models manifest!
Our man in pink @CompleteSkeptic will be speaking at Runtime, you won't want to miss it.
modal x neo next week @ runtime
100% @modal 👑 arming the jevolution with GPUs. Y'all have been the best this week.
If you’re wondering how Jev is scaling to meet insane demand they could not possibly have predicted, the answer appears to be @modal — one of only 4 subprocessors listed on
We've partnered with Anthropic to contribute up to $250K in Modal credits for researchers pushing protein design forward in the open 🧬
To show what these optimizations make possible, we’re partnering with Adaptyv Bio on a protein design competition. Together, we’ll be experimentally validating over 5,000 designs.
We're providing up to $1 million in Claude credits plus funding alongside Adaptyv for experimental validation. Modal is contributing up to $250,000 in compute and Twist Bioscience is providing DNA.
Learn more on Adaptyv’s Proteinbase:
And sign up for the competition here:
Show more
come to to see something cool here
So much of our alpha is in the infra layer anyway. So we’d rather work with open source projects and contribute back. Thanks @sgl_project for building amazing stuff!
I connected devin to some @modal H100s and then left it alone to run its own experiment loop against the GPUs. it found a way to reduce peak memory by up to 46% and latency by up to 52% on a popular OS training-kernel repo.
since the triton kernel was already near peak HBM bandwidth, it focused on other things, removing a 2GB allocation that was happening on every chunk of the backward pass. then it ran the benchmarks to confirm the speedup 🤯
Show more
Runtime speaker lineup is live!
We're bringing together experts covering AI infrastructure, applications of AI in science and robotics, the future of software engineering, and more.
Show more
Frontier models are simply too expensive and slow for the majority of use cases, so we see models like SWE-2 becoming the daily driver for most.
Training trillion-parameter coding agents at scale isn't easy though: typically, each step launches thousands of rollouts, each with its own isolated environment.
Cognition uses Modal's sandbox infrastructure for the rollouts behind SWE-2. Congrats on the launch!
More on how we scale Sandboxes:
Show more
Introducing SWE-2, our closest model yet to the frontier.
On leading evals, it scores on par with recent frontier models – at up to 70% lower cost.
We scaled RL to multiple trillions of parameters, with a refined recipe that pushes the Pareto curve on both capabilities & cost.
Show more
Run your agent on OpenAI. Run compute on Modal with isolated, secure sandboxes.
Your sandbox, your call.
Bring your own sandbox or connect a sandbox provider.
Choose the environment that fits your workload:
• CPU, GPU, and memory options
• Fully managed environments or deployments within your VPC
• File and secret storage options
We offer first-class integrations with @blaxelAI, @CloudflareDev, @daytonaio, @digitalocean, @e2b, @modal, @OracleCloud, @RunloopAI, and @vercel.
Show more
DeepSeek v4.1-Flash, a new multimodal model from @deepseek_ai, is now available on Modal.
v4.1-Flash uses DeepSeek's Causal Encoder-Decoder architecture, activating 16B parameters for input and 8B parameters for output to improve cost efficiency for input-heavy agentic workloads.
Show more
Run Codex on Modal.
We're teaming up with @AnthropicAI and @modal to host a Computational Biology Hackathon. Bring a protein sequence, gene set, or microscopy dataset — leave with an agentic tool built on Modal x Claude Science.
Sept 22 | 9AM–7:30PM | Cambridge, MA
RSVP:
Show more
Some Personal News ™ — I’m excited to join Modal as the Director of Brand, to help build the Modal Creative Studio alongside their Head of Design @teenychairs
btw we are hiring brand designers in new york 😇 link in thread
Show more
I just wrapped up my internship @modal.
This summer I worked on container filesystems, speeding up agentic workloads by up to 4x and directory traversals by 12x. I wrote about this systems work behind it here:
Huge thanks to @amitpr, @jonobelotti_IO, the runtime team, and everyone at Modal for an amazing summer!
Show more
I just talked to @max_rimpel about building a new kind of cloud from scratch and why building AI applications forces us to rethink infrastructure.
"If you're not tackling hard problems, why are you creating a startup?"
@bernhardsson was told to use Kubernetes. Instead he built @modal's file system and container runtime from the ground up, tuned for the speed AI workloads demand. With Modal, containers boot in under a second, and workloads burst from zero to thousands of CPUs or GPUs in a few lines of code.
Watch @max_rimpel in conversation with Erik.
Chapters
00:00 — Learning to Code on a Mac Plus
04:38 — Building the Engine Behind Spotify’s Discover Weekly
09:17 — The Pandemic Project That Became Modal
10:14 — The 1 to 2 Year Rule for Picking Startup Problems
12:36 — Broke Until Stable Diffusion Hit
15:42 — Architecting a New Cloud for AI
17:41 — Agents Want the Same Things Developers Do
Show more
Run 1 or 1,000,000 concurrent Cursor Cloud Agents on Modal.
