Register and share your invite link to earn from video plays and referrals.

Zhifei Li
@andylizf
Incoming PhD @PrincetonCS. Building AI systems & infra. Prev @BerkeleySky & @ruc1937
116 Following    238 Followers
My first SkyPilot PR, in Sept 2024, fixed syntax highlighting in one docs code block. 51 merged PRs later it's a company. Congrats @zongheng_yang @Michaelvll1 and the team. @tian_xia_ reviewed most of those 51, thank you!
Show more
Fresh out of stealth, and our first announcement belongs to the community: SkyPilot open source has hit 10,000 GitHub stars ⭐ We are now powering AI infra for frontier teams from neolabs to Fortune 500 enterprises, across 25+ clouds, Kubernetes, and on-prem. Every star, issue, and PR got us here. This milestone belongs to the community. Onwards to accelerate GPU fleets!
Show more
Built by @YichuanM and @andylizf at StarTrail, out of UC Berkeley's Sky Computing Lab @BerkeleySky, BAIR @berkeley_ai, and Berkeley NLP @BerkeleyNLP. Same team behind LEANN (RAG on everything, on-device, with a 97% smaller index). Thanks to our advisors @matei_zaharia, @profjoeyg, and @sewon__min! If LEANN gave your models memory of your private data, PixelRAG gives them eyes on the open web. Code: Paper: Playground: 🐍 𝚙𝚒𝚙 𝚒𝚗𝚜𝚝𝚊𝚕𝚕 𝚙𝚒𝚡𝚎𝚕𝚛𝚊𝚐
Show more
Your coding agent reads every web page wrong. And pays 2.5x extra to do it. pixelbrowse fixes it with one screenshot. −74% tokens, 4x faster. give Claude Code eyes. 👀 New: pixelbrowse. 𝚙𝚒𝚙 𝚒𝚗𝚜𝚝𝚊𝚕𝚕 𝚙𝚒𝚡𝚎𝚕𝚛𝚊𝚐 ·
Show more
Really amazing results analyzing what's creative/novel vs. what's copied from Internet data, enabled by the amazing @liujc1998's Infini-gram! This is also enabled in @allen_ai's OlmoTrace where anyone can find matching n-grams between LLM-generated text and its training data.
Show more
congrats Zihan! excited to read RAGEN-2
RAGEN-2 is selected as ICML oral! Congrats and great appreciation to all collaborators!!
Codex basically replaced OpenClaw for me at this point but the part I like most here is “memory as markdown files” pretty refreshing to hear that from someone on the Codex team. model companies usually have every reason to want memory lock-in 🙄
Show more
huge congrats! agent-written kernels are fun VibeServe is even cooler! can't wait for more from @KeisukeKamahori and the SyFI crew
Super stoked that UW SyFI ( members won a number of prizes at the MLSys'26 competition, NVIDIA Track. Hugre congrats to @KeisukeKamahori , @sudopowr , Yile Gu, Wei Shen, Steven Gao! Thanks to @nvidia , @modal , and the Flashinfer team for the support. 1st place in the GDN Track — Full-Agent Approach 2nd place in the GDN Track — Agent-Assisted Approach 3rd place in the DSA Track — Full-Agent Approach
Show more
one of the most annoying things in MLSys: tiny ops keep forcing data to move around CODA: do them before the tile leaves the chip
LLM training is built on fast MatMuls. But many surrounding ops still run as memory-bound kernels. CODA reparameterizes them to hide in the matmul’s shadow, fused into its epilogue before results leave the chip. Bonus: LLMs can write fast CODA kernels too (approaching SoLs).
Show more
this customer list makes so much sense AI apps create so much stuff. it all still needs to be searched and governed. so much AI slop😂 keeping it all hot gets expensive fast serverless search on S3 feels like the right shape
Show more
turbopuffer crossed $100M run-rate in March. 19mo after $1M. Profitable & <$1M raised. Cursor・Anthropic・Notion・Cognition・Harvey・Bridgewater・Ramp・Linear・Legora・Superhuman・Atlassian・Granola We’d be nowhere without them. We work like hell to exceed their expectations.
Show more
this one means a lot 🥹 LEANN has been one of the most fun and intense projects I've worked on. I spent a lot of time building the system, running experiments, shaping the paper, and shipping the open source release to the community. seeing both the research recognition and community response has been incredibly special. so grateful to @YichuanM, our advisors, collaborators, and everyone who tried LEANN, opened issues, contributed PRs, or gave feedback. excited for what's next 👀
Show more
LEANN just won the Best Paper Award at #MLSys26# 🥹 still processing this. paper: repo: huge thanks to all the amazing collaborators, advisors, and open-source contributors who made this possible ❤️
Show more
Today I shared some personal practice use cases (for research and maintaining open-source) of Claude Code at @BerkeleySky, UC Berkeley. Here is the link to the presentation: Some personal hot takes/ discussion conclusions: 1. IDEs might not be the eventual best way to interact with code. CLI-based agents require less human supervision and scale better (compared to tools like Cursor). People may eventually only review the PR rather than the intermediate coding steps (even more aggressive!). 2. Whether a problem can be solved (the boundary!) by coding agents (today) largely depends on whether there is a clear signal for the task. For example, @karpathy’s autosearch is relatively easy because the signal is clean, a very good example. (Good news for researchers: coding agents still struggle with open-ended questions. So… our jobs are probably safe for a little while.) 3. Human supervision is the bottleneck. Designing agent products that minimize human effort while leveraging humans’ advantage in context switching is a very interesting direction.
Show more
Glad to have contributed to this with @shulynnliu at Sky. By cleanly separating the evaluator and evolution mechanism, the LLM can actually optimize the search process itself. Scaling across 200+ tasks proves it works.
Show more
AlphaEvolve is closed-source. We release 🌟SkyDiscover🌟, a flexible, modular open-source framework with two new adaptive algorithms that match or exceed AlphaEvolve on many benchmarks and outperform OpenEvolve, GEPA, and ShinkaEvolve across 200+ optimization tasks. Our new algorithms dynamically adapt their search strategy, and can even let the AI optimize its own optimization process on the fly! Results: 📊 +34% median score improvement on 172 Frontier-CS problems. 🧮 Matches/exceeds AlphaEvolve on many math benchmarks ⚙️ Discovers system optimizations beyond human-designed SOTA 🧵👇
Show more