fal head of engineering @isidentical explains why they’ll never pre-train a model and why compute may be the real moat in AI: "We are never going to pre-train a model. That is not in the cards for us. fal is a generative media cloud, and wherever we see gaps, we are okay to adjust and evolve our form to fit in there." "Today the gaps are not in pre-training. There are multiple companies rushing to pre-train the best image and video models. There is a big gap in real-time video generation, which we think we cracked with H3 Max." "I don't think anyone in the world has enough inference compute today. We have been very aggressive building and procuring compute, anywhere from building our own data centers to renting as many GPUs as possible." "The moat is not the software that you build, not the training that you do, it's essentially your focus to be always one step ahead. As long as you're one step ahead, you're able to capture more value than anyone else." @fal