Pamela Fox(@pamelafox):Highlights from the @aiDotEngineer keynote chat with @olive_jy_song from @MiniMax_AI, creators of the open-weight M3 model: * An intern came up with sparse attention * The minimax models have "native" multimodality (trained from the start) * "Could we have models with 1 trillion context window?" "We could explore that..." * M3 is building M3.1 right now

Pamela Fox

@pamelafox

(she/her) Currently a Principal Cloud Advocate in Python at Microsoft. Happy Pride! 🏳️‍🌈 🏳️‍🌈 👩🏽‍❤️‍💋‍👩🏼 👨🏼‍❤️‍👨🏿

Joined November 2007

373 Following 25.9K Followers

Pamela Fox@pamelafox

2026.07.01 01:55

Highlights from the @aiDotEngineer keynote chat with @olive_jy_song from @MiniMax_AI, creators of the open-weight M3 model: * An intern came up with sparse attention * The minimax models have "native" multimodality (trained from the start) * "Could we have models with 1 trillion context window?" "We could explore that..." * M3 is building M3.1 right now