Beth Kindig(@Beth_Kindig):Model complexity and the KV cache are two primary drivers for memory, especially for inference requiring increasingly large context windows. Context windows for OpenAI’s leading models have risen 230-260X in three years to 1.05M tokens, while Meta’s Llama 4 Scout is 10X higher at 10M. $MSFT $AMZN $META $GOOG $MU

Beth Kindig

@Beth_Kindig

Investor with higher returns than Wall Street's Old Boys Club. Audited portfolio, automated hedge and free weekly analysis.

Joined February 2012

5K Following 183.6K Followers

Beth Kindig@Beth_Kindig

2026.09.25 20:25

Model complexity and the KV cache are two primary drivers for memory, especially for inference requiring increasingly large context windows. Context windows for OpenAI’s leading models have risen 230-260X in three years to 1.05M tokens, while Meta’s Llama 4 Scout is 10X higher at 10M. $MSFT $AMZN $META $GOOG $MU