Horace He(@cHHillee):I've realized when people are talking about how many tokens they use, they're usually including cached input tokens... which is incredibly dumb...

Horace He

@cHHillee

@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale

Joined February 2010

610 Following 53K Followers

Horace He@cHHillee

2026.08.24 11:07

I've realized when people are talking about how many tokens they use, they're usually including cached input tokens... which is incredibly dumb...

608

Forward to community

Most Popular Users

Unipcs (aka 'Bonk Guy') 🎒

286.9K Followers

594.1K Followers

90.4K Followers

241.6M Followers

19.8K Followers

681.6K Followers

242.9K Followers

2.1M Followers

93.4K Followers

1M Followers

195.2K Followers

406.5K Followers

9M Followers

70.4K Followers

1.8M Followers