yesterday we chatted with
@martin_casado and
@sarahdingwang on the pod and he happened to do basic math™ on the logic of asics
today
@taalas_inc launched their HC1 asic that can inference 17k tok/s. Sure, it's a shitty 3.1 8B today which is a 1.5 year gap.
But read the details