This is how we support a bunch of neolabs training frontier models (some of which we should be able to talk about in public soon when they release their models).
Pretty neat trick
@part_harry_ and
@stefanopopoulos cooked up reading the compressed block directly rather than scanning every byte.