Fun addition to transformers serve: you can now turn any of the 250 LLM & VLM model into a JEV-like decision model.
/v1/systemone scores a set of decision with the model's logits. No need to generate text!
Which one of them can get microducks across the finish line fast?