We’re releasing Ortet’s first health evaluation results: 34 open-weight models, 50 tasks, and 15 public benchmarks served and evaluated on Orion, our NVIDIA Blackwell GPU cluster. A few findings: - General rankings are not enough for health. - Open models are competitive on basic medical knowledge and are more willing research collaborators. - Both open and closed models struggle on the patient-prediction tasks we tested. - More reasoning usually helps, but the highest setting doesn’t always produce the best observed score. - Health rankings can be estimated with a small subset of questions. This is the first step towards our goal—to build continuously improving intelligence across the clinical, biological, and operational aspects of health. Read the blogpost: More on the findings below 🧵