Capabilities
Microsoft's MAI-DxO Diagnosis Study: What the 83% Score Does and Does Not Show
Microsoft says its AI diagnostic system beat primary care doctors on hard cases. The comparison group, the cost data and the base model all matter.
2 articles on Emergent Wire tagged "model evaluation."
2 articles
Microsoft says its AI diagnostic system beat primary care doctors on hard cases. The comparison group, the cost data and the base model all matter.
Contamination, saturation, prompt sensitivity, and averaging. Four reasons a leaderboard number tells you less than ten minutes with the test items.