Everyone’s chatbot can book a doctor’s appointment.
The real test is whether you can earn the trust of a Spanish-speaking diabetic woman, walk her through a Medicaid application while finding her secure housing, and coach her into choosing a 12oz (instead of 16oz) soda along the way.
Today we’re sharing BabaBench, a benchmark measuring how frontier models perform the real work of healthcare coordination. Our synthetic worlds are built from annotations by Baba’s in-house team of hundreds of expert doctors, therapists, nurses, and social workers.
Turns out, AI alone isn’t ready to replace human care coordination.