Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Subscribe to our monthly newsletter
Copyright © 2025. All rights reserved by Centaur.ai
Blog
— Via AIMed
The life-saving reason why medical annotation company Centaur Labs wants us all to start analyzing medical images
In 1987, Jack Treynor, Finance Professor at the University of Southern California, conducted an experiment with his class in an effort to prove market efficiency. Treynor asked each of his 56 students to estimate the number of jelly beans inside a jar. The jar contained 850 beans, and the median answer Treynor’s students gave was 870.
Only one student managed to give an estimate that was closer to the true value than the group median. The experiment became a classic example of the wisdom of crowds, where the average answer obtained from a group of individuals tends to be more accurate than the answers of the individuals themselves.
Erik Duhaime, Co-Founder and CEO of medical data labeling company Centaur.ai, knew the experiment. But when he studied it again during his PhD at the MIT Center for Collective Intelligence, he saw another potential use. At the center, researchers look at how humans and computers can be better connected to become more powerful.
“I was partly inspired by my wife, who was attending medical school and residency at that time,” says Duhaime. “My PhD research focused on how to aggregate the opinions of multiple experts. Particularly, overcoming the challenge of making the wisdom of crowds work for certain tasks like analyzing medical images, where some people might have the professional knowledge and skills to do so, while others do not.”
The new AI-powered scientific search engine, Consensus, partners with Centaur.ai to generate high-quality, scalable scientific data labels for research.
Centaur.ai provided clinicians who evaluated AI-generated medical answers for the NIH’s MedAESQA dataset, verifying each statement’s accuracy and citation support. This expert-in-the-loop process ensures reliable, evidence-based benchmarks for healthcare AI. The project reflects Centaur.ai’s mission to improve AI through human oversight in high-stakes, precision-critical environments like medicine.
Today, we’re getting to know Tom Gellatly, a Centaur Labs co-founder and the VP of engineering!