AMIE, a multimodal conversational AI agent developed by Google DeepMind, has been enhanced to intelligently request and interpret visual medical information during clinical dialogues, emulating the structured history-taking of experienced clinicians. Evaluations show that AMIE can match or exceed primary care physicians in diagnostic accuracy and empathy while utilizing multimodal data effectively in simulated consultations. Ongoing research aims to further refine AMIE's capabilities using advanced models and assess its performance in real-world clinical settings.
ai ✓
+ healthcare
diagnostics ✓
multimodal ✓
machine-learning ✓