SourceAMIE: Advancing medical AI for video consultations
This could improve remote healthcare by allowing AI to observe physical symptoms during virtual visits. It may provide a more effective patient experience than existing text-based tools.
- AMIE is built on Gemini and Project Astra using a multi-agent architecture
- Interprets visual and auditory cues, guides virtual physical exams, and reasons diagnostically in real time
- Evaluated favorably across core clinical competencies in simulated consultations with patient actors and primary care physicians
- Patient actors preferred the video experience over text chat