With traditional user interfaces, users may browse or explore visualised patient data, but little to no help is given when it comes to the interpretation of what is being displayed. Semantic annotations should provide the necessary image information, and a semantic dialogue system should be used to ask questions about the image annotations while engaging the clinician in a natural speech dialogue. Our motivation in developing RadSpeech is the design and implementation of a multimodal dialogue system for the radiologist. Dialogue-based semantic image retrieval should provide the basis for help in clinical decision support and computer aided diagnosis.

Radspeech is part of the THESEUS-MEDICO project which is funded by the Federal Ministry of Economics and Technology

Find out our path from research to
the THESEUS-Medico prototypes.

Find more presentations and projects of Prof. Daniel Sonntag

Main Objectives

With RadSpeech, we aim to build the next generation of intelligent, scalable, and user-friendly semantic search interfaces for the medical imaging domain, based on semantic technologies. Ontology-based knowledge representation is used not only for the image contents, but also for the complex natural language understanding and dialogue management process. With the incorporation of higher level knowledge represented in ontologies, different semantic views of the same medical images (such as structural, functional, and disease aspects) can be explicitly stated and integrated.

A radiologist’s daily task in the SIEMENS patient image finding stations as installed at the University Hospital Erlangen defines the application scenario. We strive for more efficiency during the medical finding process and for more structured finding reports including semantic image annotations.



On the road of realising and publishing this project we are proud to work together and get supported by

Project Duration: June 2010 – June 2012
(As of June 2012, RadSpeech’ s development will be carried on in THESEUS Data Intelligence)

Principal Investigator: Dr. Daniel Sonntag, DFKI
Industrial Partners: Siemens Healthcare, Siemens Technology
Clinical Partner: University Hospital Erlangen

Associated researchers and developers:
Christian Reuschling (DFKI), Christian Husodo Schulz (DFKI), Michael Sintek (DFKI), Daniel Porta (DFKI), Dr. Manuel Möller (DFKI), Maha Ahmed Baker (DFKI), Jochen Setz (DFKI), Milos Kalab (DFKI), Colette Weihrauch (DFKI), Luis Galárraga (DFKI), Martin Kramer (Siemens)

Industrial and clinical advisors:
Dr. Sascha Seifert (Siemens),  Prof. Dr. Alexander Cavallaro (University Hospital Erlangen), Dr. Matthias Hammon (University Hospital Erlangen)