Rian Touchent

OntoBook method enhances medical encoder pretraining with synthetic textbooks

Researchers have developed OntoBook, a novel method for pretraining encoder language models using synthetic medical textbooks. This approach converts medical ontology structures into text, which is then used to train mo…