DoctoBERT

New web data recipe boosts French medical encoder pretraining

Researchers have developed a new method for pretraining medical language encoders using web-scale data, addressing limitations of smaller, manually curated corpora. Their approach involves filtering documents for medica…