A new research paper investigates the robustness of transferability estimation (TE) metrics, which aim to predict the best source model for transfer learning, particularly in medical imaging. The study highlights that small changes in the target dataset, such as sample size and random seeds, can significantly alter model rankings. Furthermore, the choice of evaluation metric used for reference rankings also impacts the assessment of TE metrics, leading to low agreement between TE metric rankings and actual performance. AI
IMPACT Highlights potential unreliability in model selection methods for medical AI, impacting deployment and research.
RANK_REASON The cluster contains a research paper published on arXiv discussing methodology in machine learning for medical imaging. [lever_c_demoted from research: ic=1 ai=1.0]
- Hugging Face
- ImageNet
- medical imaging
- random seeds
- target dataset
- Transferability estimation (TE) metrics
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →