1 link tagged with all of: language-models + domain-adaptation + clinical-nlp + contrastive-decoding + model-ensembling
Links
Researchers developed CAPT, a method that lets newer general-purpose language models borrow clinical knowledge from older specialized medical models without requiring expensive retraining. The approach uses contrastive decoding to selectively inject clinical terminology and reasoning patterns while keeping the newer model's superior language abilities, and it works even when the models use different vocabularies. In tests on clinical tasks, CAPT beat existing ensemble methods by significant margins and produced outputs physicians rated as more accurate and clinically appropriate.
- CAPT lets a new general-purpose LLM borrow clinical knowledge from an old specialized medical model at inference time, no retraining needed, even when they use different tokenizers/vocabularies
- It beat UniTE by 17.6% and proxy tuning by 41.4% on average across six clinical classification and generation tasks
- Token-level analysis confirmed the mechanism works as designed: clinical terms (drugs, symptoms, procedures) come from the legacy clinical model while structure/fluency comes from the new general model
- Physicians rated CAPT's outputs as more accurate and clinically appropriate in case studies
language-models
clinical-nlp
model-ensembling
domain-adaptation
contrastive-decoding