1 link tagged with all of: language-models + contrastive-decoding + model-ensembling + clinical-nlp
Click any tag below to further narrow down your results
Links
Researchers developed CAPT, a method that lets newer general-purpose language models borrow clinical knowledge from older specialized medical models without requiring expensive retraining. The approach uses contrastive decoding to selectively inject clinical terminology and reasoning patterns while keeping the newer model's superior language abilities, and it works even when the models use different vocabularies. In tests on clinical tasks, CAPT beat existing ensemble methods by significant margins and produced outputs physicians rated as more accurate and clinically appropriate.
- CAPT lets a new general-purpose LLM borrow clinical knowledge from an old specialized medical model at inference time, no retraining needed, even when they use different tokenizers/vocabularies
- It beat UniTE by 17.6% and proxy tuning by 41.4% on average across six clinical classification and generation tasks
- Token-level analysis confirmed the mechanism works as designed: clinical terms (drugs, symptoms, procedures) come from the legacy clinical model while structure/fluency comes from the new general model
- Physicians rated CAPT's outputs as more accurate and clinically appropriate in case studies