VetCompass

Is That the Right Dose?


Brian Hur, Lucy Lu Wang, Laura Hardefeldt and Meliha Yetsigen
16/08/2024

Optimizing antibiotic dosing recommendations is a vital aspect of antimicrobial stewardship (AMS) programs aimed at combating antimicrobial resistance (AMR), a significant public health concern, where inappropriate dosing contributes to the selection of AMR pathogens. Akey challenge is the extraction of dosing information, which is embedded in free-text clinical records and necessitates numerical transformations. This paper assesses the utility of Large Language Models (LLMs) in extracting essential prescription attributes such as dose, duration, active ingredient, and indication. We evaluate methods to optimize LLMs on this task against a baseline BERT-based ensemble model. Our findings reveal that LLMs can achieve exceptional accuracy by combining probabilistic predictions with deterministic calculations, enforced through functional prompting, to ensure data types and execute necessary arithmetic. This research demonstrates new prospects for automating aspects of AMS when no training data is available.

 

Read the full text:

Hur, B.; Wang, L.L.; Hardefeldt, L.; Yetisgen, M. Is That the Right Dose? Investigating Generative Language Model Performance on Veterinary Prescription Text Analysis. In Proceedings of the 23rd Workshop on Biomedical Natural Language Processing, 2024, pages 390–397, Bangkok, Thailand. Association for Computational Linguistics. https://doi.org/10.18653/v1/2024.bionlp-1.30

 

AdobeStock 411745612 50

"Hands in blue protective gloves. Veterinary clinic." by Antibydni (Adobe Stock 411745612)