Text Knows What, Tables Know When: Clinical Timeline Reconstruction via Retrieval-Augmented Multimodal Alignment
Using both patient notes and data tables to figure out when medical events actually happened
Researchers created a system that combines clinical notes with structured hospital records to pinpoint when medical events occurred in a patient's care, solving a common problem where narratives are detailed but vague on timing, while data tables are precise but incomplete. The approach improved accuracy by using notes to identify key events, then checking them against hospital database records to lock down exact dates and times. The method recovered nearly 35% of clinically important events that appeared in notes but were never recorded in the hospital's structured data.
Hospitals need accurate timelines to predict which patients are deteriorating—crucial for conditions like sepsis where hours matter. Current systems force doctors to choose between rich but fuzzy narratives or precise but gappy data tables. This method uses both, meaning clinicians get both the full picture of what happened to a patient and the exact timing of when it happened, improving risk prediction and care decisions.