Citation

Osman M, Cooper R, Sayer AA, Witham MD. Age Ageing 2024; 53(7): afae135.

Copyright

(Copyright © 2024, Oxford University Press)

DOI

10.1093/ageing/afae135

PMID

38970549

Abstract

BACKGROUND: Recording and coding of ageing syndromes in hospital records is known to be suboptimal. Natural Language Processing algorithms may be useful to identify diagnoses in electronic healthcare records to improve the recording and coding of these ageing syndromes, but the feasibility and diagnostic accuracy of such algorithms are unclear.

METHODS: We conducted a systematic review according to a predefined protocol and in line with Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. Searches were run from the inception of each database to the end of September 2023 in PubMed, Medline, Embase, CINAHL, ACM digital library, IEEE Xplore and Scopus. Eligible studies were identified via independent review of search results by two coauthors and data extracted from each study to identify the computational method, source of text, testing strategy and performance metrics. Data were synthesised narratively by ageing syndrome and computational method in line with the Studies Without Meta-analysis guidelines.

RESULTS: From 1030 titles screened, 22 studies were eligible for inclusion. One study focussed on identifying sarcopenia, one frailty, twelve falls, five delirium, five dementia and four incontinence. Sensitivity (57.1%-100%) of algorithms compared with a reference standard was reported in 20 studies, and specificity (84.0%-100%) was reported in only 12 studies. Study design quality was variable with results relevant to diagnostic accuracy not always reported, and few studies undertaking external validation of algorithms.

CONCLUSIONS: Current evidence suggests that Natural Language Processing algorithms can identify ageing syndromes in electronic health records. However, algorithms require testing in rigorously designed diagnostic accuracy studies with appropriate metrics reported.

Language: en

Keywords

Humans; Aged; systematic review; Algorithms; natural language processing; older people; Syndrome; Geriatric Assessment/methods; *Accidental Falls; *Natural Language Processing; *Aging; *Electronic Health Records; *Frailty/diagnosis; *Sarcopenia/diagnosis/epidemiology/physiopathology; ageing syndromes; electronic healthcare records; informatics