by MarksMan Healthcare | 0 Comments CHARMS , Clinical Prediction Models , Risk of Bias , Systematic Literature Reviews
Clinical prediction models (CPMs) are statistical models that use patient characteristics and clinical variables to estimate the probability of a particular health outcome, such as a disease or adverse event. CPMs can be diagnostic prediction models that aid in diagnosis, by predicting the likelihood that a person is currently having a particular health condition (for example, Wells score for pulmonary embolism). Another type of CPMs is the prognostic prediction models, which aid in prognosis by predicting the likelihood that a person will experience a particular health outcome over a specific period (for example, the Framingham Risk Score for cardiovascular disease). (1) These days CPMs have become an essential part of evidence-based clinical practice, and thus it becomes important that the CPMs provide accurate estimation of the disease condition for which they are used. (2, 3) Towards this direction, systematic literature reviews (SLRs) are often conducted to determine the quality and validity of CPMs, as well as to identify gaps in the literature to inform the development of new CPMs. (4)
The CHARMS (Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies) checklist is a tool that has been developed to facilitate the critical evaluation and data extraction while performing SLRs of CPMs. First published in 2014, this checklist provides explicit guidance to help reviewers and users to frame the right review question. It also provides a data extraction list with explicit guidance on which items to extract from CPM studies for evaluating the risk of bias and applicability. It can be used to critically appraise all types of primary prediction model studies for all kinds of the target population, outcomes, and predictors, regardless of the statistical techniques used. (5) Thus, the CHARMS checklist helps the researchers in two critical areas of conducting an SLR: framing the review question, and critical appraisal of included articles.
The contents of the CHARMS checklist are arranged in two sections. First, there is a list of 7 key items to help the researcher frame a well-defined, proper, and focussed review questions; these key items include the intended scope of the review, type of prediction model studies, prognostic versus diagnostic prediction model, target population to whom the prediction model applies, outcome to be predicted, the period of the prediction, and the intended moment of using the model. Next, the checklist provides guidance for data extraction and critical appraisal of the included articles in the SLR by means of 35 key items that are organized in 11 domains: source of data, participants, outcome to be predicted, candidate predictors, sample size, missing data, model development, model performance, model evaluation, results, interpretation and discussion. (4, 5)
Ever since its publication in 2014, the CHARMS checklist has been used by various SLRs of CPMs. (6-10) To further facilitate the easier application of the CHARMS tool, an Excel template for data extraction and risk of bias assessment of clinical prediction models has been recently published; this template makes it possible for the user to apply both the CHARMS and the PROBAST (Prediction model Risk Of Bias Assessment Tool) while conducting critical appraisal of SLRs of CPMs. It will also encourage more accurate and thorough reporting of these systematic reviews. (11)
Critical appraisal of included studies is an essential part of any SLR, and SLRs of CPMs is not an exception. It is crucial that the tool used for the critical appraisal is validated, asks the correct questions, is user-friendly, and gives accurate results. The CHARMS checklist, standing the test of the time, fits the bill perfectly, and along with the PROBAST tool, has become an invaluable resource in the conduct of SLRs of CPMs.
Become A Certified HEOR Professional – Enrol yourself here!
References: