#MarksManInsights

Assessing the value of interventions in rare diseases poses unique challenges due to the small patient populations and the heterogeneity of these conditions. Traditional statistical methods often fall short of providing robust and meaningful analyses. The Win Ratio method, an innovative statistical approach, has emerged as a valuable tool to address these challenges and provide a more nuanced evaluation of treatment effects.[1]

In 2012, Pocock et al. introduced the win ratio approach to enhance the analysis of composite endpoints in randomized controlled clinical trials. This method involves evaluating whether a participant on an experimental treatment performed better (a “win”), worse (a “loss”), or about the same (a “tie”) as a participant on the control treatment across a series of endpoints, prioritized by their clinical importance. Traditional reporting of composite endpoints often emphasizes the first event for each patient, which may be of lesser clinical importance. The win ratio approach addresses this limitation by offering a more meaningful way to report composite endpoints.[2,3]

The Win Ratio method involves pairwise comparisons between patients in treatment and control groups, forming matched pairs based on risk profiles. Each pair is assessed: the patient experiencing a death first is labeled a ‘loser,’ and if this event is unknown, the next priority event, hospitalization, is considered; if neither event occurs first, the pair is tied. The win ratio is calculated as the total number of winners divided by the total number of losers, allowing simultaneous consideration of multiple outcomes prioritized by clinical importance, unlike traditional methods focusing on a single primary endpoint.[1-3]

Two approaches have been described for calculating the win ratio. In the Matched Pair Approach, matched pairs are selected from treatment and control groups using risk scores and outcomes are compared based on a hierarchy of events. In the Unmatched Pair Approach, every patient in the treatment group is compared with every patient in the control group. The win ratio method offers a robust approach to assessing multiple clinical outcomes, providing a clearer picture of treatment efficacy. The process of scoring wins, ties, and losses involves comparing outcomes according to the hierarchy until a win, loss, or tie is determined. A Win Ratio greater than 1 indicates a favorable outcome for the treatment, while a ratio less than 1 suggests a favorable outcome for the control.[2,4-6]

Studies have indicated that the Win ratio method might be particularly useful in rare disease research. Since rare diseases are a highly heterogeneous group of disorders marked by significant phenotypic and genotypic diversity within individual conditions, the limited number of affected individuals presents unique challenges in understanding these diseases and developing treatments. Notable challenges in rare disease research include patient identification, recruitment, high costs, small sample sizes, disease heterogeneity, and the need for specialized trial designs and multiple endpoints.[1] The Win Ratio method is advantageous in rare disease research due to its flexibility in endpoint selection and the ability to incorporate multiple clinically relevant endpoints. This method addresses concerns about composite primary endpoints in randomized trials, where less significant events like hospitalizations may dominate. By focusing on more clinically important components and allowing repeated analyses with different randomly removed patients to calculate a median win ratio, it ensures comprehensive data use and sequential outcome assessment. It is particularly effective for small sample sizes, maximizing data use, enhancing statistical power, and prioritizing important endpoints.[2,3,7-9]

The Win Ratio method has demonstrated its utility in various rare disease studies by effectively integrating multiple clinically relevant endpoints. In a clinical trial for amyotrophic lateral sclerosis (ALS), for instance, the method incorporated survival, functional decline, and respiratory function into the analysis. This comprehensive approach revealed a significant treatment effect that traditional methods missed, highlighting the Win Ratio’s value in rare disease research. Another example is its application in the COMET phase 3 trial for late-onset Pompe disease, showcasing its ability to analyze multiple endpoints in the context of orphan drug development. These examples underscore the method’s effectiveness in capturing the full scope of treatment impacts in rare diseases.[2,3]

While the Win Ratio method offers significant advantages, it also presents some challenges. Establishing the hierarchy of endpoints requires careful consideration and consensus among clinical experts. Critics argue that the Win Ratio can overestimate treatment effects by ignoring tied pairs and equally weighting each hierarchical component, potentially leading to fallacies in clinical interpretation. Another major issue is that ties (neither a win nor a loss) are often disregarded, which can skew results. Clinicians should not rely solely on the Win Ratio statistic but must understand the overall treatment effect by accounting for ties and dropouts to ascertain meaningful measures such as the number needed to treat or harm. Assessing aggregate clinical benefits is necessary to translate trial data into a comprehensive understanding of the magnitude, temporal relationships, durability, and overall value of the treatment, including cost-effectiveness. Additionally, the method’s complexity may require specialized statistical expertise, posing a barrier for some research teams.[10-12]

The Win Ratio method represents a significant advancement in the assessment of interventions for rare diseases. Its ability to handle multiple endpoints, small sample sizes, and clinically relevant outcomes makes it a powerful tool for evaluating treatment effects. As the field of rare disease research continues to evolve, the Win Ratio method is likely to play an increasingly important role in guiding clinical and regulatory decisions, ultimately improving outcomes for patients with rare conditions.

Become A Certified HEOR Professional – Enrol yourself here!

References:

1. Liu J, Barrett JS, Leonardi ET, Lee L, et al. Natural history and real‐world data in rare diseases: applications, limitations, and future perspectives. The Journal of Clinical Pharmacology. 2022 Dec;62:S38-55.
2. Pocock SJ, Ariti CA, Collier TJ, Wang D. The win ratio: a new approach to the analysis of composite endpoints in clinical trials based on clinical priorities. European heart journal. 2012 Jan 1;33(2):176-82.
3. Boentert M, Berger KI, Díaz-Manera J, et al. Applying the win ratio method in clinical trials of orphan drugs: an analysis of data from the COMET trial of avalglucosidase alfa in patients with late-onset Pompe disease. Orphanet Journal of Rare Diseases. 2024 Jan 12;19(1):14.2024;19(1):14.
4. Hongyue WA, Jing PE, Zheng JZ, et al. Win ratio–An intuitive and easy-to-interpret composite outcome in medical studies. Shanghai Archives of Psychiatry. 2017 Feb 2;29(1):55.
5. Finkelstein DM, Schoenfeld DA. Combining mortality and longitudinal measures in clinical trials. Statistics in medicine. 1999 Jun 15;18(11):1341-54.
6. Luo X, Tian H, Mohanty S, Tsai WY. An alternative approach to confidence interval estimation for the win ratio statistic. Biometrics. 2015 Mar;71(1):139-45.
7. Freemantle N, Calvert M, Wood J, Eastaugh J, Griffin C. Composite outcomes in randomized trials: greater precision but with greater uncertainty?. Jama. 2003 May 21;289(19):2554-9.
8. Ishak KJ, Caro JJ, Hamed A, et al. SA26 Win Ratio Analyses of Multiple Endpoints in Rare Disease Trials: A Case-Study Based on a Trial of Avaglucosidase Alfa in Late-Onset Pompe Disease (LOPD). Value in Health. 2022 Dec 1;25(12):S487-8.
9. Montori VM, Permanyer-Miralda G, Ferreira-González I, et al. Validity of composite end points in clinical trials. Bmj. 2005 Mar 10;330(7491):594-6.
10. Verbeeck J, Dirani M, Bauer JW, et al. Composite endpoints, including patient reported outcomes, in rare diseases. Orphanet Journal of Rare Diseases. 2023 Sep 1;18(1):262.
11. Dong G, Hoaglin DC, Qiu J, et al. The win ratio: on interpretation and handling of ties. Statistics in Biopharmaceutical Research. 2020 Jan 2.
12. Ajufo E, Nayak A, Mehra MR. Fallacies of using the win ratio in cardiovascular trials: challenges and solutions. Basic to Translational Science. 2023 Jun 1;8(6):720-7.