• Including Conference Abstracts for Evidence Synthesis Through Systematic Reviews

    Including Conference Abstracts for Evidence Synthesis Through Systematic Reviews
    Including Conference Abstracts for Evidence Synthesis Through Systematic Reviews

    Systematic literature reviews (SLRs) serve as the gold standard for evidence synthesis, informing healthcare decisions. However, a pertinent question arises in the methodology of these reviews: should conference abstracts be included in the search for relevant studies? This query prompts a comprehensive examination of both the advantages and disadvantages, with the ultimate decision based on the specific goals of the SLR.[1]

    Conference abstracts, often preceding full publications, provide timely access to critical information. This timeliness is especially vital in rapidly evolving fields, ensuring that SLRs stay current and offer an up-to-date perspective on the existing evidence landscape. Further, considering that not all conference abstracts are published in peer-reviewed journals, excluding abstracts translates to the exclusion of valuable data, compromising the comprehensiveness of the SLR.[1]

    It is well known that SLRs that rely solely on published studies carry a risk of publication bias which can distort the overall treatment effect estimate. Publication bias arises out of the selective publication of studies with positive results. Including conference abstracts acts as a countermeasure to this, offering a more balanced representation of study outcomes, regardless of their direction. This inclusion contributes to a more nuanced understanding of the effectiveness of the intervention.[1]

    Excluding conference abstracts that report early trial findings particularly randomized controlled trials (RCTs) from the evidence synthesis process introduces ethical concerns as well. Patient participation is grounded in the expectation that their contribution will contribute to scientific knowledge. The non-fulfillment of this commitment is viewed as an ethical problem, emphasizing the importance of including conference abstracts to honor the contributions of study participants. This ethical dimension adds a layer of responsibility to systematic reviewers, urging them to consider the broader implications of excluding conference abstracts.[1]

    Conference abstracts frequently present findings with direct policy implications. Including them in SLRs ensures that policy decisions are informed by the latest and potentially impactful research. This alignment of SLR processes with real-world applications enhances the relevance and applicability of the synthesized evidence, making it a valuable resource for policymakers and healthcare practitioners. The advantages of including conference abstracts extend beyond the content they provide, contributing to a more dynamic and adaptive SLR process.[1]

    However, the process of identifying relevant conferences, extracting abstracts, and sifting through extensive collections can be resource-intensive. Despite advancements like the inclusion of conference abstracts in searchable databases such as EMBASE, challenges persist. Abstracts, characterized by brevity, may lack essential information for systematic reviewers to comprehensively assess study design, methods, bias risk, outcomes, and results. The concise nature of abstracts poses a challenge for reviewers seeking a thorough understanding of the included studies. Additionally, the non-standard format of conference abstracts presents an additional layer of complexity, further complicating the extraction and evaluation process.[3]

    Moreover, abstracts often lack peer review, and their preliminary nature may result in unreliable information. Discrepancies between abstracts and subsequent full publications, particularly in critical aspects such as methods and results, raise questions about the dependability of abstracts. While meta-epidemiologic studies have shown only minor differences in results between meta-analyses with and without conference abstracts, the inclusion of “gray” literature, including conference abstracts, may lead to shifts in significance levels or, in some cases, no substantial change.[3,4]

    In conclusion, the decision to include conference abstracts in SLRs should be carefully considered. The advantages, including timeliness, addressing publication bias, ethical considerations, and informing policy decisions, underscore the potential benefits. However, challenges related to resource intensity, information adequacy, and reliability necessitate a nuanced approach. By adopting a flexible and evidence-driven strategy, systematic reviewers can harness the benefits of including conference abstracts without compromising the integrity of their synthesis efforts.

    Become A Certified HEOR Professional – Enrol yourself here!

    References

    1. Hackenbroich S, Kranke P, Meybohm P, Weibel S. Include or not to include conference abstracts in systematic reviews? Lessons learned from a large Cochrane network meta-analysis including 585 trials. Systematic Reviews. 2022 Dec;11(1):1-0.
    2. Murad H, Smith J, Singh G, Deber R. Methodological and reporting quality of conference abstracts: a systematic review. J Clin Epidemiol. 2013;66(7):705-15.
    3. Cohen AM, Glazner JE, Roeder K, Sandvik L. Does inclusion of published abstracts of randomized controlled trials in systematic reviews affect risk ratio estimates? J Clin Epidemiol. 2014;67(7):796-802.
    4. Egger M, Davey SG, Davey A. Bias in the selection of conference abstracts for presentation. Lancet. 1997;349(9055):1069-70.
  • Should Conferences Impose Uniform Reporting Guidelines for Research Abstracts?

    Should Conferences Impose Uniform Reporting Guidelines for Research Abstracts?
    Should Conferences Impose Uniform Reporting Guidelines for Research Abstracts

    Medical conferences are pivotal platforms for medical researchers from across the globe to disseminate discoveries, foster collaborations, and advance knowledge. Presentation of research findings at conferences is done in a format that best suits the nature of the research. For instance, a case report may benefit from a narrative approach, emphasizing the patient’s journey, while research on a new intervention may require a data-driven, factual presentation. Conferences organized across the globe often have different themes and focus points. However, this diverse nature of conferences and research reporting comes with a critical challenge: a lack of uniform reporting guidelines for research abstracts. This lacuna has been associated with significant challenges in the effectiveness of communication and evaluation of research presented at conferences, especially when research abstracts from different conferences are synthesized in the form of a systematic literature review (SLR).[1]

    Despite the advantages of flexibility in abstract presentation, the lack of standardized reporting guidelines presents obstacles. Ambiguous or incomplete abstracts hinder reviewers’ ability to assess research merit, potentially leading to biases in selection. Furthermore, inconsistent reporting makes it challenging to compare findings across studies, hindering knowledge synthesis and evidence-based practice. Another notable concern is the absence of a peer review process for abstracts that not only compromises the reliability and credibility of presented research but also poses important questions about the validity of findings and their applicability. These issues become particularly relevant in healthcare, where accurate and transparent reporting is critical for medical researchers seeking information for clinical practice and researchers conducting evidence syntheses like systematic reviews.[1]

    To address these challenges, the imposition of uniform reporting guidelines for research abstracts is a topic of debate within the scientific community. Striking the right balance between standardization and flexibility requires thoughtful consideration and collaboration between researchers, conference organizers, and professional bodies. Developing comprehensive guidelines that ensure essential information is accessible to reviewers and attendees while remaining adaptable to diverse conference themes and research disciplines is crucial.[1]

    One effective solution involves establishing core reporting elements that ensure abstract clarity and informativeness. Mandating specific sections for research objectives, methodology, key findings, and limitations creates a standardized framework. Scientific committees, comprised of researchers endorsing this core structure, can balance standardization and flexibility. Embracing technology is pivotal in this process, as online submission platforms equipped with tools to check adherence and standardized data templates tailored to different disciplines can streamline the abstract reporting process, ensuring consistent reporting.[2]

    Different reporting guidelines are already available to guide the reporting of research in journal manuscripts, each tailored to specific study designs. For example, PRISMA provides comprehensive guidance for systematic reviews, ensuring transparent and complete reporting of review methodologies and findings. PRISMA-A, an extension of the PRISMA Statement, specifically addresses systematic review abstracts, advocating for structured reporting aligned with PRISMA principles. CONSORT guidelines for RCTs offer a detailed framework for reporting randomized controlled trial (RCT) abstracts, emphasizing clarity, transparency, and completeness in presenting key study details. Various other reporting guidelines, such as STROBE, STARD, etc., are also available to enhance the comprehensiveness of other study designs. The increased usage of these guidelines to report research in manuscripts is largely attributable to the efforts of the ICMJE (International Committee of Medical Journal Editors), which has been instrumental in endorsing these guidelines as well as making the usage of these guidelines a mandatory process for authors who submit manuscripts to journals. This, in turn, has enhanced transparency and standardization in presenting findings in articles published in peer-reviewed journals.[3,4]

    A similar effort is required in developing and/ or promoting uniform reporting guidelines for abstracts in conferences. Embracing comparable practices in conferences will ensure that abstract reporting consistently maintains high standards, reinforcing the overall integrity of disseminating research across platforms. In this regard, akin to the role played by the ICMJE, it is the responsibility of various professional bodies to work towards the implementation of a uniform framework for research abstract presentations in different conferences across the world.[3,4]

    In conclusion, the debate on imposing uniform reporting guidelines for conference abstracts reflects the nuanced nature of scientific communication. While the advantages of flexibility are acknowledged, the drawbacks of inconsistent reporting must be addressed to ensure unbiased evaluation and effective knowledge synthesis. Embracing the various guidelines, technology, and educational initiatives can contribute to a transparent, credible, and communicative landscape for sharing research findings at conferences, ultimately advancing scientific progress.

    Become A Certified HEOR Professional – Enrol yourself here!

    References

    1. Saric L, Dosenovic S, Mihanovic J, Puljak L. Biomedical conferences’ author instructions rarely mention guidelines for reporting abstracts of trials and systematic reviews. Journal of Comparative Effectiveness Research. 2019 Dec;9(2):83-91.
    2. Beller EM, Glasziou PP, Altman DG, et al. PRISMA for abstracts: reporting systematic reviews in journal and conference abstracts. PLoS medicine. 2013 Apr 9;10(4):e1001419.
    3. Hopewell S, Clarke M, Moher D, et al. CONSORT for reporting randomised trials in journal and conference abstracts. The Lancet. 2008 Jan 26;371(9609):281-3.
    4. Mbuagbaw L, Thabane M, Vanniyasingam T, et al. Improvement in the quality of abstracts in major clinical journals since CONSORT extension for abstracts: a systematic review. Contemporary clinical trials. 2014 Jul 1;38(2):245-50.