Skip to main content
UploadLanguage (EN)Support
BusinessMobileSocial MediaMarketingTechnologyArt & PhotosCareerDesignEducationPresentations & Public SpeakingGovernment & NonprofitHealthcareInternetLawLeadership & ManagementAutomotiveEngineeringSoftwareRecruiting & HRRetailSalesServicesScienceSmall Business & EntrepreneurshipFoodEnvironmentEconomy & FinanceData & AnalyticsInvestor RelationsSportsSpiritualNews & PoliticsTravelSelf ImprovementReal EstateEntertainment & HumorHealth & MedicineDevices & HardwareLifestyle
Ashok Pandey, profile picture
Uploaded byAshok Pandey
PPTX, PDF358 views

Basic concept of Systematic Review and PRISMA

On 14 November, I delivered a short introductory session on the concept of systematic reviews and the PRISMA guidelines to the research team at the Policy Research Institute.

Science◦
Related topics:
Literature Reviews•
Downloaded 23 times
Ashok Pandey 1 Basic concept of Systematic Review and PRISMA Presented by Ashok Pandey Research Fellow Policy Research Institute
Ashok Pandey 2 Disclaimer https://www.slideshare.net/AshokPandey8 1. Training 2. Content Outcomes https://www.researchgate.net/profile/Ashok-Pandey-17?ev= hdr_xprf
Ashok Pandey 3
Ashok Pandey 4 Khadka, 2023
Ashok Pandey 5 Basic facts Critical appraisal and synthesis of research findings in a systematic manner emerged in its first formal guise in 1975 under the term 'meta analysis'. The phrase was coined by Glass who conducted syntheses in the areas of psychotherapy (Smith, Glass and Miller 1980) and class size (Glass and Smith 1979). Biomed: With over 2.9 million article accesses in 2021 alone, Systematic Reviews is one of the world's leading journals in applied methodology. In 2019, a total of 80 systematic reviews are published per day. This is a large increase compared to 2000 and 2010 (4 and 14 per day). in 2022 alone, there were 40,946 non-Cochrane systematic reviews published.
Ashok Pandey 6 Accessing Information Accessing information contains two larger components: • Literature Search involves finding and read as many different references as possible to correlate the search query • Literature Review A literature review is an account of what has been published on a topic by accredited scholars and researchers.
Ashok Pandey 7 Citation Sample Environment Method Conclusions Colour Bellizzi, Crowley and Hasty (1983) 125 Adults Furniture store Laboratory experiment Photographic slide simulations Warm and cool colours created different emotional responses. Customers view red retail environments as more negative and unpleasant than blue. Bellizzi, & Hite (1992) 70 Adult women 107 Students Televisions shown with different colour backgrounds Furniture stores Laboratory experiments Photographic slide simulations Study based on PAD affect measures and approach-avoidance behaviours. More positive retail outcomes occurred in blue environments than red. Music Smith and Curnow (1966) 1100 Supermarket shoppers Retail store Field experiment Time in store reduced with loud music but level of sales did not. Milliman (1982) 216 Shoppers Supermarket Field experiment The tempo of background music influenced the pace at which customers shopped. Slow tempo music slowed customers down but resulted in increased volume of sales. Hui, Dubé and Chebat (1997) 116 Students Bank branch - waiting for service. Laboratory experiment Video simulation The positive impact of music on approach behaviours is mediated by an emotional evaluation of the environment and the emotional response to waiting. Pleasurable music produced longer perceived waiting times. Lighting Areni and Kim (1994) 171 Shoppers Wine store Field experiment The investigation found that brighter in-store lighting influenced shoppers to examine and handle more of the merchandise in the store Summers and Hebert (2001) 2367 Customers Hardware store Apparel store Field experiment Confirmed Areni and Kims (1994) results. Increased levels of lighting will produce arousal and pleasure and increase the approach behaviours of customers. Summary table of literature Atmospherics in service environments
Ashok Pandey 8 How to organize studies • Chronological • By publication date • By trend • Thematic • A structure which considers different themes • Methodological • Focuses on the methods of the researcher, e.g., qualitative versus quantitative approaches
Ashok Pandey 9 Types of review SN Label Description Search Appraisal Synthesis Analysis 1Critical review Aims to demonstrate extensive research and critical evaluation of literature quality; goes beyond description to analysis and conceptual innovation; often results in hypothesis or model. Seeks to identify most significant items in the field No formal quality assessment; evaluates contribution Narrative-conceptual or chronological Identifies conceptual contribution to theory 2Literature review Published materials examining recent/current literature; wide-ranging completeness; may include findings. May or may not be comprehensive May or may not include QA Typically narrative Chronological, conceptual, thematic 3 Mapping review/Systematic map Maps and categorizes literature; identifies gaps. Time/scope constrained No formal QA Graphical/tabular Characterizes quantity/quality; identifies gaps 4Meta-analysis Statistically combines quantitative studies. Exhaustive searching; may use funnel plot QA affects inclusion/sensitivity analyses Graphical/tabular + narrative Numerical effect analysis 5 Mixed studies/Mixed methods review Combines quantitative + qualitative approaches. Sensitive or multiple searches Generic or separate appraisal tools Narrative, tabular, sometimes graphical Correlates findings; gap analysis 6Overview Summary of literature describing characteristics. May or may not be comprehensive May or may not include QA Narrative, possible tables Chronological, thematic, conceptual 7 Qualitative systematic review Integrates qualitative studies to identify themes/constructs. Selective/purposive sampling QA mediates interpretation Qualitative narrative synthesis Thematic analysis; conceptual models 8Rapid review Systematic methods under time constraints. Search limited by time Time-limited QA Narrative/tabular Summaries of quantity & direction 9Scoping review Assesses size/scope of evidence incl. ongoing research. Time/scope constrained No formal QA Tabular + narrative Characterizes literature & viability 10State-of-the-art review Addresses current issues; offers new perspectives. Comprehensive search of current literature No formal QA Narrative with tables Current knowledge & future needs 11Systematic review Systematic searching, appraisal, synthesis. Exhaustive searching QA determines inclusion Narrative + tables What’s known; implications; gaps 12Systematic search & review Critical review + comprehensive search. Exhaustive searching Optional QA Minimal narrative; tables Best evidence; practice recommendations 13Systematized review Partially systematic, common in student work. Optional comprehensiveness Optional QA Narrative + tables Known info; uncertainties; limitations 14Umbrella review Compiles evidence from multiple reviews. Identify component reviews only QA of included reviews Graphical/tabular + narrative Known info; gaps; recommendations https://guides.mclibrary.duke.edu/sysreview/types A Living Systematic Review: evidence is emerging rapidly, current evidence is uncertain, and new research may change policy or practice decisions. Trial Sequential Analysis and Sequential Meta- Analysis, which both control for Type I error, Type II error
10 • Systematic reviews and meta- analyses are considered at the top of the hierarchy of evidence • They can provide invaluable information to researchers, and policymakers given that they are conducted properly • The conduct of systematic reviews and meta-analyses requires multiple steps that need to be transparent, well documented and reproducible Basic Concept of Systematic reviews Evidence pyramid. Source: The University of Alabama at Birmingham, available from: https://guides.library.uab.edu/ebd/evidencestrength
Ashok Pandey 11 Steps for conducting SR – Flow chart (1) Fig. 1 Detailed flow diagram guideline for systematic review and meta-analysis steps. Note: Star icon refers to “2–3 reviewers screen independently”
Ashok Pandey 12 PRISMA Flow Diagram Fig. 2 PRISMA flow diagram of studies’ screening and selection
Ashok Pandey 13 Search strategies 1. Identify main concepts and keywords. 2. Find synonyms using boolean OR to broaden the search • elderly OR senior citizen • cancer OR carcinoma OR neoplasm 3. Use boolean AND to join concepts and narrow the search • elderly AND stroke • depression AND alcoholism 4. Be careful with spellings (American vs English) (e.g.: anemia and anaemia; gynecology and gynaecology)
Ashok Pandey 14 Search strategies … 5. Use truncation (putting * at the end of a word stem) to search forms of the word (minimum four letters) • disa* (disability, disabilities, disabled) • cerebr* (cerebral, cerebrovascular) 6. Use inverted commas (“….”) for a phrase • “mental health” • “cardiovascular disease” 7. Use of wildcard (?) to search for any single letter in the space (not used in PubMed) • Wom?n will search woman and women • Organi?ation will search organization and organisation 8. Reproducibility of results
Ashok Pandey 15 Steps in SR 1. Assemble team: Statistician, Researcher 2. Develop a Research Question: 3. Write and register a protocol 4. Search the evidence 5. Screen the results 6. Assess for quality and Bias 7. Extract the data 8. Write the review
Ashok Pandey 16 Develop a Research Question 1. PICO: format (patient or population, intervention, comparison, and outcome) 2. PEO: The PEO question framework is useful for qualitative research topics. PEO questions identify three concepts: population, exposure, and outcome. 3. SPIDER: The SPIDER question framework is useful for qualitative or mixed methods research topics focused on "samples" rather than populations. SPIDER questions identify five concepts: sample, phenomenon of interest, design, evaluation, and research type. 4. SPICE: The SPICE question framework is useful for qualitative research topics evaluating the outcomes of a service, project, or intervention. SPICE questions identify five concepts: setting, perspective, intervention/exposure/interest, comparison, and evaluation. 5. ECLIPSE: The ECLIPSE framework is useful for qualitative research topics investigating the outcomes of a policy or service. ECLIPSE questions identify six concepts: expectation, client group, location, impact, professionals, and service. PEO, SPIDER, SPICE, and ECLIPS can help you formulate a focused research question. 25 other question frameworks link
Ashok Pandey 17 Write and register a protocol PROSPEROSystematic review protocol registry • BioMed Central ProtocolsBioMed Central will consider protocols of any type of research for publication, following the standard peer review. • BMJ OpenBMJ Open "will consider publishing without peer review protocols that have formal ethical approval and funding from a recognized, open access advocating research-funding body". Otherwise, protocols are peer reviewed. • JBI Evidence SynthesisLike systematic reviews, scoping review protocols can be published in some journals. • Systematic Reviews, a BioMed Central journalThis open access title publishes protocols of systematic reviews broadly related to health sciences.
Ashok Pandey 18 Search the evidence Sources of Grey Literature •Abstracts & Conferences •Regulatory •Government •Trial Registries •Repositories & Reports •International
Ashok Pandey 19 Screen the results Systematic Review Screening Tool Covidence Other Screening Software • DistillerSR (paid) • PICO Portal (free + paid versions) • Rayyan (free + paid versions) •Title/abstract: typically screened by two individuals though single screening is permitted, during this phase it is common for 90% of articles retrieved by the search to be excluded •Full-text: the full manuscripts are reviewed by two screeners and the result of their decisions determines whether the article is included in the review
Ashok Pandey 20 Assess for quality and Bias Methodological rigor and transparency of reported results. Tools for Assessing Risk of Bias and Quality: LATITUDES network is a library of validity assessment tools for use in evidence syntheses. Common risk of bias tools: • Mixed Methods Appraisal Tool (MMAT)Mixed-methods SRs with a variety of study types including both qualitative & quantitative, • IHE Case Series Studies Critical Appraisal ChecklistCase series • JBI Critical Appraisal Checklist for Case ReportsCase reports • QualSyst - STANDARD QUALITY ASSESSMENT CRITERIA for Evaluating Primary Research Papers from a V ariety of Fields
Ashok Pandey 21 Extract the data Data extraction should be conducted by two blinded, independent, reviewers to reduce bias and ensure data quality control. Trained the team Covidence Data Extraction: https://support.covidence.org /col/data-extraction-2-0 Qualitative Data Extraction Dedoose NVIVO
Ashok Pandey 22 Write the review PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) is a common reporting standard for systematic reviews, but there are others. Make sure to check your preferred journal's submission guidelines to see what their standards are for systematic reviews Reporting Guidelines: • PRISMA Checklist: The PRISMA 2020 statement comprises a 27-item checklist addressing the introduction, methods, results and discussion sections of a systematic review report. • PRISMA for Scoping Reviews: The PRISMA extension for scoping reviews was published in 2018. The checklist contains 20 essential reporting items and 2 optional items to include when completing a scoping review. Scoping reviews serve to synthesize evidence and assess the scope of literature on a topic. • MOOSE: Guidelines for meta-analyses of observational studies. Flow Diagrams • PRISMA Flow DiagramsMicrosoft Word templates for PRISMA flow diagrams • PRISMA Flow Diagram Generator https://estech.shinyapps.io/prisma_flowdiagram/
Ashok Pandey 23 For more information about systematic reviews please consult the following websites: The Cochrane Library https://www.cochrane.org/ The Joanna Briggs Institute https://jbi.global/ The Campbell Collaboration https://www.campbellcollaboration.org/ The Centre for Evidence-Based Medicine https://www.cebm.net/ The NHS Centre for Reviews and Dissemination https:// www.york.ac.uk/crd/
Ashok Pandey 24 Thank you