[Skip to Content]

 

Reviewer Guide

 

General Guidelines

  • It is important we review in a uniform way - follow the scoring criteria in the platform.

  • Use your good judgment - the forum should be thought-provoking, collaborative, and fun.

  • Reach out to your track lead for support.

  • Make progress each week on your reviews. DO NOT wait until the last week.

  • Take notes on the platform as to why you scored the way you did. This helps you and your group.

 

Email your track lead...

  • If the abstract you review is not in the right category (ie, there is a lightning talk in the pre-formed panels category).

    • For example, interactivity goes in workshops, not panels; demos go in demos, not panels. Please refer to session descriptions.

  • If you realize you must recuse yourself, but have missed the recusal period.

  • Rare: If you feel unqualified to review an abstract.

 

Accepting Posters, Interactive Workshops, and Solution Demos

In order to increase conference participation we hope to accept ALL:

  • posters, 

  • interactive workshops, and 

  • solution demos 

unless they are deemed off-topic during the review, space permitting. The agenda committee and track leads will advise on acceptance numbers and the cut off points if possible. Please proceed as normal, reviewing against the criteria.

 

Important Changes

The following changes can be made on the recommendation of reviewers:

  • Pre-formed panels can be moved to where appropriate:

    • Solution demos: the abstract primarily revolves around demonstrating a particular technology or pitching a technology or service

    • Interactive workshop: if the format includes significant interactivity with the audience

    • Please score as usual, flag in your notes to inform your track lead.

  • Individual presentations can be moved to lightning talks or poster sessions

    • Poster sessions: if they are a good topic but not substantive enough for a presentation (ie, submission is a good idea or interesting evidence but has not indicating in any way how they will present the information).

    • Lightning talk: Abstract is appropriate for a storytelling format (TED-style talk)

    • Please score as usual, flag in your notes to inform your track lead.

  • Pre-formed panels, per the description, are 3 separate presentations on 1 topic. This year, the descriptions of the sessions were hard to find. As such, we should not penalize those that did not precisely follow this format (ie, it may just be a panel discussion rather than three presentations). If it scores well it can be accepted, despite not fitting the description of 3 presentations.

 

DEI Criteria

When scoring DEI, please consider questions like…

  • Does it consider or promote diversity, equity and inclusion in the field of digital health or promote equitable global health outcomes? 

  • Does it reach or include vulnerable or marginalized populations, beyond just ‘poor’? 

  • For example, does it: 

  • promote diversity in building capacity of the digital health workforce? 

  • address inclusion in the access and use of digital tools (through skills, language, accessibility features, connectivity, etc)?  

  • Contribute to equitable and people-centered health outcomes?

  • Do panelists represent a range of cultures, organizations and ways of thinking?

 

Session Descriptions

 Session types are as follows:

  • Solution Demonstration - This Abstract type will be for IN-PERSON presenters only. The solution demonstrations will showcase software and hardware innovations. Presenters can also share digital assets, like fact sheets, brochures or other online materials to provide additional information about their solution. Only one presenter name is allowed with abstract submissions of this type.

  • Individual Presentation - This Abstract type will be for IN-PERSON presenters only. Individual Presentations are 15-20 minute presentations accompanied by Q&A with session participants. Forum organizers will work to group individual presentations with other related submissions by thematic, geographic or technical area. Only one presenter name is allowed with Individual Presentation abstract submissions.

  • Interactive Workshop -This Abstract type will be for both virtual and in-person presenters. Interactive workshops will be 60 minutes and must be planned to engage participants in hands-on learning. The Interactive workshops will aim to highlight an important digital health topic combined with an activity to further participant understanding of the topic. Up to three presenter names are allowed with this type of abstract submission.  

  • Pre-Formed Panel Presentation - This Abstract type will be for both virtual and in-person presenters.  Pre-formed panels should include 3 presentations on the same topic, and the panel should last no longer than 60 minutes, including time for Q&A.All pre-formed panels must also identify a moderator for the session. Each presentation can have one presenter and each session will have one moderator, for a maximum of four presenters and one moderator.  Pre-formed groups with interactive content should apply as an interactive workshop, not a pre-formed panel.

  • Poster Presentation - This Abstract type will be for IN-PERSON presenters only. Posters will demonstrate successes or failures of digital health solutions.  

  • Lightning Talk - This Abstract type will be for both virtual and in-person presenters. These quick 5-7 minute presentations given in a story-telling format, can highlight ideas, initiatives or results that engage participants. For the virtual conference these will be pre-recorded and played back; for in-venue abstracts the talk will be presented in person. Only one presenter name is allowed with abstract submissions for a Lightning talk. 

 

Evaluation Criteria

1. Evaluation of the topic: Is the topic relevant, within scope of the Forum, and well-defined? (60 percent weighting)

  • From “Topic”:

    • Is the topic clearly articulated in the response?

    • Does the submission describe how the topic improves health outcomes?

    • Is the topic relevant to current priorities in the digital health landscape?

    • For the non-required questions evaluated above, submissions must show at least one of the following: 

      • Evidence: If evidence is provided is it appropriate given the maturity of the topic proposed? 

      • Innovation: If the proposed topic is innovative or new to the field, does the topic address a priority challenge within the field and demonstrate a clear use case for how it can be adopted and scaled?

      • Principles and standards: Does the topic apply, align or advance relevant global principles and standards? 

      • Advancing the field: Does the topic build on previous initiatives and or investments within global digital health? 

2. Evaluation of DEI criteria: Does the way that they talk about the topic and deliver it align with our DEI principles? (40 percent)

  • For all session types, the “Topic” will be evaluated on:

    • How well the topic or intervention considers or promotes diversity, equity and inclusion in the field of digital health or promotes equitable global health outcomes

    • How well the topic or intervention reaches or includes vulnerable or marginalized populations

    • For example, reviewers should look for sessions that:

      • promote diversity in building capacity of the digital health workforce;

      • address inclusion in the access and use of digital tools (through skills, language, accessibility features, connectivity, etc); 

      • Contribute to equitable and people-centered health outcomes

 

Session specific criteria

  • Preformed panels

    • Coherent theme around an important or emerging topic

    • Panelists and moderator will encourage lively discussion amongst themselves and the audience

    • We encourage pre-formed panels that reflect a diversity in thought and representation. We also encourage topics that promote equity and inclusion. 

    • (For preformed panels and interactive workshops) Does the session description describe how the session will be facilitated in a way that engages the audience? Does the session appropriately propose an approach that is interactive?

  • Individual panels

    • Contribution to the evidence and learning base for digital health

    • Importance to digital health landscape

    • Alignment with global goods and standards

    • Topics that consider or promote diversity, equity and inclusion in digital health and global health outcomes will be rated highly.

  • Lightning talks

    • Provocative storytelling 

  • Poster

    • Present evidence for research done on a topic 

  • Solution demonstration

    • The solution demonstrations will showcase software and hardware innovations through and accompanying descriptions during the Forum.

  • Interactive workshop

    • Engage participants in hands-on learning.