Research users impacted as evaluators

Individuals or their representatives directly impacted by the research activities can be involved as reviewers, as one specific category of stakeholders.
Level 0
Aim: Inclusivity
Aim: Bias mitigation
Aim: Recognition
Aim: Diversity
Aim: Alternative questions
CoARA Commitment 1
CoARA Commitment 2
CoARA Commitment 6
Target: Funder
Target: Scholarly association
Contributor

Experiments in Assessment WG

Publication date

April 9, 2026

Updated

April 20, 2026

WarningObjectives and potential outcome
  • Improve the value of research for users
  • Include targeted populations in the decision of resource attribution

Research domains

Context and considerations

Depending on the group represented, their role in the research assessment process and their requirements in terms of communication have to be carefully considered in the process design.

Challenges and mitigations

Challenge: Jargon from the proposal may limit contributions Mitigation: Ensure researchers know the composition of the panel and support them in making efficient communication (RI could be used as a case on this)

Challenge: Will evaluate impact, but possibly not the quality of the scientific method Mitigation: assign different elements of the assessment to different assessors so they feel confident in those elements (but this can create different levels of scoring needed)

Evaluating success

Relevant resources and literature

This section includes resources, literature, and reports relevant to this specific experimental idea.

Templates from funders and institutions

Case examples and literature

Pavee Point – an organisation that advocates for the Traveller and Roma communities in Ireland – has published a **guide for conducting inclusive and ethical research with Traveller and Roma individuals and communities

Other resources

Case Studies or Implementation Examples