Including non-academics in evaluation

Including non-academics in evaluation broadens perspectives by integrating stakeholders from industry, policy, and society. It enhances relevance, transparency, and societal impact, mitigates disciplinary bias, and supports responsible research assessment aligned with real-world needs and principles of openness, inclusiveness, and accountability.
Level 0
Aim: Value process
Aim: Inclusivity
Aim: Alternative questions
CoARA Commitment 1
CoARA Commitment 2
Target: Funder
Target: Meta-researcher
Contributor

Experiments in Assessment WG

Publication date

April 9, 2026

Updated

April 20, 2026

WarningObjectives and potential outcome

Research domains

This is especially relevant for funding evaluation, especially when assessing impacts, but it could also be relevant in a variety of domains and settings.

Context and considerations

This idea is connected with the following ideas where further details can be found: - Community impact evaluation - Multidimensional “diversity” in evaluation committees - Non-expert panels - Research users impacted as evaluators

Challenges and mitigations

Evaluating success

Relevant resources and literature

This section includes resources, literature, and reports relevant to this specific experimental idea.

Templates from funders and institutions

Case examples and literature

Several funders involve members of the public in their review panels, see for example NIHR and Health Research Board Ireland.

Luo, J., Ma, L., Shankar, K. (2021). **Does the inclusion of non-academic reviewers make any difference for grant impact panels?. Science and Public Policy, 48(6), pp. 763–775.

Junwen Luo (2021, 25 August), What role should non-academics have in evaluating the potential impact of new research projects? LSE Impact Blog .

Baxter S, Clowes M, Muir D, Baird W, Broadway-Parkinson A, Bennett C. (2016). Supporting public involvement in interview and other panels: a systematic review. Health Expect, 20(5). p. 807-817.

A blog post that describes the experience as a public member of a research funding panel: Adam Forristal Golberg (2025, 25 February), A peek inside a research funding panel. Cash for Questions: Research funding, policy and development.

Other resources

Case Studies or Implementation Examples