A recent white paper - The state of research assessment: Researcher perspectives on evaluation practices - drew on the voices of over 6,600 researchers globally, across all career stages and disciplines. One of the largest surveys of its kind, it provided a lens through which we can better understand the state of research evaluation and assessment, as well as the varied experiences, perceptions and wishes of researchers navigating this environment. 1,300 respondents were early career researchers (ECRs).
ECRs most frequently experienced research evaluation for grant applications, but their research is commonly evaluated for new jobs, career advancement and in internal institutional assessment processes.
As a group, ECRs are generally positive about their experiences of being evaluated over the last 5 years – mirroring the results of the wider survey. However, they do identify significant concerns and desires for future change.
Key Findings:
- A desire to move beyond narrow publication metrics: ECRs expressed concerns that their experiences of evaluation encouraged or incentivised quantity (of publications) over quality, and that this is based on publication metrics to the exclusion of rounded qualitative assessments. Only one in three of the responding ECRs reported evaluations that were approximately equally based on metrics and qualitative approaches.
-
Incorporate wider contributions and impact: ECRs want to see their wider contributions to research recognised, alongside consideration of the impact of their work for society, the economy and organisations.
Many types of research outputs used by ECRs are not included in evaluations.
- Transparency and fairness: The third area of high priority for ECRs, for whom evaluations come at a critical and defining stage in their development. ECRs whose research is evaluated through both metrics and qualitative inputs respond more positively about fairness and whether evaluation represents a good use of their time.
Overall, ECRs are positive about the ways that they are currently evaluated. However, there are some notable concerns, alongside a desire to move towards a system which places greater weight on positive contributions to society, the wider research community, and research culture.
To explore the findings in depth, read the white paper, The state of research assessment: Researcher perspectives on evaluation practices.