[[Please note that this is AI generated, and so may not be 100% accurate.]]
What is the REF?
The Research Excellence Framework (REF) is a quality assessment system used in the United Kingdom to evaluate research output and impact across various higher education institutions (HEIs). It’s a process of expert review that aims to assess research excellence, originality, and contribution to the field. The REF was introduced in 2014 as part of the UK government’s Higher Education Act 2004, with the goal of promoting quality research, assessing its impact on society and industry, and allocating public funds for HEIs’ research activities.
The framework is designed to assess two key areas: research quality and impact. Research quality involves evaluating research output, including publications, patents, and other forms of intellectual property, as well as teaching and knowledge exchange. Impact measures the extent to which research affects society, economy, or industry. These assessments inform funding allocation decisions based on the REF results, ensuring that public funds are allocated effectively.
The REF is structured into a four-year cycle, with each cycle focusing on a different aspect. The previous two cycles have been the Research Assessment Exercise (RAE) in 2014 and the Excellence in Research for England (ERF) in 2018. These cycles were designed to emphasize research quality and originality. In contrast, the upcoming REF 2029 cycle will feature significant changes, including a reduced weight on academic publications and an increased emphasis on research environment and culture.
The evaluation process involves several stages, starting with case submission, where institutions submit detailed proposals outlining their research projects. These submissions are then reviewed by expert assessors, who evaluate each case based on research quality, impact of research, inclusivity, diversity, and international collaborations, as well as teaching and knowledge exchange. The assessors also produce detailed reports for each case, which provide a comprehensive evaluation of the research output.
The final results are presented in REF ratings, such as 4*, 4, or 3*, based on the total score of all cases submitted. These ratings have significant implications for institutions, researchers, and policymakers, particularly with regards to funding allocation, research priorities, and career development opportunities.
The REF has a profound impact on various aspects of higher education institutions, including funding allocation, research priorities, and career development. Institutions with strong REF performances are more likely to secure funding, while those with weaker performances may struggle to access resources. The REF also shapes research agendas and priorities at an institutional level, ensuring that institutions focus on areas that align with societal needs.
One of the key differences between the REF and other evaluation frameworks is its scope and focus. While the Economic and Social Research Council (ESRC) focuses on social sciences and humanities, and the Natural Environment Research Council (NERC) concentrates on natural environment research, the REF covers a broader range of subjects across all disciplines. Additionally, the Agricultural and Horticultural Development Board (AHDB) evaluates research in agricultural and horticultural fields. Despite these differences, the REF remains an integral part of the UK’s research landscape, with far-reaching implications for institutions, researchers, and policymakers.
Why does the REF exist?
The Research Excellence Framework (REF) exists to serve multiple purposes, each of which is essential in promoting quality research and accountability in the UK higher education sector.
Accountability: One of the primary reasons for the REF is to provide a mechanism for holding universities accountable for their public investment in research. By evaluating research excellence and impact, the REF produces evidence that demonstrates the benefits of this investment. This accountability aspect ensures that taxpayers get value for money, as research outputs are linked to tangible outcomes.
Funding Allocation: The REF also plays a critical role in informing the selective allocation of research funding to institutions. By providing a comprehensive assessment of research quality and impact, the REF helps funders (e.g., government agencies) identify top-performing universities that can deliver high-quality research. This selective funding approach enables universities to prioritize their research activities and allocate resources more effectively.
Benchmarking: The REF provides benchmarking information for the higher education sector, establishing reputational yardsticks that allow universities to compare themselves with others. This comparison enables institutions to set targets for improvement, identify areas of strength, and focus on developing their research capabilities.
Performance Incentives: By creating performance incentives, the REF encourages HEIs and individual academics to strive for excellence in research output and impact. This drives competition among institutions to produce high-quality research that addresses national priorities and societal needs.
Strategic Decision-Making: The REF informs strategic decision-making about national research priorities by providing a comprehensive assessment of research quality and impact. This enables policymakers, funders, and university leaders to make informed decisions about investments in research infrastructure, talent acquisition, and research programs.
Resource Allocation: Finally, the REF provides HEIs with information to inform decisions on resource allocation. By evaluating research output and impact, institutions can identify areas that require additional investment or support, ensuring that resources are allocated effectively to drive innovation and progress.
What do academics do for the REF?
For the Research Excellence Framework (REF), academics play a vital role in contributing to the assessment process. One key activity is submitting their research outputs, such as journal papers, books, and other forms of publication, which are evaluated by expert assessors. Additionally, academics create impact case studies that demonstrate the real-world benefits of their research beyond academia. These case studies provide valuable evidence of the effect, change, or benefit that has occurred as a result of their work in areas such as the economy, society, culture, public policy, health, the environment, or quality of life.
Another important aspect of the REF is preparing environment statements, which describe the research environment and contribute to an institution’s overall performance. Academics also participate in data collection and revision of case studies to ensure that the information used in the assessment process is accurate and up-to-date. Furthermore, they engage with REF processes by attending training sessions, participating in discussions about the REF, and engaging with university-wide communications. This involvement helps academics stay informed about the latest developments and requirements of the REF, as well as their own institution’s performance within it.
By taking an active role in these activities, academics can ensure that their research is accurately represented and evaluated by the REF assessors. This not only benefits their institution but also contributes to a broader understanding of the impact and value of research across all disciplines and sectors. By engaging with the REF process, academics demonstrate their commitment to excellence in research and their contribution to the advancement of knowledge in their field.
It’s worth noting that these activities require significant time and effort from academics, and are often part of their normal work duties. However, by participating in the REF process, they can also gain valuable insights into their own research impact, collaborate with colleagues across departments and institutions, and contribute to the broader national conversation about research excellence.
What can be improved with the REF?
There are several areas where the Research Excellence Framework (REF) can be improved to make it a more effective and equitable assessment process.
One major concern is the lack of clarity and consistency in the REF rules, which can create uncertainty and additional work for institutions. Many academics find that the rules and criteria are often unclear or constantly changing, making it difficult for them to plan and prepare their research projects. This not only causes frustration but also leads to wasted time and resources as institutions struggle to keep up with the ever-changing requirements.
Another area for improvement is the potential burden that the REF can place on academics. The process of submitting research outputs, impact case studies, and environment statements can be overwhelming and stressful, particularly if institutions are facing limited resources or staff shortages. This can lead to concerns about authenticity and autonomy, as academics may feel pressure to present their work in a certain way rather than following their true interests and passions.
Furthermore, the REF’s ability to recognize and reward diverse research is still a concern. While the framework aims to promote excellence across all disciplines, many researchers have argued that it can be overly focused on certain areas of research, such as STEM fields. This can lead to a lack of recognition for innovative and interdisciplinary work that may not fit neatly into traditional disciplinary boundaries.
Interdisciplinary research is another area where the REF could improve its support. Many institutions are actively promoting interdisciplinary collaboration and knowledge exchange, but these efforts are often hampered by a lack of clear guidance or resources. More clarity on what constitutes successful interdisciplinary research and how it should be evaluated would help to promote this type of collaboration.
Some academics have also expressed concern that the REF’s focus on quantity over quality can lead to a culture of publishing for its own sake rather than for scientific merit. While publication is an important measure of academic achievement, it is not the only factor that should be considered when evaluating research excellence.
Additionally, there are concerns about the REF’s reliance on metrics, which can stifle creativity and innovation. By overemphasizing quantitative measures of research output, the REF may inadvertently discourage researchers from taking risks or pursuing innovative projects that may not yield immediate returns.
Finally, greater transparency is needed around the data and processes used in the REF evaluation process. Many academics feel that they have little understanding of how their research is being evaluated or why certain outcomes are being prioritized over others. More open communication and clear explanations about the REF’s methodology would help to build trust and confidence in the assessment process.
By addressing these areas, the REF can become a more effective and equitable assessment tool for promoting excellence in research across all disciplines and sectors.
What will change for REF2029?
For the REF 2029, there are several significant changes that will impact how institutions and researchers submit their cases and evaluate their performance.
Firstly, the weighting of outputs in the assessment will be reduced from 60% to 45%. This means that while publication productivity will still play a role, it will no longer dominate the evaluation process. Instead, an additional 5% will be allocated to a narrative statement about the broader contributions to the discipline, which highlights the impact and significance of the research beyond individual publications.
In addition to this shift in emphasis, the research environment, previously referred to as “people and culture,” will now carry more weight in the assessment, accounting for 25% of the overall score. This change reflects the growing recognition that a supportive and inclusive research culture is essential for producing high-quality research.
Another key change is the removal of the minimum publication standard requirement for impact case studies. Previously, institutions were expected to demonstrate impact through a minimum number of high-impact publications (2* quality). However, from REF 2029 onwards, this requirement will be dropped in favor of more nuanced evaluations that consider the quality and relevance of the research outputs.
The emphasis on outputs will shift to evaluate research culture, which encompasses various aspects of the research environment, including collaboration, innovation, and societal engagement. This change reflects the growing understanding that research is not just about individual achievements but also about contributing to a broader research community and society at large.
Lastly, the REF 2029 will see UK Research and Innovation (UKRI) take on a more prominent role as a de facto research regulator. While the REF remains the primary assessment process, UKRI’s involvement aims to strengthen its ability to provide guidance, support, and oversight for researchers and institutions throughout the REF cycle.
These changes aim to promote a more holistic evaluation of research excellence, one that balances individual achievements with broader societal and cultural considerations. By emphasizing research culture, diversity, and inclusivity, the REF 2029 seeks to create a more equitable and effective assessment process that recognizes the full range of contributions to academic excellence.
Leave a Reply