Evaluating Research in Context
Pilot studies
ERiC carried out a number of pilot studies in 2008. During these criteria and indicators were developed that will make it possible to evaluate both the social impact and scientific quality of research, i.e., research across its full breadth. Following the completion of each pilot study a trial evaluation of the research took place.
Trial evaluation
The trial evaluation consists of four stages. These are:
- Rewriting the research group's mission in an assessable (SMART) manner. SMART stands for Specific, Measurable, Agreed upon, Realistic, Time-based.
- Collecting data for the purpose of the indicators. The data are qualitative or quantitative, for example attractive descriptions of research results. A profile of the group can be compiled based on these data.
- Relevant stakeholders are interviewed, or are sent a questionnaire by e-mail, about the relevance and quality of the research. During this stakeholder research every effort is made to ensure that the results reflect the diversity of the relevant parties.
- In this final stage, the results from the first three stages are drawn together in a report. This report can be used to reflect upon the extent to which the intended quality and relevance have been realised.