OOIR: Observatory of International Research

Papers

(The median citation count of Research Evaluation is 2. The table below lists those papers that are above that threshold based on CrossRef citation counts [max. 250 papers]. The publications cover those that have been published in the past four years, i.e., from 2020-11-01 to 2024-11-01.)

Article	Citations
Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)	73
The production of scientific and societal value in research evaluation: a review of societal impact assessment methods	45
No time for that now! Qualitative changes in manuscript peer review during the Covid-19 pandemic	39
Transforming science and society? Methodological lessons from and for transformation research	31
On the relationship between interdisciplinarity and impact: Distinct effects on academic and broader impact	30
The role of metrics in peer assessments	23
Profile of authors publishing in ‘predatory’ journals and causal factors behind their decision: A systematic review	21
Does government support of a few leading universities have a broader impact on the higher education system? Evaluation of the Russian University Excellence Initiative	18
A formative approach to the evaluation of Transformative Innovation Policies	17
Assessing research excellence: Evaluating the Research Excellence Framework	15
Pathways for assessing interdisciplinarity: A systematic review	15
Capabilities for transdisciplinary research	14
Does reviewing experience reduce disagreement in proposals evaluation? Insights from Marie Skłodowska-Curie and COST Actions	13
Spreading the gospel: Legitimating university rankings as boundary work	12
Beyond bean counting: Is the policy effective for the innovation efficiency of wind power industry in China?	12
How far does an emphasis on stakeholder engagement and co-production in research present a threat to academic identity and autonomy? A prospective study across five European countries	12
Peer review in funding-by-lottery: A systematic overview and expansion	11
An exploration of referees’ comments published in open peer review journals: The characteristics of review language and the association between review scrutiny and citations	11
Science rules! A qualitative study of scientists’ approaches to grant lottery	11
Open Editors: A dataset of scholarly journals’ editorial board positions	10
The footprint of a metrics-based research evaluation system on Spain’s philosophical scholarship: An analysis of researchers’ perceptions	10
Biographical representation, from narrative to list: The evolution of curricula vitae in the humanities, 1950 to 2010	10
Say my name, say my name: Academic authorship conventions between editorial policies and disciplinary practices	10
Creating evaluative homogeneity: Experience of constructing a national journal ranking	9
Toward a modular evaluation approach of real-world laboratories: Findings from a literature review	8

Societal targeting in researcher funding: An exploratory approach	8
Affective auditing: The emotional weight of the research excellence framework	8
Systematizing societal effects of transdisciplinary research	7
Do peers share the same criteria for assessing grant applications?	7
Interdisciplinary knowledge combinations and emerging technological topics: Implications for reducing uncertainties in research evaluation	7
Valuation regimes in academia: Researchers’ attitudes towards their diversity of activities and academic performance	7
Measuring societal impact of research—Developing and validating an impact instrument for occupational health and safety	7
Estimating the effects of public subsidies on the performance of supported enterprises across firm sizes	7
Understanding collaborative interactions in relation to research impact in social sciences and humanities: A meta-ethnography	6
Valorization of transdisciplinary research: An evaluation approach and empirical illustration	6
Making the cut: How panel reviewers use evaluation devices to select applications at the European Research Council	6
SSH researchers make an impact differently. Looking at public research from the perspective of users	6
Competitive exposure and existential recognition: Visibility and legitimacy on academic social networking sites	5
Enriching research quality: A proposition for stakeholder heterogeneity	5
Evaluating socially engaged climate research: Scientists’ visions of a climate resilient U.S. Southwest	5
Mirror, mirror on the wall: is economics the fairest of them all? An investigation into the social sciences and humanities in Vietnam	5
Interdisciplinary research and policy impacts: Assessing the significance of knowledge coproduction	5
Gender diversity and publication activity—an analysis of STEM in the UK	5
The different responses of universities to introduction of performance-based research funding	4
Effects of transdisciplinary research on scientific knowledge and reflexivity	4
Transformative academic institutions: An experimental framework for understanding regional impacts of research	4
Expression of concern: Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)	4
Promoting narrative CVs to improve research evaluation? A review of opinion pieces and experiments	4
Automated citation recommendation tools encourage questionable citations	4
Researcher experiences in practice-based interdisciplinary research	3
Theory of systems change: An initial, middle-range theory of public health research impact	3
The impact of researchers’ perceived pressure on their publication strategies	3
Does R&D tax credit impact firm behaviour? Micro evidence for Portugal	3
Globalization of scientific communication: Evidence from authors in academic journals by country of origin	3
Devices of evaluation: Institutionalization and impact—Introduction to the special issue	3
Quantifying the contributions technicians make to research	3
Research calls, competition for funding and inefficiency	3
Evidence of research mastery: How applicants argue the feasibility of their research projects	3
Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities	3
University policy engagement bodies in the UK and the variable meanings of and approaches to impact	3
Early career academic's odyssey: A narrative study of her professional identity construction	3
Looking for evidence of research impact and use: A qualitative study of an Australian research-policy system	3
When publication metrics become the fetish: The research evaluation systems’ relationship with academic work engagement and burnout	3
The effect of facilitating interdisciplinary cooperation on the research productivity of university research teams: The moderating role of government assistance	3
Explaining employment sector choices of doctoral graduates in Germany	3
Research impact as understood by two funders of agricultural research in South Africa	2
What makes databases tick: Logics that underpin national databases for research output in Europe	2
Improving universities’ activities in academic startup support through public interventions: The effectiveness of the German programme ‘EXIST—leverage of potentials’	2
Evaluating the Revised National Institutes of Health clinical trial definition impact on recruitment progress	2
Quis judicabit ipsos judices? A case study on the dynamics of competitive funding panel evaluations	2
ASIRPAReal-Time in the making or how to empower researchers to steer research towards desired societal goals	2
Using the catastrophe theory to discover transformative research topics	2
The legal foundation of responsible research assessment: An overview on European Union and Italy	2
A Research Pathway Model for evaluating the implementation of practice-based research: The case of self-management health innovations	2
Research governance and the dynamics of science: A framework for the study of governance effects on research fields	2

Research impact seen from the user side	2
Under pressure: The extent and distribution of perceived pressure among scientists in Germany, Austria, and Switzerland	2
Devices of future excellence: Detaching excellence recognition from ‘eminent men’	2
Documenting development of interdisciplinary collaboration among researchers by visualizing connections	2
A participatory approach to tracking system transformation in clusters and innovation ecosystems—Evolving practice in Sweden’s Vinnväxt programme	2
The forced battle between peer-review and scientometric research assessment: Why the CoARA initiative is unsound	2
From intent to impact—The decline of broader impacts throughout an NSF project life cycle	2
Practicing responsible research assessment: Qualitative study of faculty hiring, promotion, and tenure assessments in the United States	2
The impact of Italian performance-based research funding systems on the intensity of international research collaboration	2
The epistemic, production, and accountability prospects of social impact: An analysis of strategic research proposals	2
Evaluation of rice research: An alternate method to capture outcomes	2
Assessing the variety of collaborative practices in translational research: An analysis of scientists’ ego-networks	2
Prestige of scholarly book publishers—An investigation into criteria, processes, and practices across countries	2
Methods for measuring social and conceptual dimensions of convergence science	2
The systemic approach as an instrument to evaluate higher education systems: Opportunities and challenges	2
Transdisciplinary research outcomes based on the Transdisciplinary Research on Energetics and Cancer II initiative experience	2
The Corona-Eye: Exploring the risks of COVID-19 on fair assessments of impact for REF2021	2
Boundary-work and social closure in academic recruitment: Insights from the transdisciplinary subject area Swedish as a Second Language	2
Evaluation of the arts in performance-based research funding systems: An international perspective	2