OOIR: Observatory of International Research

Papers

(The median citation count of Research Evaluation is 1. The table below lists those papers that are above that threshold based on CrossRef citation counts [max. 250 papers]. The publications cover those that have been published in the past four years, i.e., from 2020-03-01 to 2024-03-01.)

Article	Citations
Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)	48
No time for that now! Qualitative changes in manuscript peer review during the Covid-19 pandemic	37
What effects does international mobility have on scientists’ careers? A systematic review	32
The production of scientific and societal value in research evaluation: a review of societal impact assessment methods	32
Changing research on research evaluation: A critical literature review to revisit the agenda	30
What are the social and scientific benefits of participating at academic conferences? Insights from a survey among doctoral students and postdocs in Germany	26
Transforming science and society? Methodological lessons from and for transformation research	25
On the relationship between interdisciplinarity and impact: Distinct effects on academic and broader impact	23
Funding acknowledgements in scientific publications: A literature review	17
The role of metrics in peer assessments	16
Profile of authors publishing in ‘predatory’ journals and causal factors behind their decision: A systematic review	15
Does government support of a few leading universities have a broader impact on the higher education system? Evaluation of the Russian University Excellence Initiative	14
The effect of competitive public funding on scientific output: A comparison between China and the EU	14
Millennial researchers in a metric-driven scholarly world: An international study	13
A formative approach to the evaluation of Transformative Innovation Policies	13
Capabilities for transdisciplinary research	13
Assessing research excellence: Evaluating the Research Excellence Framework	13
Fast growth of the number of proceedings papers in atypical fields in the Czech Republic is a likely consequence of the national performance-based research funding system	12
How far does an emphasis on stakeholder engagement and co-production in research present a threat to academic identity and autonomy? A prospective study across five European countries	11
An exploration of referees’ comments published in open peer review journals: The characteristics of review language and the association between review scrutiny and citations	11
Does reviewing experience reduce disagreement in proposals evaluation? Insights from Marie Skłodowska-Curie and COST Actions	11
Beyond bean counting: Is the policy effective for the innovation efficiency of wind power industry in China?	10
Understanding and evaluating the impact of integrated problem-oriented research programmes: Concepts and considerations	10
Spreading the gospel: Legitimating university rankings as boundary work	9
Determinants of quality of research environment: An assessment of the environment submissions in the UK’s Research Excellence Framework in 2014	9

Say my name, say my name: Academic authorship conventions between editorial policies and disciplinary practices	8
DARE to be different? A novel approach for analysing diversity in collaborative research projects	8
Creating evaluative homogeneity: Experience of constructing a national journal ranking	8
The classification of public research organizations: Taxonomical explorations	7
How to evaluateex anteimpact of funding proposals? An analysis of reviewers’ comments on impact statements	7
Science rules! A qualitative study of scientists’ approaches to grant lottery	7
Biographical representation, from narrative to list: The evolution of curricula vitae in the humanities, 1950 to 2010	7
The footprint of a metrics-based research evaluation system on Spain’s philosophical scholarship: An analysis of researchers’ perceptions	7
Measuring societal impact of research—Developing and validating an impact instrument for occupational health and safety	7
Do peers share the same criteria for assessing grant applications?	7
Peer review in funding-by-lottery: A systematic overview and expansion	7
The use of an impact framework to evaluate the impact of research on policy and practice: Screening questionnaires for intellectual disability	6
Open Editors: A dataset of scholarly journals’ editorial board positions	5
SSH researchers make an impact differently. Looking at public research from the perspective of users	5
Interdisciplinary knowledge combinations and emerging technological topics: Implications for reducing uncertainties in research evaluation	5
Estimating the effects of public subsidies on the performance of supported enterprises across firm sizes	5
Pathways for assessing interdisciplinarity: A systematic review	5
Societal targeting in researcher funding: An exploratory approach	5
Transformative academic institutions: An experimental framework for understanding regional impacts of research	4
Interdisciplinary research and policy impacts: Assessing the significance of knowledge coproduction	4
Affective auditing: The emotional weight of the research excellence framework	4
Understanding collaborative interactions in relation to research impact in social sciences and humanities: A meta-ethnography	4
Mirror, mirror on the wall: is economics the fairest of them all? An investigation into the social sciences and humanities in Vietnam	4
A register of public-sector research organizations as a tool for research policy studies and evaluation	3
The different responses of universities to introduction of performance-based research funding	3
Evidence of research mastery: How applicants argue the feasibility of their research projects	3
Does R&D tax credit impact firm behaviour? Micro evidence for Portugal	3
Enriching research quality: A proposition for stakeholder heterogeneity	3
Devices of evaluation: Institutionalization and impact—Introduction to the special issue	3
Valorization of transdisciplinary research: An evaluation approach and empirical illustration	3
Evaluating socially engaged climate research: Scientists’ visions of a climate resilient U.S. Southwest	3
Explaining employment sector choices of doctoral graduates in Germany	3
Making the cut: How panel reviewers use evaluation devices to select applications at the European Research Council	3
Systematizing societal effects of transdisciplinary research	3
Quantifying the contributions technicians make to research	3
Gender diversity and publication activity—an analysis of STEM in the UK	3
Expression of concern: Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)	3
Assessment practices of community-engaged institutions in the USA: Common claims and uncertain methods	2
Documenting development of interdisciplinary collaboration among researchers by visualizing connections	2
University policy engagement bodies in the UK and the variable meanings of and approaches to impact	2
Toward a modular evaluation approach of real-world laboratories: Findings from a literature review	2
An openness framework for ex ante evaluation of societal impact of research	2
Heterogeneous impacts of research grant funding	2
Valuation regimes in academia: Researchers’ attitudes towards their diversity of activities and academic performance	2
What makes databases tick: Logics that underpin national databases for research output in Europe	2
The effect of facilitating interdisciplinary cooperation on the research productivity of university research teams: The moderating role of government assistance	2
How to select the best: Selection procedures of innovation agencies	2
The impact of Italian performance-based research funding systems on the intensity of international research collaboration	2
Proposed methodology for measuring the effectiveness of policies designed to further research	2
Mergers and acquisitions in the public research sector. Toward a comprehensive typology	2

Competitive exposure and existential recognition: Visibility and legitimacy on academic social networking sites	2
Evaluation of rice research: An alternate method to capture outcomes	2
Researcher experiences in practice-based interdisciplinary research	2
A superb example of policy evaluation	2
Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities	2
Evaluation of the arts in performance-based research funding systems: An international perspective	2
Transdisciplinary research outcomes based on the Transdisciplinary Research on Energetics and Cancer II initiative experience	2
Research impact as understood by two funders of agricultural research in South Africa	2
Looking for evidence of research impact and use: A qualitative study of an Australian research-policy system	2
The forms of societal interaction in the social sciences, humanities and arts: Below the tip of the iceberg	1
Teachers conceptualizing and developing assessment for skill development: Trialing a maker assessment framework	1
From intent to impact—The decline of broader impacts throughout an NSF project life cycle	1
The funding and research trends in library and information science of NSSFC: Comparison of awards and papers	1
Research and the real world: Analyzing the short- and long-term impact of knowledge transfer	1
Research governance and the dynamics of science: A framework for the study of governance effects on research fields	1
When publication metrics become the fetish: The research evaluation systems’ relationship with academic work engagement and burnout	1
Promoting narrative CVs to improve research evaluation? A review of opinion pieces and experiments	1
The Corona-Eye: Exploring the risks of COVID-19 on fair assessments of impact for REF2021	1
The effect of applied research institutes on invention: Evidence from the Fraunhofer centres in Europe	1
The program and policy change framework: A new tool to measure research use in low- and middle-income countries	1
Exploring European-funded project-based networks in ICT and their links with regional total factor productivity: The FP7 and the CIP	1
Automated citation recommendation tools encourage questionable citations	1
ASIRPAReal-Time in the making or how to empower researchers to steer research towards desired societal goals	1
Using the catastrophe theory to discover transformative research topics	1
A Research Pathway Model for evaluating the implementation of practice-based research: The case of self-management health innovations	1
Changing conceptualization of innovation in the European Union and its impact on universities: Critical junctures and evolving institutional demands	1
Being a female academic under neoliberal evaluation: A systematic review	1
The epistemic, production, and accountability prospects of social impact: An analysis of strategic research proposals	1
The missing links of research impact	1
Research calls, competition for funding and inefficiency	1
Globalization of scientific communication: Evidence from authors in academic journals by country of origin	1
Fraud, specialization, and efficiency in peer review	1
Using theory to understand how policy change happens: Insights from agricultural research for development	1
Pathway profiles: Learning from five main approaches to assessing interdisciplinarity	1
The systemic approach as an instrument to evaluate higher education systems: Opportunities and challenges	1
Evaluating the Revised National Institutes of Health clinical trial definition impact on recruitment progress	1
Predicting funded research project performance based on machine learning	1
Boundary-work and social closure in academic recruitment: Insights from the transdisciplinary subject area Swedish as a Second Language	1
A participatory approach to tracking system transformation in clusters and innovation ecosystems—Evolving practice in Sweden’s Vinnväxt programme	1
Correction to: Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)	1
Under pressure: The extent and distribution of perceived pressure among scientists in Germany, Austria, and Switzerland	1
Theory of systems change: An initial, middle-range theory of public health research impact	1
Key factors affecting the promotion of researchers of the Argentine Scientific and Technical Research Council (CONICET)	1
Lessons from mixed-method evaluations—An example from labor market research	1
The conflict of impact for early career researchers planning for a future in the academy	1
‘I want to be able to do what I know the tools will allow us to do’: Practicing evaluative bibliometrics through digital infrastructure	1
S&T resource allocation considering both performance and potential: The case of Chinese research institutes	1
Assessing the variety of collaborative practices in translational research: An analysis of scientists’ ego-networks	1