Abstract
Background Concerns about research waste have fueled debate about incentivizing individual researchers and research institutions to conduct responsible research. Instead of looking at impact factors or grants, research institutions should be assessed based on indicators that pertain to responsible research. In this study, we showed stakeholders a proof-of-principle dashboard with quantitative metrics that visualized responsible research performance on a German University Medical Center (UMC) level. Our research question was: What are stakeholders’ views on a dashboard that displays the adoption of responsible research practices on a UMC-level?
Methods We recruited different stakeholders to participate in an online interview. Stakeholders included UMC leadership, support staff, funders, and experts in responsible research. We asked interviewees to reflect on the strengths and weaknesses of this institutional dashboard approach and enquired their perceptions of the metrics it included. The interviews were recorded and transcribed. We applied content analysis to understand what stakeholders considered the Strengths, Weaknesses, Opportunities, and Threats of the dashboard and its metrics.
Results We interviewed 28 international stakeholders (60% German). Overall, interviewees thought the dashboard was helpful in seeing where an institution stands and appreciated the fact that the metrics were based on concrete behaviors. Main weaknesses included the lack of a narrative explaining the choice of the metrics covered. Interviewees considered the dashboard a good opportunity to initiate change and hoped the dashboard could be supplemented with other indicators in the future. They feared that making the dashboard public might risk incorrect interpretation of the metrics and put UMCs in a bad light.
Discussion While the feedback was given specifically to our proof-of-principle dashboard, our findings indicate that discussion with stakeholders is needed to develop an overarching framework governing responsible research on an institutional level, and to involve research-performing organizations.
Competing Interest Statement
The authors build part of the QUEST Center that developed the proof-of-principle dashboard and endorse the increased application of measures for robust and transparent science.
Funding Statement
This work was funded by the German Federal Ministry of Education and Research (BMBF 01PW18012). The funder had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The ethical review board of the Charite - Universitaetsmedizin Berlin reviewed and approved our research protocol and materials (#EA1/061/21).
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Funding statement: This work was funded by the German Federal Ministry of Education and Research (BMBF 01PW18012). The funder had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Conflicts of Interests: The authors build part of the QUEST Center that developed the dashboard and endorse the increased application of measures for robust and transparent science.
Data Availability
Interview transcripts are not publicly available as it would infringe upon participants' privacy.
