Topic：S&T Indicators ‘In the Wild’: Contextualization and Participation for Responsible Metrics

　　Time：Dec. 25, （Tuesday）

　　Location：Main BLD 418

　　Introduction：The use of indicators in research policy and evaluation is widely perceived as problematic. Responding to demands of explicit normative framings in STI governance, I propose an agenda for transforming the place and role of indicators in policy. Given that expert advice should not separate knowledge formation from decision-making under conditions of uncertainty and lack of value consensus, I argue that current scientometrics is too focused on technical issues, too reductionist and isolated from the contexts and values of its use. Using Callon’s analytical framework of ‘secluded research’ vs. ‘research in the wild’ I propose three moves for improving design and use of STI indicators. First, to continue ongoing trends towards pluralizing the data sources, processing and visualizations techniques, and expand the research communities involved in scientometrics. Second, to develop forms of quantitative evidence that can be contextualized with the participation of a more diverse set of stakeholders. Third, to open up the policy framings implicit in measurement, and use quantitative analyses to reveal more balance perspectives of existing and alternative STI options. I conclude by arguing that these shifts are necessary to preserve epistemic diversity and pluralism in the face of ongoing managerial push for standardization via ‘platforms’ run by commercial oligopolies.

　　Speaker Profile: Dr. ISMAEL RÀFOLS, Professor of the University of Valenia, Spain, Tenure Researcher of the National Research Council of Spain, Visiting Professor of the Center for Science and Technology of Leiden University, Senior Research Fellow, Institute of Science and Technology Policy, University of Sussex. His research interests include science and technology policy, bibliometrics, and knowledge mapping. In the past five years, more than 20 SCI/SSCI papers have been published in journals such as Nature, Research Policy, Science and Public Policy, Research Evaluation, Journal of Informetrics, Journal of the American Society for Information Science and Technology, Technological Forecasting and Social Change. Received the Ziman Award from the European Association for Science and Technology Research, the Best Paper Nomination Award at the DRUID Conference, and the William Page Best Paper Award at the Atlanta Science and Innovation Policy Conference. He was invited as consultant to American National Foundation of Science and Engineering.