Wind power research in Wikipedia.: Does Wikipedia demonstrate direct influence of research publications and can it be used as adequate source in research evaluation?

Antonio Eleazar Serrano-López; Peter Ingwersen; Elias Sanz-Casado

doi:DOI 10.1007/s11192-017-2447-2

Wind power research in Wikipedia. Does Wikipedia demonstrate direct influence of research publications and can it be used as adequate source in research evaluation?

Antonio Eleazar Serrano-López, Peter Ingwersen, Elias Sanz-Casado

Institut for Kommunikation

12 Citationer (Scopus)

45 Downloads (Pure)

Abstract

This paper is a result of the WOW project (Wind power On Wikipedia) which forms part of the SAPIENS (Scientometric Analyses of the Productivity and Impact of Eco-economy of Spain) project (Sanz-Casado et al. in Scientometrics 95(1):197–224, 2013). WOW is designed to observe the relationship between scholarly publications and societal impact or visibility through the mentions of scholarly papers (journal articles, books and conference proceedings papers) in the Wikipedia, English version. We determine (1) the share of scientific papers from a specific set defined by Wind Power research in Web of Science (WoS) 2006–2015 that are included in Wikipedia entries, named data set A; (2) the distribution of scientific papers in Wikipedia entries on Wind Power, named data set B, captured via the three categories for the topic Wind Power in the Wikipedia Portal: Wind Power, Wind turbines and Wind farms; (3) the distributions of document types in the two wiki entry data sets’ reference lists. In parallel the paper aims at designing and test indicators that measure societal impact and R&D properties of the Wikipedia, such as, a wiki reference focus measure; and a density measure of those types in wiki entries. The study is based on Web mining techniques and a developed software that extracts a range of different types of Wikipedia references from the data sets A and B. Findings show that in data set A 25.4% of the wiki references are academic, with a density of 17.62 academic records detected per wiki entry. However, only 0.62% of the original WoS records on Wind Power are also found as wiki references, implying that the direct societal impact through the Wikipedia is extremely small for Wind Power research. In the second Wikipedia set on Wind Power (data set B), the presence of scientific papers is even more insignificant (10.6%; density: 3.08; WoS paper percentage: 0.26%). Notwithstanding, the Wikipedia can be used as a tool informing about the transfer from scholarly publications to popular and non-peer reviewed publications, such as Web pages (news, blogs), popular magazines (science/technology) and research reports. Non-scholarly wiki reference types stand for 74.6% of the wiki references (data set A) and almost 90% in data set B. Interestingly, the few WoS articles in wiki entries on Wind Power present on average 34.3 citations received during the same period (2006–2015) as WoS Wind Power publications not mentioned in wiki entries only receives on average 5.9 citations. Owing to the scarcity of Wind Power research papers in the Wikipedia, it cannot be applied as a direct source in evaluation of Wind Power research. This is in line with other recent studies regarding other subject areas. However, our analysis presents and discusses six supplementary indirect indicators for research evaluation, based on publication types found in the wiki entry reference lists: share of (WoS) records; density; and reference focus, plus popular science knowledge export, non-scholarly knowledge export and academic knowledge export. The same indicators are direct measures of the Wikipedia reference properties.

Originalsprog	Engelsk
Tidsskrift	Scientometrics
Vol/bind	2017
Udgave nummer	112
Sider (fra-til)	1471-1488
Antal sider	18
ISSN	0138-9130
DOI	https://doi.org/DOI 10.1007/s11192-017-2447-2
Status	Udgivet - 1 sep. 2017

Emneord

Det Humanistiske Fakultet
Wikipedia
Web of Science
Forskningsevaluering
Vindenergi

Adgang til dokumentet

DOI 10.1007/s11192-017-2447-2

Submitted Wikipedia_paper-version 7 - finalAccepteret manuskript, 1,32 MB

Citationsformater

Wind power research in Wikipedia. Does Wikipedia demonstrate direct influence of research publications and can it be used as adequate source in research evaluation? / Serrano-López, Antonio Eleazar; Ingwersen, Peter; Sanz-Casado, Elias.

I: Scientometrics, Bind 2017, Nr. 112, 01.09.2017, s. 1471-1488.

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › peer review

@article{d6b200d852f84f9aa31d54d85d9f9328,

title = "Wind power research in Wikipedia.: Does Wikipedia demonstrate direct influence of research publications and can it be used as adequate source in research evaluation?",

abstract = "This paper is a result of the WOW project (Wind power On Wikipedia) which forms part of the SAPIENS (Scientometric Analyses of the Productivity and Impact of Eco-economy of Spain) project (Sanz-Casado et al. in Scientometrics 95(1):197–224, 2013). WOW is designed to observe the relationship between scholarly publications and societal impact or visibility through the mentions of scholarly papers (journal articles, books and conference proceedings papers) in the Wikipedia, English version. We determine (1) the share of scientific papers from a specific set defined by Wind Power research in Web of Science (WoS) 2006–2015 that are included in Wikipedia entries, named data set A; (2) the distribution of scientific papers in Wikipedia entries on Wind Power, named data set B, captured via the three categories for the topic Wind Power in the Wikipedia Portal: Wind Power, Wind turbines and Wind farms; (3) the distributions of document types in the two wiki entry data sets{\textquoteright} reference lists. In parallel the paper aims at designing and test indicators that measure societal impact and R&D properties of the Wikipedia, such as, a wiki reference focus measure; and a density measure of those types in wiki entries. The study is based on Web mining techniques and a developed software that extracts a range of different types of Wikipedia references from the data sets A and B. Findings show that in data set A 25.4% of the wiki references are academic, with a density of 17.62 academic records detected per wiki entry. However, only 0.62% of the original WoS records on Wind Power are also found as wiki references, implying that the direct societal impact through the Wikipedia is extremely small for Wind Power research. In the second Wikipedia set on Wind Power (data set B), the presence of scientific papers is even more insignificant (10.6%; density: 3.08; WoS paper percentage: 0.26%). Notwithstanding, the Wikipedia can be used as a tool informing about the transfer from scholarly publications to popular and non-peer reviewed publications, such as Web pages (news, blogs), popular magazines (science/technology) and research reports. Non-scholarly wiki reference types stand for 74.6% of the wiki references (data set A) and almost 90% in data set B. Interestingly, the few WoS articles in wiki entries on Wind Power present on average 34.3 citations received during the same period (2006–2015) as WoS Wind Power publications not mentioned in wiki entries only receives on average 5.9 citations. Owing to the scarcity of Wind Power research papers in the Wikipedia, it cannot be applied as a direct source in evaluation of Wind Power research. This is in line with other recent studies regarding other subject areas. However, our analysis presents and discusses six supplementary indirect indicators for research evaluation, based on publication types found in the wiki entry reference lists: share of (WoS) records; density; and reference focus, plus popular science knowledge export, non-scholarly knowledge export and academic knowledge export. The same indicators are direct measures of the Wikipedia reference properties.",

keywords = "Faculty of Humanities, Wikipedia, Web of Science, Forskningsevaluering, Vindenergi, Research Evaluation, Wikipedia, Web of Science, Wind power, Scientometrics, Indicators",

author = "Serrano-L{\'o}pez, {Antonio Eleazar} and Peter Ingwersen and Elias Sanz-Casado",

year = "2017",

month = sep,

day = "1",

doi = "DOI 10.1007/s11192-017-2447-2",

language = "English",

volume = "2017",

pages = "1471--1488",

journal = "Scientometrics",

issn = "0138-9130",

publisher = "Akad{\'e}miai Kiad{\'o}",

number = "112",

}

TY - JOUR

T1 - Wind power research in Wikipedia.

T2 - Does Wikipedia demonstrate direct influence of research publications and can it be used as adequate source in research evaluation?

AU - Serrano-López, Antonio Eleazar

AU - Ingwersen, Peter

AU - Sanz-Casado, Elias

PY - 2017/9/1

Y1 - 2017/9/1

N2 - This paper is a result of the WOW project (Wind power On Wikipedia) which forms part of the SAPIENS (Scientometric Analyses of the Productivity and Impact of Eco-economy of Spain) project (Sanz-Casado et al. in Scientometrics 95(1):197–224, 2013). WOW is designed to observe the relationship between scholarly publications and societal impact or visibility through the mentions of scholarly papers (journal articles, books and conference proceedings papers) in the Wikipedia, English version. We determine (1) the share of scientific papers from a specific set defined by Wind Power research in Web of Science (WoS) 2006–2015 that are included in Wikipedia entries, named data set A; (2) the distribution of scientific papers in Wikipedia entries on Wind Power, named data set B, captured via the three categories for the topic Wind Power in the Wikipedia Portal: Wind Power, Wind turbines and Wind farms; (3) the distributions of document types in the two wiki entry data sets’ reference lists. In parallel the paper aims at designing and test indicators that measure societal impact and R&D properties of the Wikipedia, such as, a wiki reference focus measure; and a density measure of those types in wiki entries. The study is based on Web mining techniques and a developed software that extracts a range of different types of Wikipedia references from the data sets A and B. Findings show that in data set A 25.4% of the wiki references are academic, with a density of 17.62 academic records detected per wiki entry. However, only 0.62% of the original WoS records on Wind Power are also found as wiki references, implying that the direct societal impact through the Wikipedia is extremely small for Wind Power research. In the second Wikipedia set on Wind Power (data set B), the presence of scientific papers is even more insignificant (10.6%; density: 3.08; WoS paper percentage: 0.26%). Notwithstanding, the Wikipedia can be used as a tool informing about the transfer from scholarly publications to popular and non-peer reviewed publications, such as Web pages (news, blogs), popular magazines (science/technology) and research reports. Non-scholarly wiki reference types stand for 74.6% of the wiki references (data set A) and almost 90% in data set B. Interestingly, the few WoS articles in wiki entries on Wind Power present on average 34.3 citations received during the same period (2006–2015) as WoS Wind Power publications not mentioned in wiki entries only receives on average 5.9 citations. Owing to the scarcity of Wind Power research papers in the Wikipedia, it cannot be applied as a direct source in evaluation of Wind Power research. This is in line with other recent studies regarding other subject areas. However, our analysis presents and discusses six supplementary indirect indicators for research evaluation, based on publication types found in the wiki entry reference lists: share of (WoS) records; density; and reference focus, plus popular science knowledge export, non-scholarly knowledge export and academic knowledge export. The same indicators are direct measures of the Wikipedia reference properties.

AB - This paper is a result of the WOW project (Wind power On Wikipedia) which forms part of the SAPIENS (Scientometric Analyses of the Productivity and Impact of Eco-economy of Spain) project (Sanz-Casado et al. in Scientometrics 95(1):197–224, 2013). WOW is designed to observe the relationship between scholarly publications and societal impact or visibility through the mentions of scholarly papers (journal articles, books and conference proceedings papers) in the Wikipedia, English version. We determine (1) the share of scientific papers from a specific set defined by Wind Power research in Web of Science (WoS) 2006–2015 that are included in Wikipedia entries, named data set A; (2) the distribution of scientific papers in Wikipedia entries on Wind Power, named data set B, captured via the three categories for the topic Wind Power in the Wikipedia Portal: Wind Power, Wind turbines and Wind farms; (3) the distributions of document types in the two wiki entry data sets’ reference lists. In parallel the paper aims at designing and test indicators that measure societal impact and R&D properties of the Wikipedia, such as, a wiki reference focus measure; and a density measure of those types in wiki entries. The study is based on Web mining techniques and a developed software that extracts a range of different types of Wikipedia references from the data sets A and B. Findings show that in data set A 25.4% of the wiki references are academic, with a density of 17.62 academic records detected per wiki entry. However, only 0.62% of the original WoS records on Wind Power are also found as wiki references, implying that the direct societal impact through the Wikipedia is extremely small for Wind Power research. In the second Wikipedia set on Wind Power (data set B), the presence of scientific papers is even more insignificant (10.6%; density: 3.08; WoS paper percentage: 0.26%). Notwithstanding, the Wikipedia can be used as a tool informing about the transfer from scholarly publications to popular and non-peer reviewed publications, such as Web pages (news, blogs), popular magazines (science/technology) and research reports. Non-scholarly wiki reference types stand for 74.6% of the wiki references (data set A) and almost 90% in data set B. Interestingly, the few WoS articles in wiki entries on Wind Power present on average 34.3 citations received during the same period (2006–2015) as WoS Wind Power publications not mentioned in wiki entries only receives on average 5.9 citations. Owing to the scarcity of Wind Power research papers in the Wikipedia, it cannot be applied as a direct source in evaluation of Wind Power research. This is in line with other recent studies regarding other subject areas. However, our analysis presents and discusses six supplementary indirect indicators for research evaluation, based on publication types found in the wiki entry reference lists: share of (WoS) records; density; and reference focus, plus popular science knowledge export, non-scholarly knowledge export and academic knowledge export. The same indicators are direct measures of the Wikipedia reference properties.

KW - Faculty of Humanities

KW - Wikipedia

KW - Web of Science

KW - Forskningsevaluering

KW - Vindenergi

KW - Research Evaluation

KW - Wikipedia

KW - Web of Science

KW - Wind power

KW - Scientometrics

KW - Indicators

U2 - DOI 10.1007/s11192-017-2447-2

DO - DOI 10.1007/s11192-017-2447-2

M3 - Journal article

SN - 0138-9130

VL - 2017

SP - 1471

EP - 1488

JO - Scientometrics

JF - Scientometrics

IS - 112

ER -

Wind power research in Wikipedia. Does Wikipedia demonstrate direct influence of research publications and can it be used as adequate source in research evaluation?

Abstract

Emneord

Adgang til dokumentet

Fingeraftryk

Citationsformater