Abstract
The problem of detecting scientific fraud
using machine learning was recently introduced,
with initial, positive results from
a model taking into account various general
indicators. The results seem to suggest
that writing style is predictive of scientific
fraud. We revisit these initial experiments,
and show that the leave-one-out
testing procedure they used likely leads to
a slight over-estimate of the predictability,
but also that simple models can outperform
their proposed model by some margin.
We go on to explore more abstract
linguistic features, such as linguistic complexity
and discourse structure, only to obtain
negative results. Upon analyzing our
models, we do see some interesting patterns,
though: Scientific fraud, for examples,
contains less comparison, as well as
different types of hedging and ways of presenting
logical reasoning.
using machine learning was recently introduced,
with initial, positive results from
a model taking into account various general
indicators. The results seem to suggest
that writing style is predictive of scientific
fraud. We revisit these initial experiments,
and show that the leave-one-out
testing procedure they used likely leads to
a slight over-estimate of the predictability,
but also that simple models can outperform
their proposed model by some margin.
We go on to explore more abstract
linguistic features, such as linguistic complexity
and discourse structure, only to obtain
negative results. Upon analyzing our
models, we do see some interesting patterns,
though: Scientific fraud, for examples,
contains less comparison, as well as
different types of hedging and ways of presenting
logical reasoning.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the Workshop on Stylistic VariationAssociation for Computational Linguistics |
| Number of pages | 6 |
| Publisher | Association for Computational Linguistics |
| Publication date | 2017 |
| Pages | 37-42 |
| ISBN (Print) | 978-1-945626-99-9 |
| Publication status | Published - 2017 |
| Event | Workshop on Stylistic Variation - Copenhagen, Denmark Duration: 8 Sept 2017 → 8 Sept 2017 |
Workshop
| Workshop | Workshop on Stylistic Variation |
|---|---|
| Country/Territory | Denmark |
| City | Copenhagen |
| Period | 08/09/2017 → 08/09/2017 |