A strong baseline for question relevancy ranking

    Abstract

    The best systems at the SemEval-16 and SemEval-17 community question answering shared tasks - a task that amounts to question relevancy ranking - involve complex pipelines and manual feature engineering. Despite this, many of these still fail at beating the IR baseline, i.e., the rankings provided by Google's search engine. We present a strong baseline for question relevancy ranking by training a simple multi-task feed forward network on a bag of 14 distance measures for the input question pair. This baseline model, which is fast to train and uses only language-independent features, outperforms the best shared task systems on the task of retrieving relevant previously asked questions.

    Original languageDanish
    Title of host publicationProceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
    PublisherAssociation for Computational Linguistics
    Publication date2018
    Pages4810–4815
    Publication statusPublished - 2018
    Event2018 Conference on Empirical Methods in Natural Language Processing - Brussels, Belgium
    Duration: 31 Oct 20184 Nov 2018

    Conference

    Conference2018 Conference on Empirical Methods in Natural Language Processing
    Country/TerritoryBelgium
    CityBrussels
    Period31/10/201804/11/2018

    Cite this