On the Evaluation of Entity Profiles

Maarten de Rijke, Krisztian Balog, Toine Bogers, Antal van den Bosch

4 Citations (Scopus)
238 Downloads (Pure)

Abstract

Entity profiling is the task of identifying and ranking descriptions of a given entity. The task may be viewed as one where the descriptions being sought are terms that need to be selected from a knowledge source (such as an ontology or thesaurus). In this case, entity profiling systems can be assessed by means of precision and recall values of the descriptive terms produced. However, recent evidence suggests that more sophisticated metrics are needed that go beyond mere lexical matching of system-produced descriptors against a ground truth, allowing for graded relevance and rewarding diversity in the list of descriptors returned. In this note, we motivate and propose such a metric.
Original languageEnglish
Publication date2010
Number of pages6
Publication statusPublished - 2010
EventConference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010) - Padua, Italy
Duration: 20 Sept 201023 Sept 2010

Conference

ConferenceConference on Multilingual and Multimodal Information Access Evaluation (CLEF 2010)
Country/TerritoryItaly
CityPadua
Period20/09/201023/09/2010

Keywords

  • entity profiling
  • evaluation
  • entity retrieval
  • entity search

Fingerprint

Dive into the research topics of 'On the Evaluation of Entity Profiles'. Together they form a unique fingerprint.

Cite this