INEX Tweet Contextualization 2012 track Unofficial entity evaluation eric.sanjuan@univ-avignon.fr ----------------- Runs have been anonymized using the run submission ID displayed in participants' "Manage My INEX 2012 runs" page. Average scores, as well as detailed scores per run and topic are available. Measures are standard Recall, Precision and F-score (seel eval perl script TCenteval.pl) Entity qrel reference file INEX2012TCent1ref.csv comes from informativeness qrels. Relevant entities are wikipedia title pages appearing in relevant passages. File INEX2012TCent1source.csv contains the Document Paragraph sources and gives the details of this mapping. File INEX2012TCent1runs.csv gives submitted runs converted into entity runs. You can check figures for your runs using the qrel file also there. Reminder: these measures do not take into account readability. Eric SanJuan