OnForumS 2017 Test Data

We release 19 English docs. and 19 Italian as testing data for the new OnForumS evaluation.

2257 days ago

ROUGE Evaluation Scripts for MultiLing 2015

This is the directory of ROUGE as used for MultiLing 2015. The modifications were made by Jeff Kubina.

2263 days ago

OnForumS 2017 Train Data

We release 10 English docs. and 5 Italian as training data for the new OnForumS evaluation.  

2309 days ago

OnForumS Overview

An overview paper of the OnForumS task at MultiLing 2015. This is an earlier draft, an extended and polished draft is to appear in the proceedings of the 7th Forum for Information Retrieval Evaluation (FIRE 2015).

2708 days ago

OnForumS Evaluation

Spread sheets with full OnForumS Evaluation details. P/R/F1 figures were computed based on the gold data release 20150520.

2863 days ago

OnForumS Submission Validation

A software package to validate and digest system submissions to OnForumS, an evaluation campaign for online forum summarization in multiple languages, a pilot track within MultiLing 2015.

2944 days ago

TAC 2011 MultiLing Pilot Dataset - All files (Source texts, human and system summaries, evaluation data)

This file contains all the dataset files related to the MultiLing 2011 Pilot.This includes: source texts human summaries system summaries evaluation data (human and automatic)...

4029 days ago

MultiLing Pilot 2011 Evaluation of Summaries

This file contains the (manual and automatic) evaluation results of summaries in the MultiLin...t 2011 Dataset" form, before downloading. The manual evaluation is based on Overall Responsiveness, while the automatic evaluation on the AutoSummENG  and...

4042 days ago