We release 19 English docs. and 19 Italian as testing data for the new OnForumS evaluation.

This is the directory of ROUGE as used for MultiLing 2015. The modifications were made by Jeff Kubina.

This is the submissions from the MSS (single-document summarization) from MultiLing 2015. The ROUGE scores and MeMoG scores, automatic evaluaiton are included.  

We release 10 English docs. and 5 Italian as training data for the new OnForumS evaluation.  

Josef Steinberger (UWB), Mijail Kabadjov, Udo Kruschwitz & Massimo Poesio (UESSEX)

Marina Litvak and Natalia Vanetik

Spread sheets with full OnForumS Evaluation details. P/R/F1 figures were computed based on the gold data release 20150520.

A bug was fixed from release 0.1 related to file handling.

A software package to validate and digest system submissions to OnForumS, an evaluation campaign for online forum summarization in multiple languages, a pilot track within MultiLing 2015.

Updates include: + inclusion of a DTD formalising the XML format + amended sentence IDs to conform with XML ID + a revised README to:    > correct the typo in Josef's email    > account for the DTD inclusion and...