MultiLing Community Site: Results for "ROUGE"

ROUGE Evaluation Scripts for MultiLing 2015

Mon, 09 Jan 2017 19:15:45 +0200

This is the directory of ROUGE as used for MultiLing 2015. The modifications were made by Jeff Kubina.

MSS (Multilingual Single-document Summarization) Submission and Automatic Score

Mon, 09 Jan 2017 19:01:56 +0200

This is the submissions from the MSS (single-document summarization) from MultiLing 2015. The ROUGE scores and MeMoG scores, automatic evaluaiton are included.

Task: Call Centre Conversation Summarization (CCCS)

Tue, 13 Dec 2016 11:31:07 +0200

...eader about the main events of the conversations, such as the objective of the participants and how they are met. Evaluation will be performed by ROUGE-like measures based on human-...

Task: Single Document Summarization

Tue, 13 Dec 2016 11:04:14 +0200

...;2015 training data. The submitted summaries for 2015 and their automatic evaluation scores can be found downloaded by clicking here. ROUGE needs to modified to run on m...

MultiLing Pilot 2011 Evaluation of Summaries

Mon, 20 Feb 2012 18:15:18 +0200

This file contains the (manual and automatic) evaluation results of summaries in the MultiLing 2011 Pilot. We would appreciate it greatly, if you filled in the "Using the MultiLing Pilot 2011 Dataset" form, before downloading. The manual evaluation is based on Overall Responsiveness, while t...

Comment on "TAC 2011 MultiLing Pilot Dataset - All files (Source texts, human and system summaries, evaluation data)" by George Giannakopoulos (Admin)

Mon, 22 Apr 2013 22:16:51 +0300

Hi John. The command line we used was: ROUGE-1.5.5.pl -a -x -2 4 -u -c 95 -e <ROUGEDIR> -r 1000 -n 2 -f A -p 0.5 -t 0 -d We did not modify ROUGE to work with the other langua...

Comment on "TAC 2011 MultiLing Pilot Dataset - All files (Source texts, human and system summaries, evaluation data)" by George Giannakopoulos (Admin)

Mon, 22 Apr 2013 22:16:51 +0300

Hi John. The command line we used was: ROUGE-1.5.5.pl -a -x -2 4 -u -c 95 -e <ROUGEDIR> -r 1000 -n 2 -f A -p 0.5 -t 0 -d We did not modify ROUGE to work with the other langua...