ROUGE Evaluation Scripts for MultiLing 2015

This is the directory of ROUGE as used for MultiLing 2015. The modifications were made by Jeff Kubina.

2903 days ago

MSS (Multilingual Single-document Summarization) Submission and Automatic Score

This is the submissions from the MSS (single-document summarization) from MultiLing 2015. The ROUGE scores and MeMoG scores, automatic evaluaiton are included.  

2903 days ago

Task: Call Centre Conversation Summarization (CCCS)

...eader about the main events of the conversations, such as the objective of the participants and how they are met. Evaluation will be performed by ROUGE-like measures based on human-...

2929 days ago

Task: Single Document Summarization

...;2015 training data. The submitted summaries for 2015 and their automatic evaluation scores can be found downloaded by clicking here.  ROUGE needs to modified to run on m...

1643 days ago

MultiLing Pilot 2011 Evaluation of Summaries

This file contains the (manual and automatic) evaluation results of summaries in the MultiLing 2011 Pilot. We would appreciate it greatly, if you filled in the "Using the MultiLing Pilot 2011 Dataset" form, before downloading. The manual evaluation is based on Overall Responsiveness, while t...

Tags: evaluation, TAC 2011, MultiLing Pilot, AutoSummENG, MeMoG, ROUGE

4682 days ago

Comment on "TAC 2011 MultiLing Pilot Dataset - All files (Source texts, human and system summaries, evaluation data)"

Hi John. The command line we used was: ROUGE-1.5.5.pl -a -x -2 4 -u -c 95 -e <ROUGEDIR> -r 1000 -n 2 -f A -p 0.5 -t 0 -d <SETTINGS.XML File> We did not modify ROUGE to work with the other langua...

4261 days ago

Comment on "TAC 2011 MultiLing Pilot Dataset - All files (Source texts, human and system summaries, evaluation data)"

Hi John. The command line we used was: ROUGE-1.5.5.pl -a -x -2 4 -u -c 95 -e <ROUGEDIR> -r 1000 -n 2 -f A -p 0.5 -t 0 -d <SETTINGS.XML File> We did not modify ROUGE to work with the other langua...

4261 days ago