ROUGE Evaluation Scripts for MultiLing 2015

This is the directory of ROUGE as used for MultiLing 2015. The modifications were made by Jeff Kubina.

3041 days ago

MSS (Multilingual Single-document Summarization) Submission and Automatic Score

This is the submissions from the MSS (single-document summarization) from MultiLing 2015. The ROUGE scores and MeMoG scores, automatic evaluaiton are included.  

3042 days ago

Task: Call Centre Conversation Summarization (CCCS)

...eader about the main events of the conversations, such as the objective of the participants and how they are met. Evaluation will be performed by ROUGE-like measures based on human-...

3068 days ago

Task: Single Document Summarization

...;2015 training data. The submitted summaries for 2015 and their automatic evaluation scores can be found downloaded by clicking here.  ROUGE needs to modified to run on m...

1782 days ago

Comment on "TAC 2011 MultiLing Pilot Dataset - All files (Source texts, human and system summaries, evaluation data)"

Hi John. The command line we used was: ROUGE-1.5.5.pl -a -x -2 4 -u -c 95 -e <ROUGEDIR> -r 1000 -n 2 -f A -p 0.5 -t 0 -d <SETTINGS.XML File> We did not modify ROUGE to work with the other langua...

4399 days ago

Comment on "TAC 2011 MultiLing Pilot Dataset - All files (Source texts, human and system summaries, evaluation data)"

Hi John. The command line we used was: ROUGE-1.5.5.pl -a -x -2 4 -u -c 95 -e <ROUGEDIR> -r 1000 -n 2 -f A -p 0.5 -t 0 -d <SETTINGS.XML File> We did not modify ROUGE to work with the other langua...

4399 days ago