MultiLing Community Site
Log in
    • Lost password

    elgg logo

    • Activity
    • Files
    • MultiLing 2019
    • MultiLing 2017
    • MultiLing 2015
    • MultiLing 2013
    • MultiLing 2011
    • More
      • Blogs
      • Bookmarks
      • Groups
      • Members
      • Pages
      • The Wire
    

    Activity

      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) created a page MultiLing 2013 - Tasks 3722 days ago
      Tasks Summarization Task This MultiLing task aims to evaluate the application of (partially or fully) language-independent summarization algorithms on a variety of languages. Each system participating in the task will be called to provide...
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) created a page MultiLing 2013 3722 days ago
      NOTE: On the right you will find several links covering different aspects of the MultiLing 2013 event. Overview MultiLing 2013 is a community effort, a set of research tasks and a corresponding workshop which covers three subdomains of Natural...
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) posted to the wire 3723 days ago
      MultiLing 2013 has been accepted as an ACL 2013 Workshop. Details to follow soon.
      • Maria Fuentes@mfuentes
      Maria Fuentes
      Maria Fuentes has a new avatar 4007 days ago
      Maria Fuentes
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) posted to the wire 4014 days ago
      Registration will be open again, from 2012-03-26 to 2012-03-30, after your request.
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) posted to the wire 4027 days ago
      Registration will be open from 2012-03-12 to 2012-03-16, to avoid spam users.
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) posted to the wire 4029 days ago
      The MultiLing 2011 Pilot corpus is now publicly available as a single package. Check the files section.
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) uploaded the file TAC 2011 MultiLing Pilot Dataset - All files (Source texts, human and system summaries, evaluation data) 4029 days ago
      This file contains all the dataset files related to the MultiLing 2011 Pilot.This includes: source texts human summaries system summaries evaluation data (human and automatic) This is a packaging of the existing individual packages, found...
      Comments
        • John M. Conroy@jmconroy
        John M. Conroy
        John M. Conroy 3623 days ago

        Hi George,

         Can you post the options you used for ROUGE?  For example, was it

        using ROUGE1.5.5 with the options

        -x -u -d -m -n 2 -2 4 -c 95 -r 1000 -f A  -t 0 -a -l 250

        Also did you have to modify ROUGE to work with the other lanuages?

        Best regards,

        John

        • George Giannakopoulos (Admin)@ggianna
        George Giannakopoulos (Admin)
        George Giannakopoulos (Admin) 3621 days ago

        Hi John.

        The command line we used was:

        ROUGE-1.5.5.pl -a -x -2 4 -u -c 95 -e <ROUGEDIR> -r 1000 -n 2 -f A -p 0.5 -t 0 -d <SETTINGS.XML File>

        We did not modify ROUGE to work with the other languages. This may have caused a problem, as we later saw (because things may change with the tokenization in some languages). However, whether the effect of this different tokenization was significant is unclear. Marina Litvak later tried to apply some changes (to apply to the Hebrew language) and may have more information.

        • Marina Litvak@litvakm
        Marina Litvak
        Marina Litvak 3555 days ago

        Hi John, George,

         

        Yes, we also discussed it with Michael Elhadad - there may be a significant effect to ROUGE results depending on whether it is adapted to a particular language or not. I think Michael can explain ut better - I used adapted (by his student) to Hebrew version of Rouge. Then, I also adapted it to Arabic in the same manner.

      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) posted to the wire 4031 days ago
      Registration has been temporarily disabled to avoid garbage (spam) messages and users. Contact me directly, if you need to register.
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) posted to the wire 4042 days ago
      The MultiLing 2011 Pilot Dataset will be made publicly available by tomorrow.
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) uploaded the file MultiLing Pilot 2011 Source Texts 4048 days ago
      This file contains the source texts for the summaries of the MultiLing 2011 Pilot. We would appreciate it greatly, if you filled in the "Using the MultiLing Pilot 2011 Dataset" form, before downloading. You can find more information in the README...
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) uploaded the file MultiLing Pilot 2011 Model Summaries 4048 days ago
      This file contains the model summaries of the MultiLing 2011 Pilot. We would appreciate it greatly, if you filled in the "Using the MultiLing Pilot 2011 Dataset" form, before downloading.
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) uploaded the file MultiLing Pilot 2011 Evaluation of Summaries 4048 days ago
      This file contains the (manual and automatic) evaluation results of summaries in the MultiLing 2011 Pilot. We would appreciate it greatly, if you filled in the "Using the MultiLing Pilot 2011 Dataset" form, before downloading. The manual...
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) uploaded the file MultiLing Pilot 2011 Peer Summaries 4048 days ago
      This file contains the peer summaries submitted in the MultiLing Pilot of TAC 2011. The files have been preprocessed into UTF8 plain text files. We would appreciate it greatly, if you filled in the "Using the MultiLing Pilot 2011 Dataset" form,...
      • Benoit Favre@benoit.favre
      Benoit Favre
      Benoit Favre joined the group MultiLing 2011 Co-organizers 4053 days ago
      • Benoit Favre@benoit.favre
      Benoit Favre
      Benoit Favre has a new avatar 4053 days ago
      Benoit Favre
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) bookmarked Text Analysis Conference Website 4067 days ago
      The website of the NIST Text Analysis Conference.
      http://www.nist.gov/tac/
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
      George Giannakopoulos (Admin) posted to the wire 4067 days ago
      "Terms" page updated to better word expected behavior of users. Follow on the bottom right of the page.
      • bekoul@bekoul
      bekoul
      bekoul has a new avatar 4071 days ago
      bekoul
      • bekoul@bekoul
      bekoul
      bekoul is now a friend with George Giannakopoulos (Admin) 4071 days ago
      • bekoul@bekoul
      bekoul
      • George Giannakopoulos (Admin)@ggianna
      George Giannakopoulos (Admin)
    • Previous
    • 3
    • 4
    • 5
    • 6
    • 7
    • 8
    • 9
    • Next

    Twitter Bootstrap for Elgg is made possible by the awesome Elgg engine and impressive Twitter Bootstrap.
    • Report this
    • About
    • Terms
    • Privacy
    Powered by Elgg