---------------------------------------------
ID1 ROUGE-1 Average_R: 0.46690 (95%-conf.int. 0.43521 - 0.49845)
ID1 ROUGE-1 Average_P: 0.46810 (95%-conf.int. 0.42850 - 0.50227)
ID1 ROUGE-1 Average_F: 0.46702 (95%-conf.int. 0.43278 - 0.49713)
.............................................
ID1 ROUGE-1 Eval 1.ID1 R:0.48423 P:0.51374 F:0.49855
ID1 ROUGE-1 Eval 2.ID1 R:0.35367 P:0.33333 F:0.34320
ID1 ROUGE-1 Eval 3.ID1 R:0.55272 P:0.56620 F:0.55938
ID1 ROUGE-1 Eval 4.ID1 R:0.44651 P:0.45404 F:0.45024
ID1 ROUGE-1 Eval 5.ID1 R:0.51275 P:0.47944 F:0.49554
ID1 ROUGE-1 Eval 6.ID1 R:0.44686 P:0.52039 F:0.48083
ID1 ROUGE-1 Eval 7.ID1 R:0.44753 P:0.42791 F:0.43750
ID1 ROUGE-1 Eval 8.ID1 R:0.41733 P:0.41077 F:0.41402
ID1 ROUGE-1 Eval 9.ID1 R:0.49558 P:0.48780 F:0.49166
ID1 ROUGE-1 Eval 10.ID1 R:0.51040 P:0.48601 F:0.49791
---------------------------------------------
ID1 ROUGE-2 Average_R: 0.15354 (95%-conf.int. 0.12241 - 0.18216)
ID1 ROUGE-2 Average_P: 0.15474 (95%-conf.int. 0.12148 - 0.18548)
ID1 ROUGE-2 Average_F: 0.15398 (95%-conf.int. 0.12209 - 0.18356)
.............................................
ID1 ROUGE-2 Eval 1.ID1 R:0.18305 P:0.19424 F:0.18848
ID1 ROUGE-2 Eval 2.ID1 R:0.07875 P:0.07420 F:0.07641
ID1 ROUGE-2 Eval 3.ID1 R:0.23379 P:0.23951 F:0.23662
ID1 ROUGE-2 Eval 4.ID1 R:0.14612 P:0.14859 F:0.14734
ID1 ROUGE-2 Eval 5.ID1 R:0.18005 P:0.16832 F:0.17399
ID1 ROUGE-2 Eval 6.ID1 R:0.15636 P:0.18220 F:0.16829
ID1 ROUGE-2 Eval 7.ID1 R:0.10291 P:0.09838 F:0.10059
ID1 ROUGE-2 Eval 8.ID1 R:0.08238 P:0.08108 F:0.08172
ID1 ROUGE-2 Eval 9.ID1 R:0.21137 P:0.20804 F:0.20969
ID1 ROUGE-2 Eval 10.ID1 R:0.15971 P:0.15205 F:0.15579
---------------------------------------------
ID1 ROUGE-SU4 Average_R: 0.19030 (95%-conf.int. 0.16554 - 0.21471)
ID1 ROUGE-SU4 Average_P: 0.19146 (95%-conf.int. 0.16349 - 0.21957)
ID1 ROUGE-SU4 Average_F: 0.19068 (95%-conf.int. 0.16356 - 0.21652)
.............................................
ID1 ROUGE-SU4 Eval 1.ID1 R:0.20985 P:0.22276 F:0.21611
ID1 ROUGE-SU4 Eval 2.ID1 R:0.11426 P:0.10762 F:0.11084
ID1 ROUGE-SU4 Eval 3.ID1 R:0.26659 P:0.27315 F:0.26983
ID1 ROUGE-SU4 Eval 4.ID1 R:0.17808 P:0.18111 F:0.17958
ID1 ROUGE-SU4 Eval 5.ID1 R:0.21752 P:0.20326 F:0.21015
ID1 ROUGE-SU4 Eval 6.ID1 R:0.19411 P:0.22641 F:0.20902
ID1 ROUGE-SU4 Eval 7.ID1 R:0.15916 P:0.15211 F:0.15556
ID1 ROUGE-SU4 Eval 8.ID1 R:0.14039 P:0.13817 F:0.13927
ID1 ROUGE-SU4 Eval 9.ID1 R:0.23020 P:0.22655 F:0.22836
ID1 ROUGE-SU4 Eval 10.ID1 R:0.19201 P:0.18275 F:0.18727
---------------------------------------------
ID10 ROUGE-1 Average_R: 0.54728 (95%-conf.int. 0.51750 - 0.57596)
ID10 ROUGE-1 Average_P: 0.53965 (95%-conf.int. 0.50469 - 0.57774)
ID10 ROUGE-1 Average_F: 0.54315 (95%-conf.int. 0.51221 - 0.57582)
.............................................
ID10 ROUGE-1 Eval 1.ID10 R:0.58221 P:0.58418 F:0.58319
ID10 ROUGE-1 Eval 2.ID10 R:0.58904 P:0.56511 F:0.57683
ID10 ROUGE-1 Eval 3.ID10 R:0.57653 P:0.59059 F:0.58348
ID10 ROUGE-1 Eval 4.ID10 R:0.47205 P:0.49032 F:0.48101
ID10 ROUGE-1 Eval 5.ID10 R:0.59631 P:0.58048 F:0.58829
ID10 ROUGE-1 Eval 6.ID10 R:0.52536 P:0.47697 F:0.50000
ID10 ROUGE-1 Eval 7.ID10 R:0.61279 P:0.65128 F:0.63145
ID10 ROUGE-1 Eval 8.ID10 R:0.49715 P:0.47650 F:0.48661
ID10 ROUGE-1 Eval 9.ID10 R:0.50000 P:0.49388 F:0.49692
ID10 ROUGE-1 Eval 10.ID10 R:0.52264 P:0.48912 F:0.50532
---------------------------------------------
ID10 ROUGE-2 Average_R: 0.28553 (95%-conf.int. 0.24400 - 0.32685)
ID10 ROUGE-2 Average_P: 0.28215 (95%-conf.int. 0.23738 - 0.32629)
ID10 ROUGE-2 Average_F: 0.28369 (95%-conf.int. 0.24069 - 0.32612)
.............................................
ID10 ROUGE-2 Eval 1.ID10 R:0.34463 P:0.34580 F:0.34521
ID10 ROUGE-2 Eval 2.ID10 R:0.35000 P:0.33573 F:0.34272
ID10 ROUGE-2 Eval 3.ID10 R:0.30034 P:0.30769 F:0.30397
ID10 ROUGE-2 Eval 4.ID10 R:0.17867 P:0.18561 F:0.18207
ID10 ROUGE-2 Eval 5.ID10 R:0.37158 P:0.36168 F:0.36656
ID10 ROUGE-2 Eval 6.ID10 R:0.21818 P:0.19802 F:0.20761
ID10 ROUGE-2 Eval 7.ID10 R:0.37167 P:0.39511 F:0.38303
ID10 ROUGE-2 Eval 8.ID10 R:0.22311 P:0.21382 F:0.21837
ID10 ROUGE-2 Eval 9.ID10 R:0.25666 P:0.25351 F:0.25508
ID10 ROUGE-2 Eval 10.ID10 R:0.24201 P:0.22644 F:0.23397
---------------------------------------------
ID10 ROUGE-SU4 Average_R: 0.29501 (95%-conf.int. 0.26026 - 0.32987)
ID10 ROUGE-SU4 Average_P: 0.29153 (95%-conf.int. 0.25407 - 0.33069)
ID10 ROUGE-SU4 Average_F: 0.29311 (95%-conf.int. 0.25749 - 0.33046)
.............................................
ID10 ROUGE-SU4 Eval 1.ID10 R:0.33466 P:0.33580 F:0.33523
ID10 ROUGE-SU4 Eval 2.ID10 R:0.33501 P:0.32127 F:0.32800
ID10 ROUGE-SU4 Eval 3.ID10 R:0.31264 P:0.32034 F:0.31644
ID10 ROUGE-SU4 Eval 4.ID10 R:0.21860 P:0.22714 F:0.22279
ID10 ROUGE-SU4 Eval 5.ID10 R:0.37674 P:0.36665 F:0.37163
ID10 ROUGE-SU4 Eval 6.ID10 R:0.23984 P:0.21755 F:0.22815
ID10 ROUGE-SU4 Eval 7.ID10 R:0.37860 P:0.40263 F:0.39025
ID10 ROUGE-SU4 Eval 8.ID10 R:0.24319 P:0.23300 F:0.23799
ID10 ROUGE-SU4 Eval 9.ID10 R:0.25938 P:0.25618 F:0.25777
ID10 ROUGE-SU4 Eval 10.ID10 R:0.25278 P:0.23642 F:0.24433
---------------------------------------------
ID2 ROUGE-1 Average_R: 0.49282 (95%-conf.int. 0.46395 - 0.52093)
ID2 ROUGE-1 Average_P: 0.48345 (95%-conf.int. 0.45638 - 0.51003)
ID2 ROUGE-1 Average_F: 0.48789 (95%-conf.int. 0.46251 - 0.51509)
.............................................
ID2 ROUGE-1 Eval 1.ID2 R:0.53041 P:0.52862 F:0.52951
ID2 ROUGE-1 Eval 2.ID2 R:0.47696 P:0.42985 F:0.45218
ID2 ROUGE-1 Eval 3.ID2 R:0.49150 P:0.50702 F:0.49914
ID2 ROUGE-1 Eval 4.ID2 R:0.47550 P:0.49039 F:0.48283
ID2 ROUGE-1 Eval 5.ID2 R:0.58135 P:0.54719 F:0.56375
ID2 ROUGE-1 Eval 6.ID2 R:0.45531 P:0.43333 F:0.44405
ID2 ROUGE-1 Eval 7.ID2 R:0.52111 P:0.51799 F:0.51955
ID2 ROUGE-1 Eval 8.ID2 R:0.40821 P:0.41149 F:0.40984
ID2 ROUGE-1 Eval 9.ID2 R:0.51327 P:0.49488 F:0.50391
ID2 ROUGE-1 Eval 10.ID2 R:0.47491 P:0.47375 F:0.47433
---------------------------------------------
ID2 ROUGE-2 Average_R: 0.19737 (95%-conf.int. 0.16477 - 0.23113)
ID2 ROUGE-2 Average_P: 0.19322 (95%-conf.int. 0.16339 - 0.22451)
ID2 ROUGE-2 Average_F: 0.19520 (95%-conf.int. 0.16400 - 0.22763)
.............................................
ID2 ROUGE-2 Eval 1.ID2 R:0.23164 P:0.23086 F:0.23125
ID2 ROUGE-2 Eval 2.ID2 R:0.17625 P:0.15878 F:0.16706
ID2 ROUGE-2 Eval 3.ID2 R:0.18430 P:0.19014 F:0.18717
ID2 ROUGE-2 Eval 4.ID2 R:0.16482 P:0.17000 F:0.16737
ID2 ROUGE-2 Eval 5.ID2 R:0.31244 P:0.29402 F:0.30295
ID2 ROUGE-2 Eval 6.ID2 R:0.15273 P:0.14533 F:0.14894
ID2 ROUGE-2 Eval 7.ID2 R:0.24576 P:0.24428 F:0.24502
ID2 ROUGE-2 Eval 8.ID2 R:0.11670 P:0.11765 F:0.11717
ID2 ROUGE-2 Eval 9.ID2 R:0.21137 P:0.20377 F:0.20750
ID2 ROUGE-2 Eval 10.ID2 R:0.17813 P:0.17770 F:0.17791
---------------------------------------------
ID2 ROUGE-SU4 Average_R: 0.21525 (95%-conf.int. 0.18972 - 0.24411)
ID2 ROUGE-SU4 Average_P: 0.21091 (95%-conf.int. 0.18657 - 0.23739)
ID2 ROUGE-SU4 Average_F: 0.21297 (95%-conf.int. 0.18875 - 0.24028)
.............................................
ID2 ROUGE-SU4 Eval 1.ID2 R:0.23598 P:0.23518 F:0.23558
ID2 ROUGE-SU4 Eval 2.ID2 R:0.18868 P:0.16988 F:0.17879
ID2 ROUGE-SU4 Eval 3.ID2 R:0.20509 P:0.21163 F:0.20831
ID2 ROUGE-SU4 Eval 4.ID2 R:0.19468 P:0.20084 F:0.19771
ID2 ROUGE-SU4 Eval 5.ID2 R:0.31681 P:0.29802 F:0.30713
ID2 ROUGE-SU4 Eval 6.ID2 R:0.18354 P:0.17459 F:0.17895
ID2 ROUGE-SU4 Eval 7.ID2 R:0.24990 P:0.24839 F:0.24914
ID2 ROUGE-SU4 Eval 8.ID2 R:0.14960 P:0.15081 F:0.15020
ID2 ROUGE-SU4 Eval 9.ID2 R:0.22424 P:0.21613 F:0.22011
ID2 ROUGE-SU4 Eval 10.ID2 R:0.20416 P:0.20366 F:0.20391
---------------------------------------------
ID3 ROUGE-1 Average_R: 0.46999 (95%-conf.int. 0.43326 - 0.51384)
ID3 ROUGE-1 Average_P: 0.52169 (95%-conf.int. 0.48618 - 0.56591)
ID3 ROUGE-1 Average_F: 0.49427 (95%-conf.int. 0.45888 - 0.53850)
.............................................
ID3 ROUGE-1 Eval 1.ID3 R:0.60023 P:0.67298 F:0.63453
ID3 ROUGE-1 Eval 2.ID3 R:0.44707 P:0.45328 F:0.45015
ID3 ROUGE-1 Eval 3.ID3 R:0.45748 P:0.53162 F:0.49177
ID3 ROUGE-1 Eval 4.ID3 R:0.39890 P:0.47184 F:0.43231
ID3 ROUGE-1 Eval 5.ID3 R:0.52682 P:0.56723 F:0.54628
ID3 ROUGE-1 Eval 6.ID3 R:0.38647 P:0.44630 F:0.41424
ID3 ROUGE-1 Eval 7.ID3 R:0.54282 P:0.57692 F:0.55935
ID3 ROUGE-1 Eval 8.ID3 R:0.43558 P:0.48787 F:0.46024
ID3 ROUGE-1 Eval 9.ID3 R:0.45664 P:0.50195 F:0.47822
ID3 ROUGE-1 Eval 10.ID3 R:0.44798 P:0.50622 F:0.47532
---------------------------------------------
ID3 ROUGE-2 Average_R: 0.20178 (95%-conf.int. 0.15658 - 0.25622)
ID3 ROUGE-2 Average_P: 0.22313 (95%-conf.int. 0.17521 - 0.28082)
ID3 ROUGE-2 Average_F: 0.21184 (95%-conf.int. 0.16535 - 0.26809)
.............................................
ID3 ROUGE-2 Eval 1.ID3 R:0.36045 P:0.40431 F:0.38112
ID3 ROUGE-2 Eval 2.ID3 R:0.15750 P:0.15970 F:0.15859
ID3 ROUGE-2 Eval 3.ID3 R:0.13993 P:0.16270 F:0.15046
ID3 ROUGE-2 Eval 4.ID3 R:0.13019 P:0.15410 F:0.14114
ID3 ROUGE-2 Eval 5.ID3 R:0.26390 P:0.28422 F:0.27368
ID3 ROUGE-2 Eval 6.ID3 R:0.11030 P:0.12745 F:0.11826
ID3 ROUGE-2 Eval 7.ID3 R:0.29298 P:0.31145 F:0.30193
ID3 ROUGE-2 Eval 8.ID3 R:0.18192 P:0.20385 F:0.19226
ID3 ROUGE-2 Eval 9.ID3 R:0.23091 P:0.25391 F:0.24186
ID3 ROUGE-2 Eval 10.ID3 R:0.14988 P:0.16944 F:0.15906
---------------------------------------------
ID3 ROUGE-SU4 Average_R: 0.21896 (95%-conf.int. 0.18151 - 0.26496)
ID3 ROUGE-SU4 Average_P: 0.24294 (95%-conf.int. 0.20436 - 0.29102)
ID3 ROUGE-SU4 Average_F: 0.23023 (95%-conf.int. 0.19209 - 0.27652)
.............................................
ID3 ROUGE-SU4 Eval 1.ID3 R:0.36383 P:0.40838 F:0.38482
ID3 ROUGE-SU4 Eval 2.ID3 R:0.16541 P:0.16773 F:0.16656
ID3 ROUGE-SU4 Eval 3.ID3 R:0.17620 P:0.20506 F:0.18954
ID3 ROUGE-SU4 Eval 4.ID3 R:0.15695 P:0.18597 F:0.17023
ID3 ROUGE-SU4 Eval 5.ID3 R:0.27449 P:0.29576 F:0.28473
ID3 ROUGE-SU4 Eval 6.ID3 R:0.15549 P:0.17983 F:0.16678
ID3 ROUGE-SU4 Eval 7.ID3 R:0.28624 P:0.30440 F:0.29504
ID3 ROUGE-SU4 Eval 8.ID3 R:0.19774 P:0.22172 F:0.20904
ID3 ROUGE-SU4 Eval 9.ID3 R:0.23317 P:0.25655 F:0.24430
ID3 ROUGE-SU4 Eval 10.ID3 R:0.17985 P:0.20350 F:0.19095
---------------------------------------------
ID4 ROUGE-1 Average_R: 0.45828 (95%-conf.int. 0.42406 - 0.49052)
ID4 ROUGE-1 Average_P: 0.46227 (95%-conf.int. 0.43172 - 0.49180)
ID4 ROUGE-1 Average_F: 0.46006 (95%-conf.int. 0.42782 - 0.49012)
.............................................
ID4 ROUGE-1 Eval 1.ID4 R:0.47072 P:0.50667 F:0.48803
ID4 ROUGE-1 Eval 2.ID4 R:0.46202 P:0.46144 F:0.46173
ID4 ROUGE-1 Eval 3.ID4 R:0.38946 P:0.41941 F:0.40388
ID4 ROUGE-1 Eval 4.ID4 R:0.43478 P:0.45985 F:0.44696
ID4 ROUGE-1 Eval 5.ID4 R:0.52419 P:0.51736 F:0.52075
ID4 ROUGE-1 Eval 6.ID4 R:0.40217 P:0.40809 F:0.40511
ID4 ROUGE-1 Eval 7.ID4 R:0.55609 P:0.54881 F:0.55243
ID4 ROUGE-1 Eval 8.ID4 R:0.39339 P:0.39519 F:0.39429
ID4 ROUGE-1 Eval 9.ID4 R:0.50619 P:0.48311 F:0.49438
ID4 ROUGE-1 Eval 10.ID4 R:0.44553 P:0.42424 F:0.43462
---------------------------------------------
ID4 ROUGE-2 Average_R: 0.15909 (95%-conf.int. 0.12533 - 0.19354)
ID4 ROUGE-2 Average_P: 0.15994 (95%-conf.int. 0.12752 - 0.19231)
ID4 ROUGE-2 Average_F: 0.15945 (95%-conf.int. 0.12574 - 0.19251)
.............................................
ID4 ROUGE-2 Eval 1.ID4 R:0.16045 P:0.17275 F:0.16637
ID4 ROUGE-2 Eval 2.ID4 R:0.18500 P:0.18477 F:0.18488
ID4 ROUGE-2 Eval 3.ID4 R:0.09386 P:0.10110 F:0.09735
ID4 ROUGE-2 Eval 4.ID4 R:0.13573 P:0.14359 F:0.13955
ID4 ROUGE-2 Eval 5.ID4 R:0.24625 P:0.24303 F:0.24463
ID4 ROUGE-2 Eval 6.ID4 R:0.10909 P:0.11070 F:0.10989
ID4 ROUGE-2 Eval 7.ID4 R:0.25545 P:0.25209 F:0.25376
ID4 ROUGE-2 Eval 8.ID4 R:0.09954 P:0.10000 F:0.09977
ID4 ROUGE-2 Eval 9.ID4 R:0.18206 P:0.17373 F:0.17780
ID4 ROUGE-2 Eval 10.ID4 R:0.12531 P:0.11930 F:0.12223
---------------------------------------------
ID4 ROUGE-SU4 Average_R: 0.19151 (95%-conf.int. 0.16296 - 0.22099)
ID4 ROUGE-SU4 Average_P: 0.19286 (95%-conf.int. 0.16583 - 0.22129)
ID4 ROUGE-SU4 Average_F: 0.19210 (95%-conf.int. 0.16433 - 0.22098)
.............................................
ID4 ROUGE-SU4 Eval 1.ID4 R:0.19015 P:0.20481 F:0.19721
ID4 ROUGE-SU4 Eval 2.ID4 R:0.19266 P:0.19242 F:0.19254
ID4 ROUGE-SU4 Eval 3.ID4 R:0.13072 P:0.14088 F:0.13561
ID4 ROUGE-SU4 Eval 4.ID4 R:0.18017 P:0.19066 F:0.18527
ID4 ROUGE-SU4 Eval 5.ID4 R:0.27257 P:0.26898 F:0.27076
ID4 ROUGE-SU4 Eval 6.ID4 R:0.15854 P:0.16089 F:0.15971
ID4 ROUGE-SU4 Eval 7.ID4 R:0.27852 P:0.27484 F:0.27667
ID4 ROUGE-SU4 Eval 8.ID4 R:0.14231 P:0.14297 F:0.14264
ID4 ROUGE-SU4 Eval 9.ID4 R:0.21203 P:0.20227 F:0.20704
ID4 ROUGE-SU4 Eval 10.ID4 R:0.15884 P:0.15118 F:0.15492
---------------------------------------------
ID5 ROUGE-1 Average_R: 0.37111 (95%-conf.int. 0.33908 - 0.40431)
ID5 ROUGE-1 Average_P: 0.43984 (95%-conf.int. 0.41612 - 0.46799)
ID5 ROUGE-1 Average_F: 0.40200 (95%-conf.int. 0.37373 - 0.43246)
.............................................
ID5 ROUGE-1 Eval 1.ID5 R:0.34572 P:0.39208 F:0.36744
ID5 ROUGE-1 Eval 2.ID5 R:0.36364 P:0.40896 F:0.38497
ID5 ROUGE-1 Eval 3.ID5 R:0.36905 P:0.46767 F:0.41255
ID5 ROUGE-1 Eval 4.ID5 R:0.31470 P:0.40176 F:0.35294
ID5 ROUGE-1 Eval 5.ID5 R:0.37643 P:0.44215 F:0.40665
ID5 ROUGE-1 Eval 6.ID5 R:0.37319 P:0.41365 F:0.39238
ID5 ROUGE-1 Eval 7.ID5 R:0.47889 P:0.53794 F:0.50670
ID5 ROUGE-1 Eval 8.ID5 R:0.37286 P:0.43775 F:0.40271
ID5 ROUGE-1 Eval 9.ID5 R:0.43009 P:0.48406 F:0.45548
ID5 ROUGE-1 Eval 10.ID5 R:0.28886 P:0.41404 F:0.34030
---------------------------------------------
ID5 ROUGE-2 Average_R: 0.11862 (95%-conf.int. 0.09357 - 0.15295)
ID5 ROUGE-2 Average_P: 0.14000 (95%-conf.int. 0.11306 - 0.17661)
ID5 ROUGE-2 Average_F: 0.12827 (95%-conf.int. 0.10284 - 0.16373)
.............................................
ID5 ROUGE-2 Eval 1.ID5 R:0.10282 P:0.11667 F:0.10931
ID5 ROUGE-2 Eval 2.ID5 R:0.09750 P:0.10970 F:0.10324
ID5 ROUGE-2 Eval 3.ID5 R:0.12799 P:0.16234 F:0.14313
ID5 ROUGE-2 Eval 4.ID5 R:0.10319 P:0.13186 F:0.11578
ID5 ROUGE-2 Eval 5.ID5 R:0.10944 P:0.12863 F:0.11826
ID5 ROUGE-2 Eval 6.ID5 R:0.07636 P:0.08468 F:0.08031
ID5 ROUGE-2 Eval 7.ID5 R:0.25061 P:0.28163 F:0.26522
ID5 ROUGE-2 Eval 8.ID5 R:0.09382 P:0.11022 F:0.10136
ID5 ROUGE-2 Eval 9.ID5 R:0.15808 P:0.17800 F:0.16745
ID5 ROUGE-2 Eval 10.ID5 R:0.06880 P:0.09877 F:0.08110
---------------------------------------------
ID5 ROUGE-SU4 Average_R: 0.15037 (95%-conf.int. 0.12936 - 0.18068)
ID5 ROUGE-SU4 Average_P: 0.17820 (95%-conf.int. 0.15784 - 0.20682)
ID5 ROUGE-SU4 Average_F: 0.16289 (95%-conf.int. 0.14218 - 0.19230)
.............................................
ID5 ROUGE-SU4 Eval 1.ID5 R:0.13144 P:0.14925 F:0.13978
ID5 ROUGE-SU4 Eval 2.ID5 R:0.12767 P:0.14377 F:0.13524
ID5 ROUGE-SU4 Eval 3.ID5 R:0.14960 P:0.19004 F:0.16741
ID5 ROUGE-SU4 Eval 4.ID5 R:0.14012 P:0.17935 F:0.15733
ID5 ROUGE-SU4 Eval 5.ID5 R:0.14324 P:0.16852 F:0.15486
ID5 ROUGE-SU4 Eval 6.ID5 R:0.13557 P:0.15043 F:0.14261
ID5 ROUGE-SU4 Eval 7.ID5 R:0.26106 P:0.29361 F:0.27638
ID5 ROUGE-SU4 Eval 8.ID5 R:0.13867 P:0.16306 F:0.14988
ID5 ROUGE-SU4 Eval 9.ID5 R:0.17540 P:0.19765 F:0.18586
ID5 ROUGE-SU4 Eval 10.ID5 R:0.10301 P:0.14828 F:0.12157
---------------------------------------------
ID6 ROUGE-1 Average_R: 0.36108 (95%-conf.int. 0.31758 - 0.39977)
ID6 ROUGE-1 Average_P: 0.50732 (95%-conf.int. 0.47861 - 0.53954)
ID6 ROUGE-1 Average_F: 0.42045 (95%-conf.int. 0.38014 - 0.45529)
.............................................
ID6 ROUGE-1 Eval 1.ID6 R:0.38176 P:0.57360 F:0.45842
ID6 ROUGE-1 Eval 2.ID6 R:0.23537 P:0.43151 F:0.30460
ID6 ROUGE-1 Eval 3.ID6 R:0.34014 P:0.49505 F:0.40323
ID6 ROUGE-1 Eval 4.ID6 R:0.27812 P:0.46057 F:0.34681
ID6 ROUGE-1 Eval 5.ID6 R:0.44767 P:0.52152 F:0.48178
ID6 ROUGE-1 Eval 6.ID6 R:0.31039 P:0.45811 F:0.37005
ID6 ROUGE-1 Eval 7.ID6 R:0.44873 P:0.59048 F:0.50994
ID6 ROUGE-1 Eval 8.ID6 R:0.38997 P:0.50000 F:0.43818
ID6 ROUGE-1 Eval 9.ID6 R:0.40708 P:0.54762 F:0.46701
ID6 ROUGE-1 Eval 10.ID6 R:0.37087 P:0.49510 F:0.42407
---------------------------------------------
ID6 ROUGE-2 Average_R: 0.10044 (95%-conf.int. 0.07532 - 0.12950)
ID6 ROUGE-2 Average_P: 0.13955 (95%-conf.int. 0.11076 - 0.17554)
ID6 ROUGE-2 Average_F: 0.11645 (95%-conf.int. 0.09004 - 0.14796)
.............................................
ID6 ROUGE-2 Eval 1.ID6 R:0.13898 P:0.20918 F:0.16700
ID6 ROUGE-2 Eval 2.ID6 R:0.05625 P:0.10345 F:0.07287
ID6 ROUGE-2 Eval 3.ID6 R:0.07679 P:0.11194 F:0.09109
ID6 ROUGE-2 Eval 4.ID6 R:0.04017 P:0.06667 F:0.05013
ID6 ROUGE-2 Eval 5.ID6 R:0.12710 P:0.14815 F:0.13682
ID6 ROUGE-2 Eval 6.ID6 R:0.06788 P:0.10036 F:0.08098
ID6 ROUGE-2 Eval 7.ID6 R:0.18886 P:0.24880 F:0.21473
ID6 ROUGE-2 Eval 8.ID6 R:0.11327 P:0.14537 F:0.12733
ID6 ROUGE-2 Eval 9.ID6 R:0.11456 P:0.15431 F:0.13150
ID6 ROUGE-2 Eval 10.ID6 R:0.08108 P:0.10837 F:0.09276
---------------------------------------------
ID6 ROUGE-SU4 Average_R: 0.13499 (95%-conf.int. 0.11123 - 0.15897)
ID6 ROUGE-SU4 Average_P: 0.18900 (95%-conf.int. 0.16596 - 0.21597)
ID6 ROUGE-SU4 Average_F: 0.15699 (95%-conf.int. 0.13312 - 0.18227)
.............................................
ID6 ROUGE-SU4 Eval 1.ID6 R:0.15947 P:0.24071 F:0.19184
ID6 ROUGE-SU4 Eval 2.ID6 R:0.06939 P:0.12829 F:0.09007
ID6 ROUGE-SU4 Eval 3.ID6 R:0.12271 P:0.17935 F:0.14572
ID6 ROUGE-SU4 Eval 4.ID6 R:0.09101 P:0.15164 F:0.11375
ID6 ROUGE-SU4 Eval 5.ID6 R:0.17046 P:0.19890 F:0.18359
ID6 ROUGE-SU4 Eval 6.ID6 R:0.10691 P:0.15853 F:0.12770
ID6 ROUGE-SU4 Eval 7.ID6 R:0.20341 P:0.26849 F:0.23146
ID6 ROUGE-SU4 Eval 8.ID6 R:0.15362 P:0.19749 F:0.17281
ID6 ROUGE-SU4 Eval 9.ID6 R:0.14205 P:0.19172 F:0.16319
ID6 ROUGE-SU4 Eval 10.ID6 R:0.13082 P:0.17522 F:0.14980
---------------------------------------------
ID7 ROUGE-1 Average_R: 0.46018 (95%-conf.int. 0.43331 - 0.49276)
ID7 ROUGE-1 Average_P: 0.45893 (95%-conf.int. 0.43469 - 0.48557)
ID7 ROUGE-1 Average_F: 0.45914 (95%-conf.int. 0.43468 - 0.48740)
.............................................
ID7 ROUGE-1 Eval 1.ID7 R:0.44820 P:0.45279 F:0.45048
ID7 ROUGE-1 Eval 2.ID7 R:0.40598 P:0.39805 F:0.40198
ID7 ROUGE-1 Eval 3.ID7 R:0.45408 P:0.47509 F:0.46435
ID7 ROUGE-1 Eval 4.ID7 R:0.42098 P:0.41077 F:0.41581
ID7 ROUGE-1 Eval 5.ID7 R:0.49956 P:0.48797 F:0.49370
ID7 ROUGE-1 Eval 6.ID7 R:0.47343 P:0.44144 F:0.45688
ID7 ROUGE-1 Eval 7.ID7 R:0.57298 P:0.54977 F:0.56114
ID7 ROUGE-1 Eval 8.ID7 R:0.40707 P:0.47600 F:0.43884
ID7 ROUGE-1 Eval 9.ID7 R:0.48938 P:0.47024 F:0.47962
ID7 ROUGE-1 Eval 10.ID7 R:0.43207 P:0.42788 F:0.42996
---------------------------------------------
ID7 ROUGE-2 Average_R: 0.15053 (95%-conf.int. 0.12436 - 0.18230)
ID7 ROUGE-2 Average_P: 0.14996 (95%-conf.int. 0.12535 - 0.17969)
ID7 ROUGE-2 Average_F: 0.15011 (95%-conf.int. 0.12463 - 0.18068)
.............................................
ID7 ROUGE-2 Eval 1.ID7 R:0.15480 P:0.15639 F:0.15559
ID7 ROUGE-2 Eval 2.ID7 R:0.12625 P:0.12377 F:0.12500
ID7 ROUGE-2 Eval 3.ID7 R:0.13993 P:0.14643 F:0.14311
ID7 ROUGE-2 Eval 4.ID7 R:0.09903 P:0.09662 F:0.09781
ID7 ROUGE-2 Eval 5.ID7 R:0.20565 P:0.20086 F:0.20323
ID7 ROUGE-2 Eval 6.ID7 R:0.13333 P:0.12429 F:0.12865
ID7 ROUGE-2 Eval 7.ID7 R:0.26755 P:0.25668 F:0.26200
ID7 ROUGE-2 Eval 8.ID7 R:0.12929 P:0.15127 F:0.13942
ID7 ROUGE-2 Eval 9.ID7 R:0.14298 P:0.13737 F:0.14012
ID7 ROUGE-2 Eval 10.ID7 R:0.10811 P:0.10706 F:0.10758
---------------------------------------------
ID7 ROUGE-SU4 Average_R: 0.18688 (95%-conf.int. 0.16509 - 0.21388)
ID7 ROUGE-SU4 Average_P: 0.18607 (95%-conf.int. 0.16584 - 0.21121)
ID7 ROUGE-SU4 Average_F: 0.18631 (95%-conf.int. 0.16558 - 0.21262)
.............................................
ID7 ROUGE-SU4 Eval 1.ID7 R:0.18920 P:0.19116 F:0.19017
ID7 ROUGE-SU4 Eval 2.ID7 R:0.16415 P:0.16091 F:0.16251
ID7 ROUGE-SU4 Eval 3.ID7 R:0.17677 P:0.18503 F:0.18081
ID7 ROUGE-SU4 Eval 4.ID7 R:0.15150 P:0.14779 F:0.14962
ID7 ROUGE-SU4 Eval 5.ID7 R:0.23217 P:0.22673 F:0.22942
ID7 ROUGE-SU4 Eval 6.ID7 R:0.17724 P:0.16515 F:0.17098
ID7 ROUGE-SU4 Eval 7.ID7 R:0.28969 P:0.27784 F:0.28364
ID7 ROUGE-SU4 Eval 8.ID7 R:0.15343 P:0.17969 F:0.16552
ID7 ROUGE-SU4 Eval 9.ID7 R:0.18359 P:0.17634 F:0.17989
ID7 ROUGE-SU4 Eval 10.ID7 R:0.15266 P:0.15116 F:0.15191
---------------------------------------------
ID9 ROUGE-1 Average_R: 0.43156 (95%-conf.int. 0.40621 - 0.45376)
ID9 ROUGE-1 Average_P: 0.43124 (95%-conf.int. 0.40720 - 0.45450)
ID9 ROUGE-1 Average_F: 0.43120 (95%-conf.int. 0.40730 - 0.45278)
.............................................
ID9 ROUGE-1 Eval 1.ID9 R:0.36599 P:0.37100 F:0.36848
ID9 ROUGE-1 Eval 2.ID9 R:0.35243 P:0.35597 F:0.35419
ID9 ROUGE-1 Eval 3.ID9 R:0.45068 P:0.48535 F:0.46737
ID9 ROUGE-1 Eval 4.ID9 R:0.44651 P:0.46547 F:0.45579
ID9 ROUGE-1 Eval 5.ID9 R:0.46438 P:0.45833 F:0.46134
ID9 ROUGE-1 Eval 6.ID9 R:0.44807 P:0.44325 F:0.44565
ID9 ROUGE-1 Eval 7.ID9 R:0.45597 P:0.45000 F:0.45297
ID9 ROUGE-1 Eval 8.ID9 R:0.40935 P:0.41988 F:0.41455
ID9 ROUGE-1 Eval 9.ID9 R:0.47434 P:0.44966 F:0.46167
ID9 ROUGE-1 Eval 10.ID9 R:0.44798 P:0.41356 F:0.43008
---------------------------------------------
ID9 ROUGE-2 Average_R: 0.12980 (95%-conf.int. 0.11289 - 0.14430)
ID9 ROUGE-2 Average_P: 0.12979 (95%-conf.int. 0.11261 - 0.14620)
ID9 ROUGE-2 Average_F: 0.12973 (95%-conf.int. 0.11296 - 0.14513)
.............................................
ID9 ROUGE-2 Eval 1.ID9 R:0.07458 P:0.07560 F:0.07509
ID9 ROUGE-2 Eval 2.ID9 R:0.09500 P:0.09596 F:0.09548
ID9 ROUGE-2 Eval 3.ID9 R:0.15188 P:0.16360 F:0.15752
ID9 ROUGE-2 Eval 4.ID9 R:0.16274 P:0.16968 F:0.16614
ID9 ROUGE-2 Eval 5.ID9 R:0.13945 P:0.13763 F:0.13853
ID9 ROUGE-2 Eval 6.ID9 R:0.14667 P:0.14508 F:0.14587
ID9 ROUGE-2 Eval 7.ID9 R:0.13196 P:0.13023 F:0.13109
ID9 ROUGE-2 Eval 8.ID9 R:0.10984 P:0.11268 F:0.11124
ID9 ROUGE-2 Eval 9.ID9 R:0.14476 P:0.13721 F:0.14088
ID9 ROUGE-2 Eval 10.ID9 R:0.14128 P:0.13039 F:0.13562
---------------------------------------------
ID9 ROUGE-SU4 Average_R: 0.16705 (95%-conf.int. 0.14920 - 0.18196)
ID9 ROUGE-SU4 Average_P: 0.16709 (95%-conf.int. 0.14839 - 0.18446)
ID9 ROUGE-SU4 Average_F: 0.16699 (95%-conf.int. 0.14901 - 0.18308)
.............................................
ID9 ROUGE-SU4 Eval 1.ID9 R:0.11345 P:0.11502 F:0.11423
ID9 ROUGE-SU4 Eval 2.ID9 R:0.12096 P:0.12219 F:0.12157
ID9 ROUGE-SU4 Eval 3.ID9 R:0.18965 P:0.20438 F:0.19674
ID9 ROUGE-SU4 Eval 4.ID9 R:0.19840 P:0.20690 F:0.20256
ID9 ROUGE-SU4 Eval 5.ID9 R:0.17993 P:0.17757 F:0.17874
ID9 ROUGE-SU4 Eval 6.ID9 R:0.18801 P:0.18597 F:0.18698
ID9 ROUGE-SU4 Eval 7.ID9 R:0.17235 P:0.17007 F:0.17120
ID9 ROUGE-SU4 Eval 8.ID9 R:0.15401 P:0.15801 F:0.15598
ID9 ROUGE-SU4 Eval 9.ID9 R:0.17496 P:0.16577 F:0.17024
ID9 ROUGE-SU4 Eval 10.ID9 R:0.17882 P:0.16496 F:0.17161
