---------------------------------------------
ID1 ROUGE-1 Average_R: 0.40524 (95%-conf.int. 0.37197 - 0.44134)
ID1 ROUGE-1 Average_P: 0.41253 (95%-conf.int. 0.37388 - 0.45277)
ID1 ROUGE-1 Average_F: 0.40776 (95%-conf.int. 0.37511 - 0.44214)
.............................................
ID1 ROUGE-1 Eval 1.ID1 R:0.36230 P:0.49362 F:0.41789
ID1 ROUGE-1 Eval 2.ID1 R:0.49867 P:0.48889 F:0.49373
ID1 ROUGE-1 Eval 3.ID1 R:0.40423 P:0.39535 F:0.39974
ID1 ROUGE-1 Eval 4.ID1 R:0.37677 P:0.38778 F:0.38220
ID1 ROUGE-1 Eval 5.ID1 R:0.40691 P:0.39844 F:0.40263
ID1 ROUGE-1 Eval 6.ID1 R:0.37813 P:0.34537 F:0.36101
ID1 ROUGE-1 Eval 7.ID1 R:0.50459 P:0.50525 F:0.50492
ID1 ROUGE-1 Eval 8.ID1 R:0.33463 P:0.33858 F:0.33659
ID1 ROUGE-1 Eval 9.ID1 R:0.44575 P:0.44401 F:0.44488
ID1 ROUGE-1 Eval 10.ID1 R:0.34400 P:0.33077 F:0.33726
---------------------------------------------
ID1 ROUGE-2 Average_R: 0.12125 (95%-conf.int. 0.09068 - 0.15596)
ID1 ROUGE-2 Average_P: 0.12448 (95%-conf.int. 0.09118 - 0.15963)
ID1 ROUGE-2 Average_F: 0.12247 (95%-conf.int. 0.09101 - 0.15689)
.............................................
ID1 ROUGE-2 Eval 1.ID1 R:0.12886 P:0.17582 F:0.14872
ID1 ROUGE-2 Eval 2.ID1 R:0.22356 P:0.21916 F:0.22134
ID1 ROUGE-2 Eval 3.ID1 R:0.10345 P:0.10117 F:0.10230
ID1 ROUGE-2 Eval 4.ID1 R:0.09585 P:0.09867 F:0.09724
ID1 ROUGE-2 Eval 5.ID1 R:0.10814 P:0.10588 F:0.10700
ID1 ROUGE-2 Eval 6.ID1 R:0.08069 P:0.07367 F:0.07702
ID1 ROUGE-2 Eval 7.ID1 R:0.20658 P:0.20685 F:0.20671
ID1 ROUGE-2 Eval 8.ID1 R:0.06510 P:0.06588 F:0.06549
ID1 ROUGE-2 Eval 9.ID1 R:0.14436 P:0.14379 F:0.14407
ID1 ROUGE-2 Eval 10.ID1 R:0.05890 P:0.05663 F:0.05774
---------------------------------------------
ID1 ROUGE-SU4 Average_R: 0.15995 (95%-conf.int. 0.13367 - 0.18916)
ID1 ROUGE-SU4 Average_P: 0.16322 (95%-conf.int. 0.13486 - 0.19338)
ID1 ROUGE-SU4 Average_F: 0.16112 (95%-conf.int. 0.13452 - 0.19011)
.............................................
ID1 ROUGE-SU4 Eval 1.ID1 R:0.14865 P:0.20333 F:0.17174
ID1 ROUGE-SU4 Eval 2.ID1 R:0.24326 P:0.23844 F:0.24083
ID1 ROUGE-SU4 Eval 3.ID1 R:0.15087 P:0.14752 F:0.14918
ID1 ROUGE-SU4 Eval 4.ID1 R:0.14494 P:0.14922 F:0.14705
ID1 ROUGE-SU4 Eval 5.ID1 R:0.14516 P:0.14211 F:0.14362
ID1 ROUGE-SU4 Eval 6.ID1 R:0.13671 P:0.12475 F:0.13046
ID1 ROUGE-SU4 Eval 7.ID1 R:0.24283 P:0.24315 F:0.24299
ID1 ROUGE-SU4 Eval 8.ID1 R:0.10594 P:0.10721 F:0.10657
ID1 ROUGE-SU4 Eval 9.ID1 R:0.17415 P:0.17346 F:0.17380
ID1 ROUGE-SU4 Eval 10.ID1 R:0.10984 P:0.10557 F:0.10766
---------------------------------------------
ID10 ROUGE-1 Average_R: 0.52488 (95%-conf.int. 0.50684 - 0.54221)
ID10 ROUGE-1 Average_P: 0.51806 (95%-conf.int. 0.50263 - 0.53352)
ID10 ROUGE-1 Average_F: 0.52141 (95%-conf.int. 0.50488 - 0.53758)
.............................................
ID10 ROUGE-1 Eval 1.ID10 R:0.48797 P:0.47900 F:0.48344
ID10 ROUGE-1 Eval 2.ID10 R:0.54800 P:0.54800 F:0.54800
ID10 ROUGE-1 Eval 3.ID10 R:0.49670 P:0.48958 F:0.49311
ID10 ROUGE-1 Eval 4.ID10 R:0.54323 P:0.53157 F:0.53734
ID10 ROUGE-1 Eval 5.ID10 R:0.55186 P:0.53826 F:0.54498
ID10 ROUGE-1 Eval 6.ID10 R:0.55468 P:0.52757 F:0.54079
ID10 ROUGE-1 Eval 7.ID10 R:0.56356 P:0.55556 F:0.55953
ID10 ROUGE-1 Eval 8.ID10 R:0.48508 P:0.48508 F:0.48508
ID10 ROUGE-1 Eval 9.ID10 R:0.51373 P:0.51575 F:0.51474
ID10 ROUGE-1 Eval 10.ID10 R:0.50533 P:0.51147 F:0.50838
---------------------------------------------
ID10 ROUGE-2 Average_R: 0.25177 (95%-conf.int. 0.22525 - 0.27939)
ID10 ROUGE-2 Average_P: 0.24830 (95%-conf.int. 0.22276 - 0.27466)
ID10 ROUGE-2 Average_F: 0.25000 (95%-conf.int. 0.22403 - 0.27732)
.............................................
ID10 ROUGE-2 Eval 1.ID10 R:0.22148 P:0.21739 F:0.21942
ID10 ROUGE-2 Eval 2.ID10 R:0.31459 P:0.31459 F:0.31459
ID10 ROUGE-2 Eval 3.ID10 R:0.23210 P:0.22876 F:0.23042
ID10 ROUGE-2 Eval 4.ID10 R:0.28886 P:0.28264 F:0.28572
ID10 ROUGE-2 Eval 5.ID10 R:0.30307 P:0.29557 F:0.29927
ID10 ROUGE-2 Eval 6.ID10 R:0.26587 P:0.25283 F:0.25919
ID10 ROUGE-2 Eval 7.ID10 R:0.28289 P:0.27886 F:0.28086
ID10 ROUGE-2 Eval 8.ID10 R:0.18359 P:0.18359 F:0.18359
ID10 ROUGE-2 Eval 9.ID10 R:0.21129 P:0.21212 F:0.21170
ID10 ROUGE-2 Eval 10.ID10 R:0.21553 P:0.21816 F:0.21684
---------------------------------------------
ID10 ROUGE-SU4 Average_R: 0.27248 (95%-conf.int. 0.25028 - 0.29471)
ID10 ROUGE-SU4 Average_P: 0.26882 (95%-conf.int. 0.24783 - 0.28996)
ID10 ROUGE-SU4 Average_F: 0.27062 (95%-conf.int. 0.24885 - 0.29232)
.............................................
ID10 ROUGE-SU4 Eval 1.ID10 R:0.23716 P:0.23276 F:0.23494
ID10 ROUGE-SU4 Eval 2.ID10 R:0.32502 P:0.32502 F:0.32502
ID10 ROUGE-SU4 Eval 3.ID10 R:0.26658 P:0.26272 F:0.26464
ID10 ROUGE-SU4 Eval 4.ID10 R:0.29835 P:0.29188 F:0.29508
ID10 ROUGE-SU4 Eval 5.ID10 R:0.31116 P:0.30341 F:0.30724
ID10 ROUGE-SU4 Eval 6.ID10 R:0.28118 P:0.26730 F:0.27406
ID10 ROUGE-SU4 Eval 7.ID10 R:0.29912 P:0.29482 F:0.29695
ID10 ROUGE-SU4 Eval 8.ID10 R:0.22171 P:0.22171 F:0.22171
ID10 ROUGE-SU4 Eval 9.ID10 R:0.23602 P:0.23696 F:0.23649
ID10 ROUGE-SU4 Eval 10.ID10 R:0.24978 P:0.25284 F:0.25130
---------------------------------------------
ID2 ROUGE-1 Average_R: 0.46481 (95%-conf.int. 0.43685 - 0.49265)
ID2 ROUGE-1 Average_P: 0.45655 (95%-conf.int. 0.42712 - 0.48557)
ID2 ROUGE-1 Average_F: 0.46062 (95%-conf.int. 0.43222 - 0.48921)
.............................................
ID2 ROUGE-1 Eval 1.ID2 R:0.48797 P:0.48667 F:0.48732
ID2 ROUGE-1 Eval 2.ID2 R:0.45867 P:0.44444 F:0.45144
ID2 ROUGE-1 Eval 3.ID2 R:0.41215 P:0.40467 F:0.40838
ID2 ROUGE-1 Eval 4.ID2 R:0.45419 P:0.44955 F:0.45186
ID2 ROUGE-1 Eval 5.ID2 R:0.50399 P:0.49542 F:0.49967
ID2 ROUGE-1 Eval 6.ID2 R:0.42029 P:0.40278 F:0.41135
ID2 ROUGE-1 Eval 7.ID2 R:0.55832 P:0.55686 F:0.55759
ID2 ROUGE-1 Eval 8.ID2 R:0.40208 P:0.39141 F:0.39667
ID2 ROUGE-1 Eval 9.ID2 R:0.47451 P:0.46899 F:0.47173
ID2 ROUGE-1 Eval 10.ID2 R:0.47733 P:0.46615 F:0.47167
---------------------------------------------
ID2 ROUGE-2 Average_R: 0.17052 (95%-conf.int. 0.13907 - 0.19926)
ID2 ROUGE-2 Average_P: 0.16779 (95%-conf.int. 0.13603 - 0.19769)
ID2 ROUGE-2 Average_F: 0.16914 (95%-conf.int. 0.13747 - 0.19853)
.............................................
ID2 ROUGE-2 Eval 1.ID2 R:0.21745 P:0.21687 F:0.21716
ID2 ROUGE-2 Eval 2.ID2 R:0.16332 P:0.15824 F:0.16074
ID2 ROUGE-2 Eval 3.ID2 R:0.12599 P:0.12370 F:0.12483
ID2 ROUGE-2 Eval 4.ID2 R:0.17876 P:0.17692 F:0.17784
ID2 ROUGE-2 Eval 5.ID2 R:0.20427 P:0.20079 F:0.20252
ID2 ROUGE-2 Eval 6.ID2 R:0.11243 P:0.10773 F:0.11003
ID2 ROUGE-2 Eval 7.ID2 R:0.25395 P:0.25328 F:0.25361
ID2 ROUGE-2 Eval 8.ID2 R:0.08854 P:0.08619 F:0.08735
ID2 ROUGE-2 Eval 9.ID2 R:0.18110 P:0.17899 F:0.18004
ID2 ROUGE-2 Eval 10.ID2 R:0.18072 P:0.17647 F:0.17857
---------------------------------------------
ID2 ROUGE-SU4 Average_R: 0.20220 (95%-conf.int. 0.18010 - 0.22260)
ID2 ROUGE-SU4 Average_P: 0.19868 (95%-conf.int. 0.17605 - 0.21990)
ID2 ROUGE-SU4 Average_F: 0.20042 (95%-conf.int. 0.17805 - 0.22140)
.............................................
ID2 ROUGE-SU4 Eval 1.ID2 R:0.22523 P:0.22462 F:0.22492
ID2 ROUGE-SU4 Eval 2.ID2 R:0.20350 P:0.19713 F:0.20026
ID2 ROUGE-SU4 Eval 3.ID2 R:0.16400 P:0.16099 F:0.16248
ID2 ROUGE-SU4 Eval 4.ID2 R:0.20122 P:0.19914 F:0.20017
ID2 ROUGE-SU4 Eval 5.ID2 R:0.22760 P:0.22369 F:0.22563
ID2 ROUGE-SU4 Eval 6.ID2 R:0.17355 P:0.16624 F:0.16982
ID2 ROUGE-SU4 Eval 7.ID2 R:0.26909 P:0.26838 F:0.26873
ID2 ROUGE-SU4 Eval 8.ID2 R:0.14111 P:0.13733 F:0.13919
ID2 ROUGE-SU4 Eval 9.ID2 R:0.20454 P:0.20213 F:0.20333
ID2 ROUGE-SU4 Eval 10.ID2 R:0.21339 P:0.20833 F:0.21083
---------------------------------------------
ID3 ROUGE-1 Average_R: 0.43169 (95%-conf.int. 0.40377 - 0.46453)
ID3 ROUGE-1 Average_P: 0.47909 (95%-conf.int. 0.44958 - 0.51215)
ID3 ROUGE-1 Average_F: 0.45404 (95%-conf.int. 0.42616 - 0.48778)
.............................................
ID3 ROUGE-1 Eval 1.ID3 R:0.45187 P:0.48986 F:0.47010
ID3 ROUGE-1 Eval 2.ID3 R:0.44533 P:0.50837 F:0.47477
ID3 ROUGE-1 Eval 3.ID3 R:0.46235 P:0.49858 F:0.47978
ID3 ROUGE-1 Eval 4.ID3 R:0.37290 P:0.41168 F:0.39133
ID3 ROUGE-1 Eval 5.ID3 R:0.44947 P:0.47943 F:0.46397
ID3 ROUGE-1 Eval 6.ID3 R:0.40580 P:0.44063 F:0.42250
ID3 ROUGE-1 Eval 7.ID3 R:0.53997 P:0.58941 F:0.56361
ID3 ROUGE-1 Eval 8.ID3 R:0.36576 P:0.41964 F:0.39085
ID3 ROUGE-1 Eval 9.ID3 R:0.44183 P:0.52160 F:0.47841
ID3 ROUGE-1 Eval 10.ID3 R:0.38400 P:0.43439 F:0.40764
---------------------------------------------
ID3 ROUGE-2 Average_R: 0.17330 (95%-conf.int. 0.13838 - 0.20856)
ID3 ROUGE-2 Average_P: 0.19256 (95%-conf.int. 0.15368 - 0.23050)
ID3 ROUGE-2 Average_F: 0.18237 (95%-conf.int. 0.14582 - 0.21849)
.............................................
ID3 ROUGE-2 Eval 1.ID3 R:0.19329 P:0.20961 F:0.20112
ID3 ROUGE-2 Eval 2.ID3 R:0.24096 P:0.27523 F:0.25696
ID3 ROUGE-2 Eval 3.ID3 R:0.19629 P:0.21173 F:0.20372
ID3 ROUGE-2 Eval 4.ID3 R:0.09067 P:0.10014 F:0.09517
ID3 ROUGE-2 Eval 5.ID3 R:0.18959 P:0.20228 F:0.19573
ID3 ROUGE-2 Eval 6.ID3 R:0.11111 P:0.12069 F:0.11570
ID3 ROUGE-2 Eval 7.ID3 R:0.27105 P:0.29598 F:0.28297
ID3 ROUGE-2 Eval 8.ID3 R:0.10938 P:0.12556 F:0.11691
ID3 ROUGE-2 Eval 9.ID3 R:0.20341 P:0.24031 F:0.22033
ID3 ROUGE-2 Eval 10.ID3 R:0.12985 P:0.14697 F:0.13788
---------------------------------------------
ID3 ROUGE-SU4 Average_R: 0.19927 (95%-conf.int. 0.17193 - 0.22844)
ID3 ROUGE-SU4 Average_P: 0.22148 (95%-conf.int. 0.19138 - 0.25241)
ID3 ROUGE-SU4 Average_F: 0.20973 (95%-conf.int. 0.18066 - 0.24007)
.............................................
ID3 ROUGE-SU4 Eval 1.ID3 R:0.20968 P:0.22752 F:0.21824
ID3 ROUGE-SU4 Eval 2.ID3 R:0.25000 P:0.28582 F:0.26671
ID3 ROUGE-SU4 Eval 3.ID3 R:0.22052 P:0.23799 F:0.22892
ID3 ROUGE-SU4 Eval 4.ID3 R:0.14233 P:0.15730 F:0.14944
ID3 ROUGE-SU4 Eval 5.ID3 R:0.20587 P:0.21975 F:0.21258
ID3 ROUGE-SU4 Eval 6.ID3 R:0.15912 P:0.17294 F:0.16574
ID3 ROUGE-SU4 Eval 7.ID3 R:0.28985 P:0.31669 F:0.30268
ID3 ROUGE-SU4 Eval 8.ID3 R:0.14133 P:0.16240 F:0.15113
ID3 ROUGE-SU4 Eval 9.ID3 R:0.21466 P:0.25391 F:0.23264
ID3 ROUGE-SU4 Eval 10.ID3 R:0.16173 P:0.18321 F:0.17180
---------------------------------------------
ID4 ROUGE-1 Average_R: 0.44423 (95%-conf.int. 0.40933 - 0.47228)
ID4 ROUGE-1 Average_P: 0.44966 (95%-conf.int. 0.41248 - 0.47787)
ID4 ROUGE-1 Average_F: 0.44691 (95%-conf.int. 0.41040 - 0.47523)
.............................................
ID4 ROUGE-1 Eval 1.ID4 R:0.44251 P:0.44669 F:0.44459
ID4 ROUGE-1 Eval 2.ID4 R:0.45200 P:0.45935 F:0.45565
ID4 ROUGE-1 Eval 3.ID4 R:0.45575 P:0.46559 F:0.46062
ID4 ROUGE-1 Eval 4.ID4 R:0.44645 P:0.45586 F:0.45111
ID4 ROUGE-1 Eval 5.ID4 R:0.50399 P:0.50736 F:0.50567
ID4 ROUGE-1 Eval 6.ID4 R:0.31621 P:0.30769 F:0.31189
ID4 ROUGE-1 Eval 7.ID4 R:0.47182 P:0.48000 F:0.47587
ID4 ROUGE-1 Eval 8.ID4 R:0.41634 P:0.42460 F:0.42043
ID4 ROUGE-1 Eval 9.ID4 R:0.43399 P:0.44624 F:0.44003
ID4 ROUGE-1 Eval 10.ID4 R:0.50267 P:0.50267 F:0.50267
---------------------------------------------
ID4 ROUGE-2 Average_R: 0.15170 (95%-conf.int. 0.12134 - 0.17808)
ID4 ROUGE-2 Average_P: 0.15369 (95%-conf.int. 0.12282 - 0.17942)
ID4 ROUGE-2 Average_F: 0.15269 (95%-conf.int. 0.12207 - 0.17868)
.............................................
ID4 ROUGE-2 Eval 1.ID4 R:0.14899 P:0.15041 F:0.14970
ID4 ROUGE-2 Eval 2.ID4 R:0.19009 P:0.19320 F:0.19163
ID4 ROUGE-2 Eval 3.ID4 R:0.15517 P:0.15854 F:0.15684
ID4 ROUGE-2 Eval 4.ID4 R:0.14249 P:0.14550 F:0.14398
ID4 ROUGE-2 Eval 5.ID4 R:0.22163 P:0.22312 F:0.22237
ID4 ROUGE-2 Eval 6.ID4 R:0.05423 P:0.05277 F:0.05349
ID4 ROUGE-2 Eval 7.ID4 R:0.17105 P:0.17403 F:0.17253
ID4 ROUGE-2 Eval 8.ID4 R:0.11458 P:0.11687 F:0.11571
ID4 ROUGE-2 Eval 9.ID4 R:0.13123 P:0.13495 F:0.13306
ID4 ROUGE-2 Eval 10.ID4 R:0.18742 P:0.18742 F:0.18742
---------------------------------------------
ID4 ROUGE-SU4 Average_R: 0.19083 (95%-conf.int. 0.16558 - 0.21300)
ID4 ROUGE-SU4 Average_P: 0.19320 (95%-conf.int. 0.16741 - 0.21507)
ID4 ROUGE-SU4 Average_F: 0.19200 (95%-conf.int. 0.16651 - 0.21403)
.............................................
ID4 ROUGE-SU4 Eval 1.ID4 R:0.18086 P:0.18258 F:0.18172
ID4 ROUGE-SU4 Eval 2.ID4 R:0.21900 P:0.22260 F:0.22079
ID4 ROUGE-SU4 Eval 3.ID4 R:0.19381 P:0.19804 F:0.19590
ID4 ROUGE-SU4 Eval 4.ID4 R:0.18470 P:0.18864 F:0.18665
ID4 ROUGE-SU4 Eval 5.ID4 R:0.25067 P:0.25237 F:0.25152
ID4 ROUGE-SU4 Eval 6.ID4 R:0.11607 P:0.11291 F:0.11447
ID4 ROUGE-SU4 Eval 7.ID4 R:0.21082 P:0.21451 F:0.21265
ID4 ROUGE-SU4 Eval 8.ID4 R:0.16164 P:0.16488 F:0.16324
ID4 ROUGE-SU4 Eval 9.ID4 R:0.16557 P:0.17029 F:0.16790
ID4 ROUGE-SU4 Eval 10.ID4 R:0.22507 P:0.22507 F:0.22507
---------------------------------------------
ID5 ROUGE-1 Average_R: 0.41092 (95%-conf.int. 0.38492 - 0.43766)
ID5 ROUGE-1 Average_P: 0.43513 (95%-conf.int. 0.41223 - 0.46197)
ID5 ROUGE-1 Average_F: 0.42243 (95%-conf.int. 0.39890 - 0.44843)
.............................................
ID5 ROUGE-1 Eval 1.ID5 R:0.38636 P:0.41168 F:0.39862
ID5 ROUGE-1 Eval 2.ID5 R:0.42400 P:0.40927 F:0.41650
ID5 ROUGE-1 Eval 3.ID5 R:0.43329 P:0.44626 F:0.43968
ID5 ROUGE-1 Eval 4.ID5 R:0.36516 P:0.42113 F:0.39115
ID5 ROUGE-1 Eval 5.ID5 R:0.43218 P:0.45518 F:0.44338
ID5 ROUGE-1 Eval 6.ID5 R:0.40448 P:0.40608 F:0.40528
ID5 ROUGE-1 Eval 7.ID5 R:0.48624 P:0.51743 F:0.50135
ID5 ROUGE-1 Eval 8.ID5 R:0.35798 P:0.38494 F:0.37097
ID5 ROUGE-1 Eval 9.ID5 R:0.36078 P:0.40889 F:0.38333
ID5 ROUGE-1 Eval 10.ID5 R:0.46000 P:0.49145 F:0.47521
---------------------------------------------
ID5 ROUGE-2 Average_R: 0.13605 (95%-conf.int. 0.11404 - 0.15508)
ID5 ROUGE-2 Average_P: 0.14404 (95%-conf.int. 0.12254 - 0.16386)
ID5 ROUGE-2 Average_F: 0.13985 (95%-conf.int. 0.11868 - 0.15947)
.............................................
ID5 ROUGE-2 Eval 1.ID5 R:0.12215 P:0.13019 F:0.12604
ID5 ROUGE-2 Eval 2.ID5 R:0.15127 P:0.14599 F:0.14858
ID5 ROUGE-2 Eval 3.ID5 R:0.14324 P:0.14754 F:0.14536
ID5 ROUGE-2 Eval 4.ID5 R:0.11528 P:0.13303 F:0.12352
ID5 ROUGE-2 Eval 5.ID5 R:0.18291 P:0.19269 F:0.18767
ID5 ROUGE-2 Eval 6.ID5 R:0.11111 P:0.11155 F:0.11133
ID5 ROUGE-2 Eval 7.ID5 R:0.18553 P:0.19748 F:0.19132
ID5 ROUGE-2 Eval 8.ID5 R:0.07552 P:0.08123 F:0.07827
ID5 ROUGE-2 Eval 9.ID5 R:0.12730 P:0.14435 F:0.13529
ID5 ROUGE-2 Eval 10.ID5 R:0.14726 P:0.15737 F:0.15215
---------------------------------------------
ID5 ROUGE-SU4 Average_R: 0.17475 (95%-conf.int. 0.15461 - 0.19578)
ID5 ROUGE-SU4 Average_P: 0.18503 (95%-conf.int. 0.16498 - 0.20611)
ID5 ROUGE-SU4 Average_F: 0.17964 (95%-conf.int. 0.15958 - 0.20004)
.............................................
ID5 ROUGE-SU4 Eval 1.ID5 R:0.15405 P:0.16427 F:0.15900
ID5 ROUGE-SU4 Eval 2.ID5 R:0.17453 P:0.16840 F:0.17141
ID5 ROUGE-SU4 Eval 3.ID5 R:0.19137 P:0.19716 F:0.19422
ID5 ROUGE-SU4 Eval 4.ID5 R:0.14342 P:0.16566 F:0.15374
ID5 ROUGE-SU4 Eval 5.ID5 R:0.20520 P:0.21624 F:0.21058
ID5 ROUGE-SU4 Eval 6.ID5 R:0.17000 P:0.17068 F:0.17034
ID5 ROUGE-SU4 Eval 7.ID5 R:0.23488 P:0.25012 F:0.24226
ID5 ROUGE-SU4 Eval 8.ID5 R:0.12189 P:0.13117 F:0.12636
ID5 ROUGE-SU4 Eval 9.ID5 R:0.15081 P:0.17116 F:0.16034
ID5 ROUGE-SU4 Eval 10.ID5 R:0.20238 P:0.21638 F:0.20915
---------------------------------------------
ID6 ROUGE-1 Average_R: 0.35470 (95%-conf.int. 0.31709 - 0.39003)
ID6 ROUGE-1 Average_P: 0.45122 (95%-conf.int. 0.39682 - 0.49485)
ID6 ROUGE-1 Average_F: 0.39617 (95%-conf.int. 0.35443 - 0.43233)
.............................................
ID6 ROUGE-1 Eval 1.ID6 R:0.32888 P:0.54667 F:0.41069
ID6 ROUGE-1 Eval 2.ID6 R:0.47467 P:0.53695 F:0.50389
ID6 ROUGE-1 Eval 3.ID6 R:0.24967 P:0.30000 F:0.27253
ID6 ROUGE-1 Eval 4.ID6 R:0.34581 P:0.42338 F:0.38068
ID6 ROUGE-1 Eval 5.ID6 R:0.35904 P:0.46632 F:0.40571
ID6 ROUGE-1 Eval 6.ID6 R:0.36232 P:0.47496 F:0.41106
ID6 ROUGE-1 Eval 7.ID6 R:0.40367 P:0.49123 F:0.44317
ID6 ROUGE-1 Eval 8.ID6 R:0.27237 P:0.32407 F:0.29598
ID6 ROUGE-1 Eval 9.ID6 R:0.39608 P:0.49754 F:0.44105
ID6 ROUGE-1 Eval 10.ID6 R:0.35733 P:0.45347 F:0.39970
---------------------------------------------
ID6 ROUGE-2 Average_R: 0.10655 (95%-conf.int. 0.07318 - 0.13602)
ID6 ROUGE-2 Average_P: 0.13670 (95%-conf.int. 0.09431 - 0.17623)
ID6 ROUGE-2 Average_F: 0.11937 (95%-conf.int. 0.08278 - 0.15155)
.............................................
ID6 ROUGE-2 Eval 1.ID6 R:0.13020 P:0.21700 F:0.16275
ID6 ROUGE-2 Eval 2.ID6 R:0.20482 P:0.23182 F:0.21749
ID6 ROUGE-2 Eval 3.ID6 R:0.03183 P:0.03828 F:0.03476
ID6 ROUGE-2 Eval 4.ID6 R:0.08161 P:0.10000 F:0.08987
ID6 ROUGE-2 Eval 5.ID6 R:0.11883 P:0.15451 F:0.13434
ID6 ROUGE-2 Eval 6.ID6 R:0.08598 P:0.11285 F:0.09760
ID6 ROUGE-2 Eval 7.ID6 R:0.14605 P:0.17788 F:0.16040
ID6 ROUGE-2 Eval 8.ID6 R:0.02865 P:0.03411 F:0.03114
ID6 ROUGE-2 Eval 9.ID6 R:0.13517 P:0.16997 F:0.15059
ID6 ROUGE-2 Eval 10.ID6 R:0.10442 P:0.13265 F:0.11685
---------------------------------------------
ID6 ROUGE-SU4 Average_R: 0.14570 (95%-conf.int. 0.11887 - 0.17103)
ID6 ROUGE-SU4 Average_P: 0.18648 (95%-conf.int. 0.14827 - 0.21792)
ID6 ROUGE-SU4 Average_F: 0.16312 (95%-conf.int. 0.13162 - 0.19008)
.............................................
ID6 ROUGE-SU4 Eval 1.ID6 R:0.15113 P:0.25302 F:0.18923
ID6 ROUGE-SU4 Eval 2.ID6 R:0.23518 P:0.26641 F:0.24982
ID6 ROUGE-SU4 Eval 3.ID6 R:0.07588 P:0.09137 F:0.08291
ID6 ROUGE-SU4 Eval 4.ID6 R:0.11973 P:0.14693 F:0.13194
ID6 ROUGE-SU4 Eval 5.ID6 R:0.15502 P:0.20198 F:0.17541
ID6 ROUGE-SU4 Eval 6.ID6 R:0.15002 P:0.19731 F:0.17045
ID6 ROUGE-SU4 Eval 7.ID6 R:0.18256 P:0.22267 F:0.20063
ID6 ROUGE-SU4 Eval 8.ID6 R:0.08170 P:0.09740 F:0.08886
ID6 ROUGE-SU4 Eval 9.ID6 R:0.16292 P:0.20521 F:0.18164
ID6 ROUGE-SU4 Eval 10.ID6 R:0.14488 P:0.18439 F:0.16226
---------------------------------------------
ID7 ROUGE-1 Average_R: 0.39586 (95%-conf.int. 0.36852 - 0.42342)
ID7 ROUGE-1 Average_P: 0.39530 (95%-conf.int. 0.37240 - 0.41922)
ID7 ROUGE-1 Average_F: 0.39547 (95%-conf.int. 0.37088 - 0.42115)
.............................................
ID7 ROUGE-1 Eval 1.ID7 R:0.44251 P:0.43438 F:0.43841
ID7 ROUGE-1 Eval 2.ID7 R:0.36533 P:0.35958 F:0.36243
ID7 ROUGE-1 Eval 3.ID7 R:0.40687 P:0.40580 F:0.40633
ID7 ROUGE-1 Eval 4.ID7 R:0.34710 P:0.34755 F:0.34732
ID7 ROUGE-1 Eval 5.ID7 R:0.38431 P:0.37339 F:0.37877
ID7 ROUGE-1 Eval 6.ID7 R:0.42029 P:0.40585 F:0.41294
ID7 ROUGE-1 Eval 7.ID7 R:0.44561 P:0.44796 F:0.44678
ID7 ROUGE-1 Eval 8.ID7 R:0.31258 P:0.34478 F:0.32789
ID7 ROUGE-1 Eval 9.ID7 R:0.38431 P:0.38735 F:0.38582
ID7 ROUGE-1 Eval 10.ID7 R:0.45067 P:0.44709 F:0.44887
---------------------------------------------
ID7 ROUGE-2 Average_R: 0.09662 (95%-conf.int. 0.07639 - 0.11762)
ID7 ROUGE-2 Average_P: 0.09612 (95%-conf.int. 0.07605 - 0.11675)
ID7 ROUGE-2 Average_F: 0.09635 (95%-conf.int. 0.07619 - 0.11719)
.............................................
ID7 ROUGE-2 Eval 1.ID7 R:0.12483 P:0.12253 F:0.12367
ID7 ROUGE-2 Eval 2.ID7 R:0.07497 P:0.07378 F:0.07437
ID7 ROUGE-2 Eval 3.ID7 R:0.15119 P:0.15079 F:0.15099
ID7 ROUGE-2 Eval 4.ID7 R:0.05440 P:0.05447 F:0.05443
ID7 ROUGE-2 Eval 5.ID7 R:0.08278 P:0.08042 F:0.08158
ID7 ROUGE-2 Eval 6.ID7 R:0.09921 P:0.09579 F:0.09747
ID7 ROUGE-2 Eval 7.ID7 R:0.11842 P:0.11905 F:0.11873
ID7 ROUGE-2 Eval 8.ID7 R:0.04167 P:0.04598 F:0.04372
ID7 ROUGE-2 Eval 9.ID7 R:0.08661 P:0.08730 F:0.08695
ID7 ROUGE-2 Eval 10.ID7 R:0.13253 P:0.13147 F:0.13200
---------------------------------------------
ID7 ROUGE-SU4 Average_R: 0.14507 (95%-conf.int. 0.12667 - 0.16408)
ID7 ROUGE-SU4 Average_P: 0.14460 (95%-conf.int. 0.12724 - 0.16293)
ID7 ROUGE-SU4 Average_F: 0.14480 (95%-conf.int. 0.12696 - 0.16359)
.............................................
ID7 ROUGE-SU4 Eval 1.ID7 R:0.17072 P:0.16755 F:0.16912
ID7 ROUGE-SU4 Eval 2.ID7 R:0.12736 P:0.12533 F:0.12634
ID7 ROUGE-SU4 Eval 3.ID7 R:0.19003 P:0.18953 F:0.18978
ID7 ROUGE-SU4 Eval 4.ID7 R:0.11647 P:0.11662 F:0.11654
ID7 ROUGE-SU4 Eval 5.ID7 R:0.13150 P:0.12772 F:0.12958
ID7 ROUGE-SU4 Eval 6.ID7 R:0.15313 P:0.14781 F:0.15042
ID7 ROUGE-SU4 Eval 7.ID7 R:0.15872 P:0.15957 F:0.15914
ID7 ROUGE-SU4 Eval 8.ID7 R:0.09218 P:0.10178 F:0.09674
ID7 ROUGE-SU4 Eval 9.ID7 R:0.12395 P:0.12494 F:0.12444
ID7 ROUGE-SU4 Eval 10.ID7 R:0.18688 P:0.18538 F:0.18613
---------------------------------------------
ID8 ROUGE-1 Average_R: 0.38714 (95%-conf.int. 0.35845 - 0.41583)
ID8 ROUGE-1 Average_P: 0.39265 (95%-conf.int. 0.36224 - 0.42161)
ID8 ROUGE-1 Average_F: 0.38985 (95%-conf.int. 0.36056 - 0.41825)
.............................................
ID8 ROUGE-1 Eval 1.ID8 R:0.43048 P:0.43280 F:0.43164
ID8 ROUGE-1 Eval 2.ID8 R:0.34400 P:0.34400 F:0.34400
ID8 ROUGE-1 Eval 3.ID8 R:0.31836 P:0.31878 F:0.31857
ID8 ROUGE-1 Eval 4.ID8 R:0.37290 P:0.36768 F:0.37027
ID8 ROUGE-1 Eval 5.ID8 R:0.42021 P:0.42818 F:0.42416
ID8 ROUGE-1 Eval 6.ID8 R:0.37286 P:0.38661 F:0.37961
ID8 ROUGE-1 Eval 7.ID8 R:0.40105 P:0.41975 F:0.41019
ID8 ROUGE-1 Eval 8.ID8 R:0.31907 P:0.32932 F:0.32411
ID8 ROUGE-1 Eval 9.ID8 R:0.44706 P:0.45059 F:0.44882
ID8 ROUGE-1 Eval 10.ID8 R:0.44533 P:0.44892 F:0.44712
---------------------------------------------
ID8 ROUGE-2 Average_R: 0.12144 (95%-conf.int. 0.09816 - 0.14456)
ID8 ROUGE-2 Average_P: 0.12298 (95%-conf.int. 0.10038 - 0.14589)
ID8 ROUGE-2 Average_F: 0.12219 (95%-conf.int. 0.09923 - 0.14500)
.............................................
ID8 ROUGE-2 Eval 1.ID8 R:0.16779 P:0.16869 F:0.16824
ID8 ROUGE-2 Eval 2.ID8 R:0.08835 P:0.08835 F:0.08835
ID8 ROUGE-2 Eval 3.ID8 R:0.07958 P:0.07968 F:0.07963
ID8 ROUGE-2 Eval 4.ID8 R:0.13601 P:0.13410 F:0.13505
ID8 ROUGE-2 Eval 5.ID8 R:0.13885 P:0.14150 F:0.14016
ID8 ROUGE-2 Eval 6.ID8 R:0.09921 P:0.10288 F:0.10101
ID8 ROUGE-2 Eval 7.ID8 R:0.11579 P:0.12121 F:0.11844
ID8 ROUGE-2 Eval 8.ID8 R:0.06380 P:0.06586 F:0.06481
ID8 ROUGE-2 Eval 9.ID8 R:0.16404 P:0.16534 F:0.16469
ID8 ROUGE-2 Eval 10.ID8 R:0.16064 P:0.16194 F:0.16129
---------------------------------------------
ID8 ROUGE-SU4 Average_R: 0.15660 (95%-conf.int. 0.13697 - 0.17654)
ID8 ROUGE-SU4 Average_P: 0.15874 (95%-conf.int. 0.13929 - 0.17853)
ID8 ROUGE-SU4 Average_F: 0.15765 (95%-conf.int. 0.13806 - 0.17755)
.............................................
ID8 ROUGE-SU4 Eval 1.ID8 R:0.20023 P:0.20131 F:0.20077
ID8 ROUGE-SU4 Eval 2.ID8 R:0.12399 P:0.12399 F:0.12399
ID8 ROUGE-SU4 Eval 3.ID8 R:0.11571 P:0.11586 F:0.11578
ID8 ROUGE-SU4 Eval 4.ID8 R:0.16841 P:0.16602 F:0.16721
ID8 ROUGE-SU4 Eval 5.ID8 R:0.17003 P:0.17329 F:0.17164
ID8 ROUGE-SU4 Eval 6.ID8 R:0.14248 P:0.14779 F:0.14509
ID8 ROUGE-SU4 Eval 7.ID8 R:0.15982 P:0.16736 F:0.16350
ID8 ROUGE-SU4 Eval 8.ID8 R:0.10878 P:0.11231 F:0.11052
ID8 ROUGE-SU4 Eval 9.ID8 R:0.19177 P:0.19330 F:0.19253
ID8 ROUGE-SU4 Eval 10.ID8 R:0.18464 P:0.18614 F:0.18539
---------------------------------------------
ID9 ROUGE-1 Average_R: 0.38105 (95%-conf.int. 0.35397 - 0.40782)
ID9 ROUGE-1 Average_P: 0.37726 (95%-conf.int. 0.34923 - 0.40629)
ID9 ROUGE-1 Average_F: 0.37910 (95%-conf.int. 0.35180 - 0.40679)
.............................................
ID9 ROUGE-1 Eval 1.ID9 R:0.32219 P:0.31137 F:0.31669
ID9 ROUGE-1 Eval 2.ID9 R:0.36800 P:0.34981 F:0.35867
ID9 ROUGE-1 Eval 3.ID9 R:0.37913 P:0.37963 F:0.37938
ID9 ROUGE-1 Eval 4.ID9 R:0.30323 P:0.30719 F:0.30520
ID9 ROUGE-1 Eval 5.ID9 R:0.39761 P:0.39708 F:0.39734
ID9 ROUGE-1 Eval 6.ID9 R:0.41897 P:0.41085 F:0.41487
ID9 ROUGE-1 Eval 7.ID9 R:0.42202 P:0.43106 F:0.42649
ID9 ROUGE-1 Eval 8.ID9 R:0.37873 P:0.38021 F:0.37947
ID9 ROUGE-1 Eval 9.ID9 R:0.44444 P:0.44099 F:0.44271
ID9 ROUGE-1 Eval 10.ID9 R:0.37733 P:0.36563 F:0.37139
---------------------------------------------
ID9 ROUGE-2 Average_R: 0.10962 (95%-conf.int. 0.09229 - 0.12519)
ID9 ROUGE-2 Average_P: 0.10841 (95%-conf.int. 0.09140 - 0.12424)
ID9 ROUGE-2 Average_F: 0.10900 (95%-conf.int. 0.09200 - 0.12464)
.............................................
ID9 ROUGE-2 Eval 1.ID9 R:0.06980 P:0.06744 F:0.06860
ID9 ROUGE-2 Eval 2.ID9 R:0.12985 P:0.12341 F:0.12655
ID9 ROUGE-2 Eval 3.ID9 R:0.13263 P:0.13280 F:0.13271
ID9 ROUGE-2 Eval 4.ID9 R:0.06347 P:0.06430 F:0.06388
ID9 ROUGE-2 Eval 5.ID9 R:0.10414 P:0.10400 F:0.10407
ID9 ROUGE-2 Eval 6.ID9 R:0.13492 P:0.13230 F:0.13360
ID9 ROUGE-2 Eval 7.ID9 R:0.11974 P:0.12231 F:0.12101
ID9 ROUGE-2 Eval 8.ID9 R:0.09245 P:0.09281 F:0.09263
ID9 ROUGE-2 Eval 9.ID9 R:0.14173 P:0.14062 F:0.14117
ID9 ROUGE-2 Eval 10.ID9 R:0.10843 P:0.10506 F:0.10672
---------------------------------------------
ID9 ROUGE-SU4 Average_R: 0.14805 (95%-conf.int. 0.13217 - 0.16348)
ID9 ROUGE-SU4 Average_P: 0.14655 (95%-conf.int. 0.13082 - 0.16230)
ID9 ROUGE-SU4 Average_F: 0.14728 (95%-conf.int. 0.13132 - 0.16296)
.............................................
ID9 ROUGE-SU4 Eval 1.ID9 R:0.10158 P:0.09813 F:0.09983
ID9 ROUGE-SU4 Eval 2.ID9 R:0.15252 P:0.14490 F:0.14861
ID9 ROUGE-SU4 Eval 3.ID9 R:0.17134 P:0.17157 F:0.17145
ID9 ROUGE-SU4 Eval 4.ID9 R:0.10821 P:0.10964 F:0.10892
ID9 ROUGE-SU4 Eval 5.ID9 R:0.14247 P:0.14228 F:0.14237
ID9 ROUGE-SU4 Eval 6.ID9 R:0.18220 P:0.17863 F:0.18040
ID9 ROUGE-SU4 Eval 7.ID9 R:0.16865 P:0.17230 F:0.17046
ID9 ROUGE-SU4 Eval 8.ID9 R:0.14111 P:0.14167 F:0.14139
ID9 ROUGE-SU4 Eval 9.ID9 R:0.15984 P:0.15858 F:0.15921
ID9 ROUGE-SU4 Eval 10.ID9 R:0.15341 P:0.14861 F:0.15097
