-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy pathdemo.log
46 lines (46 loc) · 2.1 KB
/
demo.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
+--------+-------------+---------+
| Method | Correlation | P value |
+========+=============+=========+
| BLEU | 0.139 | 0.721 |
+--------+-------------+---------+
+---------------+--------+-------------+---------+
| Model | Method | Correlation | P value |
+===============+========+=============+=========+
| glove | wms | 0.555 | 0.121 |
+---------------+--------+-------------+---------+
| glove | sms | 0.286 | 0.456 |
+---------------+--------+-------------+---------+
| glove | s+wms | 0.563 | 0.114 |
+---------------+--------+-------------+---------+
| bert | wms | 0.251 | 0.514 |
+---------------+--------+-------------+---------+
| bert | sms | 0.494 | 0.177 |
+---------------+--------+-------------+---------+
| bert | s+wms | 0.399 | 0.288 |
+---------------+--------+-------------+---------+
| elmo | wms | 0.598 | 0.089 |
+---------------+--------+-------------+---------+
| elmo | sms | 0.581 | 0.101 |
+---------------+--------+-------------+---------+
| elmo | s+wms | 0.615 | 0.078 |
+---------------+--------+-------------+---------+
| roberta-large | wms | 0.234 | 0.545 |
+---------------+--------+-------------+---------+
| roberta-large | sms | 0.451 | 0.224 |
+---------------+--------+-------------+---------+
| roberta-large | s+wms | 0.277 | 0.470 |
+---------------+--------+-------------+---------+
+--------------------+-------------+---------+
| Method | Correlation | P value |
+====================+=============+=========+
| BERTScore R score | 0.667 | 0.050 |
+--------------------+-------------+---------+
| BERTScore P score | 0.581 | 0.101 |
+--------------------+-------------+---------+
| BERTScore F1 score | 0.719 | 0.029 |
+--------------------+-------------+---------+
+---------+-------------+---------+
| Method | Correlation | P value |
+=========+=============+=========+
| ROUGE-L | 0.459 | 0.214 |
+---------+-------------+---------+