AIDA |
corrected ACE subset (uploaded) |
|
0.5626
|
0.585
|
0.5417
|
0.539
|
0.5703
|
0.5255
|
0.6103
|
0.5703
|
0.6747
|
0.6364
|
0.585
|
0.6978
|
0
|
0
|
0
|
0
|
0
|
0
|
27,319.6
|
0.2354
|
0
|
2016-09-29 16:15:45 |
1.2.4 |
AIDA |
corrected ACE subset (uploaded) |
Entity Recognition |
0.7249
|
0.6951
|
0.7575
|
0.7112
|
0.6932
|
0.7566
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0976
|
0
|
2016-09-29 16:15:45 |
1.2.4 |
AIDA |
corrected ACE subset (uploaded) |
D2KB |
0.5996
|
0.8021
|
0.4787
|
0.5394
|
0.7896
|
0.4237
|
0.6384
|
0.7896
|
0.5655
|
0.6972
|
0.8021
|
0.6166
|
0.16
|
0.16
|
0.16
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:15:45 |
1.2.4 |
Babelfy |
corrected ACE subset (uploaded) |
|
0.2923
|
0.2182
|
0.4425
|
0.2729
|
0.2062
|
0.434
|
0.295
|
0.2057
|
0.5541
|
0.3148
|
0.2177
|
0.568
|
0.16
|
0.16
|
0.16
|
0
|
0
|
0
|
1,706.04
|
0.3529
|
0
|
2016-09-29 16:05:10 |
1.2.4 |
Babelfy |
corrected ACE subset (uploaded) |
Entity Recognition |
0.4774
|
0.3564
|
0.7228
|
0.4805
|
0.3654
|
0.7505
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.3529
|
0
|
2016-09-29 16:05:10 |
1.2.4 |
Babelfy |
corrected ACE subset (uploaded) |
D2KB |
0.4913
|
0.7071
|
0.3764
|
0.4462
|
0.6613
|
0.3438
|
0.5262
|
0.6606
|
0.4503
|
0.5735
|
0.7062
|
0.4828
|
0.1667
|
0.2
|
0.1636
|
0.014
|
1
|
0.007
|
|
0
|
0
|
2016-09-29 16:05:10 |
1.2.4 |
DBpedia Spotlight |
corrected ACE subset (uploaded) |
|
0.4165
|
0.3744
|
0.4693
|
0.4223
|
0.3835
|
0.4961
|
0.4686
|
0.3835
|
0.6514
|
0.4624
|
0.3744
|
0.6045
|
0.16
|
0.16
|
0.16
|
0
|
0
|
0
|
257.48
|
0
|
0
|
2016-09-29 16:04:27 |
1.2.4 |
DBpedia Spotlight |
corrected ACE subset (uploaded) |
Entity Recognition |
0.5842
|
0.5251
|
0.6583
|
0.6102
|
0.555
|
0.7121
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:04:27 |
1.2.4 |
DBpedia Spotlight |
corrected ACE subset (uploaded) |
D2KB |
0.5022
|
0.8185
|
0.3622
|
0.4879
|
0.7929
|
0.3655
|
0.5866
|
0.7929
|
0.4956
|
0.5943
|
0.8185
|
0.4665
|
0.16
|
0.16
|
0.16
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:04:27 |
1.2.4 |
Dexter |
corrected ACE subset (uploaded) |
|
0.3773
|
0.4312
|
0.3354
|
0.4112
|
0.4515
|
0.3934
|
0.4651
|
0.4515
|
0.5098
|
0.4316
|
0.4312
|
0.432
|
0
|
0
|
0
|
0
|
0
|
0
|
4,846.12
|
0.5013
|
0
|
2016-09-29 16:06:22 |
1.2.4 |
Dexter |
corrected ACE subset (uploaded) |
Entity Recognition |
0.5317
|
0.5838
|
0.4882
|
0.5827
|
0.6317
|
0.5621
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:06:22 |
1.2.4 |
Dexter |
corrected ACE subset (uploaded) |
D2KB |
0.3786
|
0.8254
|
0.2457
|
0.4057
|
0.8306
|
0.2836
|
0.4922
|
0.8306
|
0.381
|
0.4575
|
0.8254
|
0.3164
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.5
|
0
|
2016-09-29 16:06:22 |
1.2.4 |
Entityclassifier.eu NER |
corrected ACE subset (uploaded) |
|
0.4015
|
0.333
|
0.5055
|
0.3844
|
0.3235
|
0.4907
|
0.4173
|
0.3235
|
0.6335
|
0.4406
|
0.333
|
0.6511
|
0.16
|
0.16
|
0.16
|
0
|
0
|
0
|
75.1304
|
0
|
2
|
2016-09-29 16:04:23 |
1.2.4 |
Entityclassifier.eu NER |
corrected ACE subset (uploaded) |
Entity Recognition |
0.7017
|
0.582
|
0.8835
|
0.6745
|
0.564
|
0.8645
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:04:23 |
1.2.4 |
Entityclassifier.eu NER |
corrected ACE subset (uploaded) |
D2KB |
0.515
|
0.6351
|
0.4331
|
0.4763
|
0.5803
|
0.4088
|
0.5422
|
0.5803
|
0.5298
|
0.594
|
0.6351
|
0.5578
|
0.16
|
0.16
|
0.16
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:04:23 |
1.2.4 |
FOX |
corrected ACE subset (uploaded) |
|
0.2456
|
0.2292
|
0.2646
|
0.3229
|
0.3149
|
0.3382
|
0.3219
|
0.3072
|
0.3542
|
0.2417
|
0.2163
|
0.2738
|
0.3277
|
0.354
|
0.3509
|
0.2629
|
0.3028
|
0.2324
|
10,054.56
|
0
|
0
|
2016-09-29 16:08:32 |
1.2.4 |
FOX |
corrected ACE subset (uploaded) |
Entity Recognition |
0.4386
|
0.4093
|
0.4724
|
0.5207
|
0.5056
|
0.5482
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:08:32 |
1.2.4 |
FOX |
corrected ACE subset (uploaded) |
D2KB |
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0.16
|
0.16
|
0.16
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:08:32 |
1.2.4 |
FRED |
corrected ACE subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:23:26 |
1.2.4 |
FREME NER |
corrected ACE subset (uploaded) |
|
0.4094
|
0.3753
|
0.4504
|
0.3969
|
0.3681
|
0.4463
|
0.4458
|
0.3681
|
0.587
|
0.4558
|
0.3753
|
0.5801
|
0
|
0
|
0
|
0
|
0
|
0
|
395.92
|
0.5323
|
0
|
2016-09-29 16:04:33 |
1.2.4 |
FREME NER |
corrected ACE subset (uploaded) |
Entity Recognition |
0.726
|
0.6501
|
0.822
|
0.7167
|
0.6561
|
0.8137
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.4263
|
0
|
2016-09-29 16:04:33 |
1.2.4 |
FREME NER |
corrected ACE subset (uploaded) |
D2KB |
0.453
|
0.5879
|
0.3685
|
0.429
|
0.5952
|
0.3466
|
0.5071
|
0.5952
|
0.4706
|
0.5253
|
0.5879
|
0.4746
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.3757
|
0
|
2016-09-29 16:04:33 |
1.2.4 |
Kea |
corrected ACE subset (uploaded) |
|
0.1476
|
0.1046
|
0.2504
|
0.1853
|
0.1365
|
0.3161
|
0.1986
|
0.1365
|
0.4197
|
0.158
|
0.1046
|
0.3225
|
0
|
0
|
0
|
0
|
0
|
0
|
2,725.68
|
0.5047
|
0
|
2016-09-29 16:05:52 |
1.2.4 |
Kea |
corrected ACE subset (uploaded) |
Entity Recognition |
0.3081
|
0.2184
|
0.5228
|
0.3511
|
0.2617
|
0.5855
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.5047
|
0
|
2016-09-29 16:05:52 |
1.2.4 |
Kea |
corrected ACE subset (uploaded) |
D2KB |
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0
|
0.16
|
0.16
|
0.16
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:05:52 |
1.2.4 |
NERD-ML |
corrected ACE subset (uploaded) |
|
0.4456
|
0.5188
|
0.3906
|
0.3973
|
0.4792
|
0.3777
|
0.4563
|
0.4792
|
0.484
|
0.5108
|
0.5188
|
0.503
|
0
|
0
|
0
|
0
|
0
|
0
|
152,860.5
|
0.1589
|
1
|
2016-09-29 17:06:14 |
1.2.4 |
NERD-ML |
corrected ACE subset (uploaded) |
Entity Recognition |
0.5891
|
0.657
|
0.5339
|
0.5522
|
0.6387
|
0.5578
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.1484
|
0
|
2016-09-29 17:06:14 |
1.2.4 |
NERD-ML |
corrected ACE subset (uploaded) |
D2KB |
0.5542
|
0.7901
|
0.4268
|
0.4785
|
0.6636
|
0.3877
|
0.5674
|
0.6636
|
0.5213
|
0.6483
|
0.7901
|
0.5497
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.0085
|
0
|
2016-09-29 17:06:14 |
1.2.4 |
TagMe 2 |
corrected ACE subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:04:22 |
1.2.4 |
WAT |
corrected ACE subset (uploaded) |
|
0.5625
|
0.5478
|
0.578
|
0.5325
|
0.5236
|
0.5652
|
0.6027
|
0.5236
|
0.7315
|
0.6311
|
0.5478
|
0.7444
|
0
|
0
|
0
|
0
|
0
|
0
|
1,855.04
|
0.1975
|
0
|
2016-09-29 16:05:10 |
1.2.4 |
WAT |
corrected ACE subset (uploaded) |
Entity Recognition |
0.7302
|
0.6328
|
0.863
|
0.7066
|
0.6201
|
0.8527
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0659
|
0
|
2016-09-29 16:05:10 |
1.2.4 |
WAT |
corrected ACE subset (uploaded) |
D2KB |
0.6185
|
0.8736
|
0.4787
|
0.577
|
0.8685
|
0.4454
|
0.6849
|
0.8685
|
0.5921
|
0.7229
|
0.8736
|
0.6166
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.1261
|
0
|
2016-09-29 16:05:10 |
1.2.4 |
xLisa |
corrected ACE subset (uploaded) |
|
0.3125
|
0.4113
|
0.252
|
0.327
|
0.4353
|
0.2981
|
0.3792
|
0.4353
|
0.3939
|
0.3628
|
0.4113
|
0.3245
|
0
|
0
|
0
|
0
|
0
|
0
|
4,179.32
|
0.249
|
0
|
2016-09-29 16:06:19 |
1.2.4 |
xLisa |
corrected ACE subset (uploaded) |
Entity Recognition |
0.4074
|
0.4355
|
0.3827
|
0.43
|
0.4691
|
0.4571
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.17
|
0
|
2016-09-29 16:06:19 |
1.2.4 |
xLisa |
corrected ACE subset (uploaded) |
D2KB |
0.4161
|
0.8341
|
0.2772
|
0.4072
|
0.7558
|
0.2956
|
0.4966
|
0.7558
|
0.4067
|
0.5
|
0.8341
|
0.357
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.023
|
0
|
2016-09-29 16:06:19 |
1.2.4 |
AIDA |
corrected AIDA subset (uploaded) |
|
0.5812
|
0.6184
|
0.5483
|
0.4485
|
0.4872
|
0.4257
|
0.5468
|
0.4872
|
0.7087
|
0.6904
|
0.6184
|
0.7815
|
0
|
0
|
0
|
0
|
0
|
0
|
25,855.32
|
0.1442
|
0
|
2016-09-29 16:15:23 |
1.2.4 |
AIDA |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.8685
|
0.9022
|
0.8373
|
0.7969
|
0.8428
|
0.7747
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0847
|
0
|
2016-09-29 16:15:23 |
1.2.4 |
AIDA |
corrected AIDA subset (uploaded) |
D2KB |
0.584
|
0.6972
|
0.5024
|
0.4397
|
0.6446
|
0.355
|
0.5665
|
0.6446
|
0.6039
|
0.7065
|
0.6972
|
0.716
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.1442
|
0
|
2016-09-29 16:15:23 |
1.2.4 |
Babelfy |
corrected AIDA subset (uploaded) |
|
0.439
|
0.3665
|
0.5472
|
0.296
|
0.2562
|
0.3732
|
0.3388
|
0.2561
|
0.6089
|
0.4981
|
0.3663
|
0.7782
|
0
|
0
|
0
|
0
|
0
|
0
|
1,671.76
|
0.3652
|
0
|
2016-09-29 16:05:48 |
1.2.4 |
Babelfy |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.6764
|
0.5648
|
0.8432
|
0.6042
|
0.5304
|
0.7539
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.3652
|
0
|
2016-09-29 16:05:48 |
1.2.4 |
Babelfy |
corrected AIDA subset (uploaded) |
D2KB |
0.5966
|
0.6954
|
0.5224
|
0.4058
|
0.5537
|
0.3383
|
0.5159
|
0.5533
|
0.5672
|
0.7181
|
0.695
|
0.7429
|
0.0032
|
0.04
|
0.0017
|
0.0079
|
1
|
0.004
|
|
0
|
0
|
2016-09-29 16:05:48 |
1.2.4 |
DBpedia Spotlight |
corrected AIDA subset (uploaded) |
|
0.5259
|
0.5383
|
0.5142
|
0.4118
|
0.404
|
0.4406
|
0.4844
|
0.404
|
0.714
|
0.6206
|
0.5383
|
0.7328
|
0
|
0
|
0
|
0
|
0
|
0
|
235.76
|
0
|
0
|
2016-09-29 16:04:27 |
1.2.4 |
DBpedia Spotlight |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.7189
|
0.7358
|
0.7028
|
0.6533
|
0.6474
|
0.6908
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:04:27 |
1.2.4 |
DBpedia Spotlight |
corrected AIDA subset (uploaded) |
D2KB |
0.5898
|
0.7901
|
0.4705
|
0.4764
|
0.7362
|
0.3742
|
0.6324
|
0.7362
|
0.6154
|
0.7255
|
0.7901
|
0.6706
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:04:27 |
1.2.4 |
Dexter |
corrected AIDA subset (uploaded) |
|
0.5348
|
0.6343
|
0.4623
|
0.409
|
0.4878
|
0.3633
|
0.5055
|
0.4878
|
0.5769
|
0.6463
|
0.6343
|
0.6588
|
0
|
0
|
0
|
0
|
0
|
0
|
3,615.28
|
0.5015
|
0
|
2016-09-29 16:06:10 |
1.2.4 |
Dexter |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.7562
|
0.8721
|
0.6675
|
0.6748
|
0.7991
|
0.6009
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:06:10 |
1.2.4 |
Dexter |
corrected AIDA subset (uploaded) |
D2KB |
0.4747
|
0.7212
|
0.3538
|
0.3764
|
0.6442
|
0.2855
|
0.5047
|
0.6442
|
0.4622
|
0.5935
|
0.7212
|
0.5042
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.5015
|
0
|
2016-09-29 16:06:10 |
1.2.4 |
Entityclassifier.eu NER |
corrected AIDA subset (uploaded) |
|
0.2824
|
0.3132
|
0.2571
|
0.3293
|
0.2919
|
0.3863
|
0.3758
|
0.2919
|
0.6363
|
0.3377
|
0.3132
|
0.3664
|
0
|
0
|
0
|
0
|
0
|
0
|
62.84
|
0
|
0
|
2016-09-29 16:04:22 |
1.2.4 |
Entityclassifier.eu NER |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.6606
|
0.7328
|
0.6014
|
0.7432
|
0.6559
|
0.874
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:04:22 |
1.2.4 |
Entityclassifier.eu NER |
corrected AIDA subset (uploaded) |
D2KB |
0.2917
|
0.4663
|
0.2123
|
0.3694
|
0.4602
|
0.3156
|
0.4533
|
0.4602
|
0.5309
|
0.367
|
0.4663
|
0.3025
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:04:22 |
1.2.4 |
FOX |
corrected AIDA subset (uploaded) |
|
0.5549
|
0.5616
|
0.5483
|
0.4469
|
0.4592
|
0.4426
|
0.4736
|
0.4448
|
0.5496
|
0.6245
|
0.5769
|
0.6807
|
0.278
|
0.4078
|
0.2454
|
0.3166
|
0.4762
|
0.2372
|
13,837.08
|
0
|
0
|
2016-09-29 16:10:07 |
1.2.4 |
FOX |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.926
|
0.9372
|
0.9151
|
0.8599
|
0.9014
|
0.8384
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:10:07 |
1.2.4 |
FOX |
corrected AIDA subset (uploaded) |
D2KB |
0.5427
|
0.5949
|
0.4988
|
0.4094
|
0.5011
|
0.3566
|
0.4365
|
0.4721
|
0.4527
|
0.6177
|
0.6071
|
0.6286
|
0.2389
|
0.3989
|
0.2058
|
0.2816
|
0.5158
|
0.1937
|
|
0
|
0
|
2016-09-29 16:10:07 |
1.2.4 |
FRED |
corrected AIDA subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:22:50 |
1.2.4 |
FREME NER |
corrected AIDA subset (uploaded) |
|
0.5623
|
0.5891
|
0.5377
|
0.4062
|
0.4205
|
0.4115
|
0.4964
|
0.4205
|
0.6555
|
0.6662
|
0.5891
|
0.7664
|
0
|
0
|
0
|
0
|
0
|
0
|
344.6
|
0.3617
|
0
|
2016-09-29 16:05:08 |
1.2.4 |
FREME NER |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.8277
|
0.8621
|
0.796
|
0.7259
|
0.7623
|
0.727
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.3183
|
0
|
2016-09-29 16:05:08 |
1.2.4 |
FREME NER |
corrected AIDA subset (uploaded) |
D2KB |
0.5811
|
0.7054
|
0.4941
|
0.4176
|
0.601
|
0.345
|
0.549
|
0.601
|
0.5565
|
0.7048
|
0.7054
|
0.7042
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.3617
|
0
|
2016-09-29 16:05:08 |
1.2.4 |
Kea |
corrected AIDA subset (uploaded) |
|
0.4289
|
0.431
|
0.4269
|
0.198
|
0.1677
|
0.2756
|
0.2224
|
0.1677
|
0.4293
|
0.5045
|
0.431
|
0.6084
|
0
|
0
|
0
|
0
|
0
|
0
|
1,102.2
|
0.5004
|
0
|
2016-09-29 16:05:18 |
1.2.4 |
Kea |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.5913
|
0.5906
|
0.592
|
0.3433
|
0.2913
|
0.4712
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.4994
|
0
|
2016-09-29 16:05:18 |
1.2.4 |
Kea |
corrected AIDA subset (uploaded) |
D2KB |
0.5108
|
0.801
|
0.375
|
0.2945
|
0.4596
|
0.2299
|
0.382
|
0.4596
|
0.3658
|
0.6411
|
0.801
|
0.5345
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.4976
|
0
|
2016-09-29 16:05:18 |
1.2.4 |
NERD-ML |
corrected AIDA subset (uploaded) |
|
0.5734
|
0.7045
|
0.4835
|
0.3393
|
0.3884
|
0.3236
|
0.4213
|
0.3884
|
0.5013
|
0.6967
|
0.7045
|
0.6891
|
0
|
0
|
0
|
0
|
0
|
0
|
153,133.1667
|
0.7706
|
1
|
2016-09-29 17:06:36 |
1.2.4 |
NERD-ML |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.6842
|
0.7997
|
0.5979
|
0.4755
|
0.505
|
0.4755
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.7335
|
0
|
2016-09-29 17:06:36 |
1.2.4 |
NERD-ML |
corrected AIDA subset (uploaded) |
D2KB |
0.6418
|
0.8472
|
0.5165
|
0.4185
|
0.5876
|
0.3489
|
0.5408
|
0.5876
|
0.5502
|
0.7878
|
0.8472
|
0.7361
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.1185
|
0
|
2016-09-29 17:06:36 |
1.2.4 |
TagMe 2 |
corrected AIDA subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:04:22 |
1.2.4 |
WAT |
corrected AIDA subset (uploaded) |
|
0.6162
|
0.6975
|
0.5519
|
0.469
|
0.6019
|
0.4224
|
0.5913
|
0.6019
|
0.6702
|
0.7393
|
0.6975
|
0.7866
|
0
|
0
|
0
|
0
|
0
|
0
|
1,706.8
|
0.2871
|
0
|
2016-09-29 16:05:37 |
1.2.4 |
WAT |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.8823
|
0.86
|
0.9057
|
0.8264
|
0.8038
|
0.8816
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0556
|
0
|
2016-09-29 16:05:37 |
1.2.4 |
WAT |
corrected AIDA subset (uploaded) |
D2KB |
0.6365
|
0.7607
|
0.5472
|
0.4932
|
0.7019
|
0.4089
|
0.6395
|
0.7019
|
0.6637
|
0.7701
|
0.7607
|
0.7798
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.0867
|
0
|
2016-09-29 16:05:37 |
1.2.4 |
xLisa |
corrected AIDA subset (uploaded) |
|
0.3337
|
0.3269
|
0.3408
|
0.2381
|
0.2332
|
0.2742
|
0.2747
|
0.2332
|
0.4669
|
0.3908
|
0.3269
|
0.4857
|
0
|
0
|
0
|
0
|
0
|
0
|
2,415.24
|
0.052
|
0
|
2016-09-29 16:05:37 |
1.2.4 |
xLisa |
corrected AIDA subset (uploaded) |
Entity Recognition |
0.4677
|
0.4581
|
0.4776
|
0.4286
|
0.4085
|
0.5063
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.052
|
0
|
2016-09-29 16:05:37 |
1.2.4 |
xLisa |
corrected AIDA subset (uploaded) |
D2KB |
0.424
|
0.639
|
0.3172
|
0.2813
|
0.486
|
0.2158
|
0.3789
|
0.486
|
0.3753
|
0.5295
|
0.639
|
0.4521
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.012
|
0
|
2016-09-29 16:05:37 |
1.2.4 |
AIDA |
corrected OKE subset (uploaded) |
|
0.6279
|
0.7431
|
0.5436
|
0.5563
|
0.7283
|
0.4911
|
0.6015
|
0.7283
|
0.5758
|
0.6864
|
0.7431
|
0.6378
|
0
|
0
|
0
|
0
|
0
|
0
|
22,755.9677
|
0.1809
|
0
|
2016-09-29 16:16:05 |
1.2.4 |
AIDA |
corrected OKE subset (uploaded) |
Entity Recognition |
0.7634
|
0.885
|
0.6711
|
0.6908
|
0.8644
|
0.6231
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0929
|
0
|
2016-09-29 16:16:05 |
1.2.4 |
AIDA |
corrected OKE subset (uploaded) |
D2KB |
0.6468
|
0.8837
|
0.5101
|
0.5774
|
0.8489
|
0.4639
|
0.6285
|
0.8489
|
0.5371
|
0.7136
|
0.8837
|
0.5984
|
0.5806
|
0.5806
|
0.5806
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:16:05 |
1.2.4 |
Babelfy |
corrected OKE subset (uploaded) |
|
0.4419
|
0.5
|
0.396
|
0.3825
|
0.5014
|
0.3808
|
0.4184
|
0.5005
|
0.449
|
0.4754
|
0.4957
|
0.4567
|
0.5806
|
0.5806
|
0.5806
|
0
|
0
|
0
|
357.7419
|
0.6471
|
0
|
2016-09-29 16:04:30 |
1.2.4 |
Babelfy |
corrected OKE subset (uploaded) |
Entity Recognition |
0.5522
|
0.6218
|
0.4966
|
0.4956
|
0.634
|
0.4933
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.6377
|
0
|
2016-09-29 16:04:30 |
1.2.4 |
Babelfy |
corrected OKE subset (uploaded) |
D2KB |
0.6192
|
0.8222
|
0.4966
|
0.5715
|
0.7909
|
0.478
|
0.6324
|
0.7909
|
0.5755
|
0.6759
|
0.8202
|
0.5748
|
0.6129
|
0.6129
|
0.6129
|
0.087
|
1
|
0.0455
|
|
0
|
0
|
2016-09-29 16:04:30 |
1.2.4 |
DBpedia Spotlight |
corrected OKE subset (uploaded) |
|
0.4906
|
0.5603
|
0.4362
|
0.4368
|
0.5372
|
0.4096
|
0.4732
|
0.5372
|
0.4709
|
0.535
|
0.5603
|
0.5118
|
0.5806
|
0.5806
|
0.5806
|
0
|
0
|
0
|
163
|
0
|
0
|
2016-09-29 16:04:24 |
1.2.4 |
DBpedia Spotlight |
corrected OKE subset (uploaded) |
Entity Recognition |
0.634
|
0.7241
|
0.5638
|
0.5728
|
0.7017
|
0.533
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:04:24 |
1.2.4 |
DBpedia Spotlight |
corrected OKE subset (uploaded) |
D2KB |
0.5283
|
0.8889
|
0.3758
|
0.4555
|
0.7183
|
0.3612
|
0.4989
|
0.7183
|
0.4147
|
0.5895
|
0.8889
|
0.4409
|
0.5806
|
0.5806
|
0.5806
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:04:24 |
1.2.4 |
Dexter |
corrected OKE subset (uploaded) |
|
0.5254
|
0.7126
|
0.4161
|
0.4898
|
0.6478
|
0.4296
|
0.5469
|
0.6478
|
0.5169
|
0.5794
|
0.7126
|
0.4882
|
0
|
0
|
0
|
0
|
0
|
0
|
3,254.3226
|
0.5645
|
0
|
2016-09-29 16:06:03 |
1.2.4 |
Dexter |
corrected OKE subset (uploaded) |
Entity Recognition |
0.6179
|
0.7835
|
0.5101
|
0.5756
|
0.7532
|
0.5094
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.5222
|
0
|
2016-09-29 16:06:03 |
1.2.4 |
Dexter |
corrected OKE subset (uploaded) |
D2KB |
0.5243
|
0.9474
|
0.3624
|
0.4934
|
0.8118
|
0.3883
|
0.555
|
0.8118
|
0.465
|
0.587
|
0.9474
|
0.4252
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.5476
|
0
|
2016-09-29 16:06:03 |
1.2.4 |
Entityclassifier.eu NER |
corrected OKE subset (uploaded) |
|
0.2966
|
0.305
|
0.2886
|
0.3133
|
0.3252
|
0.319
|
0.3385
|
0.3252
|
0.3764
|
0.3209
|
0.305
|
0.3386
|
0.5806
|
0.5806
|
0.5806
|
0
|
0
|
0
|
28.3871
|
0
|
0
|
2016-09-29 16:04:23 |
1.2.4 |
Entityclassifier.eu NER |
corrected OKE subset (uploaded) |
Entity Recognition |
0.669
|
0.6879
|
0.651
|
0.6628
|
0.7101
|
0.6638
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:04:23 |
1.2.4 |
Entityclassifier.eu NER |
corrected OKE subset (uploaded) |
D2KB |
0.338
|
0.5625
|
0.2416
|
0.3428
|
0.5478
|
0.2687
|
0.3754
|
0.5478
|
0.3119
|
0.377
|
0.5625
|
0.2835
|
0.5806
|
0.5806
|
0.5806
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:04:23 |
1.2.4 |
FOX |
corrected OKE subset (uploaded) |
|
0.5166
|
0.5738
|
0.4698
|
0.4639
|
0.5178
|
0.4398
|
0.4966
|
0.5642
|
0.4858
|
0.5726
|
0.6262
|
0.5276
|
0.4892
|
0.5054
|
0.4806
|
0.1622
|
0.2
|
0.1364
|
8,695.0323
|
0
|
0
|
2016-09-29 16:08:52 |
1.2.4 |
FOX |
corrected OKE subset (uploaded) |
Entity Recognition |
0.8118
|
0.9016
|
0.7383
|
0.764
|
0.9077
|
0.7019
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:08:52 |
1.2.4 |
FOX |
corrected OKE subset (uploaded) |
D2KB |
0.5083
|
0.6703
|
0.4094
|
0.4566
|
0.5957
|
0.3843
|
0.4753
|
0.6156
|
0.4134
|
0.5577
|
0.716
|
0.4567
|
0.586
|
0.6022
|
0.5774
|
0.1875
|
0.3
|
0.1364
|
|
0
|
0
|
2016-09-29 16:08:52 |
1.2.4 |
FRED |
corrected OKE subset (uploaded) |
|
0.2947
|
0.1995
|
0.5638
|
0.2971
|
0.2102
|
0.5573
|
0.5041
|
0.5947
|
0.5059
|
0.5664
|
0.6465
|
0.5039
|
0.1446
|
0.1059
|
0.4194
|
0.1163
|
0.0621
|
0.9091
|
43,449.2
|
0
|
1
|
2016-09-29 16:26:42 |
1.2.4 |
FRED |
corrected OKE subset (uploaded) |
Entity Recognition |
0.4912
|
0.3325
|
0.9396
|
0.4994
|
0.3532
|
0.9409
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:26:42 |
1.2.4 |
FRED |
corrected OKE subset (uploaded) |
D2KB |
0.4943
|
0.5702
|
0.4362
|
0.4874
|
0.5597
|
0.4573
|
0.4939
|
0.679
|
0.4207
|
0.5543
|
0.8947
|
0.4016
|
0.4269
|
0.4216
|
0.4968
|
0.3544
|
0.2456
|
0.6364
|
|
0
|
0
|
2016-09-29 16:26:42 |
1.2.4 |
FREME NER |
corrected OKE subset (uploaded) |
|
0.5201
|
0.5726
|
0.4765
|
0.4826
|
0.534
|
0.4664
|
0.5123
|
0.534
|
0.5316
|
0.5657
|
0.5726
|
0.5591
|
0
|
0
|
0
|
0
|
0
|
0
|
193.6774
|
0.4451
|
0
|
2016-09-29 16:04:30 |
1.2.4 |
FREME NER |
corrected OKE subset (uploaded) |
Entity Recognition |
0.7709
|
0.8413
|
0.7114
|
0.7314
|
0.833
|
0.6981
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:04:30 |
1.2.4 |
FREME NER |
corrected OKE subset (uploaded) |
D2KB |
0.5417
|
0.7143
|
0.4362
|
0.5124
|
0.675
|
0.4344
|
0.5454
|
0.675
|
0.497
|
0.5963
|
0.7143
|
0.5118
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.4451
|
0
|
2016-09-29 16:04:30 |
1.2.4 |
Kea |
corrected OKE subset (uploaded) |
|
0.4971
|
0.4328
|
0.5839
|
0.5024
|
0.502
|
0.5789
|
0.563
|
0.502
|
0.6893
|
0.5305
|
0.4328
|
0.685
|
0
|
0
|
0
|
0
|
0
|
0
|
687.6774
|
0.5093
|
0
|
2016-09-29 16:04:46 |
1.2.4 |
Kea |
corrected OKE subset (uploaded) |
Entity Recognition |
0.685
|
0.5458
|
0.9195
|
0.6996
|
0.6074
|
0.9198
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.4868
|
0
|
2016-09-29 16:04:46 |
1.2.4 |
Kea |
corrected OKE subset (uploaded) |
D2KB |
0.6744
|
0.7982
|
0.5839
|
0.6499
|
0.7962
|
0.5763
|
0.716
|
0.7962
|
0.6979
|
0.7373
|
0.7982
|
0.685
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.4481
|
0
|
2016-09-29 16:04:46 |
1.2.4 |
NERD-ML |
corrected OKE subset (uploaded) |
|
0.5743
|
0.5649
|
0.5839
|
0.5367
|
0.5356
|
0.574
|
0.5696
|
0.5356
|
0.682
|
0.6192
|
0.5649
|
0.685
|
0
|
0
|
0
|
0
|
0
|
0
|
117,607.4667
|
0.1398
|
1
|
2016-09-29 17:03:46 |
1.2.4 |
NERD-ML |
corrected OKE subset (uploaded) |
Entity Recognition |
0.7368
|
0.6528
|
0.8456
|
0.7158
|
0.6538
|
0.8344
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0573
|
0
|
2016-09-29 17:03:46 |
1.2.4 |
NERD-ML |
corrected OKE subset (uploaded) |
D2KB |
0.6587
|
0.8058
|
0.557
|
0.6056
|
0.7196
|
0.543
|
0.6589
|
0.7196
|
0.6398
|
0.7217
|
0.8058
|
0.6535
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.0584
|
0
|
2016-09-29 17:03:46 |
1.2.4 |
TagMe 2 |
corrected OKE subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:04:30 |
1.2.4 |
WAT |
corrected OKE subset (uploaded) |
|
0.553
|
0.6348
|
0.4899
|
0.4773
|
0.5723
|
0.431
|
0.5268
|
0.5723
|
0.5229
|
0.6033
|
0.6348
|
0.5748
|
0
|
0
|
0
|
0
|
0
|
0
|
891.0645
|
0.1659
|
0
|
2016-09-29 16:04:57 |
1.2.4 |
WAT |
corrected OKE subset (uploaded) |
Entity Recognition |
0.79
|
0.8409
|
0.745
|
0.7538
|
0.858
|
0.7162
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0263
|
0
|
2016-09-29 16:04:57 |
1.2.4 |
WAT |
corrected OKE subset (uploaded) |
D2KB |
0.5872
|
0.8023
|
0.4631
|
0.5026
|
0.6976
|
0.4103
|
0.5511
|
0.6976
|
0.4869
|
0.6479
|
0.8023
|
0.5433
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.0641
|
0
|
2016-09-29 16:04:57 |
1.2.4 |
xLisa |
corrected OKE subset (uploaded) |
|
0.4837
|
0.4713
|
0.4966
|
0.4781
|
0.4995
|
0.5237
|
0.5174
|
0.4995
|
0.6193
|
0.5211
|
0.4713
|
0.5827
|
0
|
0
|
0
|
0
|
0
|
0
|
256.1613
|
0.305
|
0
|
2016-09-29 16:04:38 |
1.2.4 |
xLisa |
corrected OKE subset (uploaded) |
Entity Recognition |
0.5714
|
0.5535
|
0.5906
|
0.5783
|
0.5869
|
0.6357
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.301
|
0
|
2016-09-29 16:04:38 |
1.2.4 |
xLisa |
corrected OKE subset (uploaded) |
D2KB |
0.6862
|
0.9111
|
0.5503
|
0.6816
|
0.9011
|
0.5948
|
0.7618
|
0.9011
|
0.7171
|
0.7558
|
0.9111
|
0.6457
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.108
|
0
|
2016-09-29 16:04:38 |
1.2.4 |
AIDA |
orig. ACE subset (uploaded) |
|
0.2982
|
0.2279
|
0.4315
|
0.2613
|
0.2338
|
0.3318
|
0.2834
|
0.2338
|
0.4087
|
0.3238
|
0.2279
|
0.5592
|
0
|
0
|
0
|
0
|
0
|
0
|
28,601.32
|
0.6577
|
0
|
2016-09-29 16:16:26 |
1.2.4 |
AIDA |
orig. ACE subset (uploaded) |
Entity Recognition |
0.3228
|
0.2466
|
0.467
|
0.2797
|
0.2501
|
0.354
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.6577
|
0
|
2016-09-29 16:16:26 |
1.2.4 |
AIDA |
orig. ACE subset (uploaded) |
D2KB |
0.638
|
0.8062
|
0.5279
|
0.4831
|
0.6246
|
0.4032
|
0.7866
|
0.8646
|
0.7382
|
0.7402
|
0.8062
|
0.6842
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:16:26 |
1.2.4 |
Babelfy |
orig. ACE subset (uploaded) |
|
0.1743
|
0.1474
|
0.2132
|
0.1485
|
0.1453
|
0.1644
|
0.1595
|
0.1455
|
0.1945
|
0.1927
|
0.1479
|
0.2763
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
1,560.88
|
0.9737
|
0
|
2016-09-29 16:05:15 |
1.2.4 |
Babelfy |
orig. ACE subset (uploaded) |
Entity Recognition |
0.2213
|
0.1501
|
0.4213
|
0.2127
|
0.1862
|
0.3096
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.6831
|
0
|
2016-09-29 16:05:15 |
1.2.4 |
Babelfy |
orig. ACE subset (uploaded) |
D2KB |
0.5409
|
0.7107
|
0.4365
|
0.3945
|
0.5213
|
0.3315
|
0.5659
|
0.6402
|
0.5292
|
0.625
|
0.7083
|
0.5592
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
|
0.3539
|
0
|
2016-09-29 16:05:15 |
1.2.4 |
DBpedia Spotlight |
orig. ACE subset (uploaded) |
|
0.2276
|
0.142
|
0.5736
|
0.2186
|
0.1519
|
0.4532
|
0.2303
|
0.1519
|
0.5529
|
0.2384
|
0.142
|
0.7434
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
202.04
|
0
|
0
|
2016-09-29 16:04:44 |
1.2.4 |
DBpedia Spotlight |
orig. ACE subset (uploaded) |
Entity Recognition |
0.2981
|
0.1859
|
0.7513
|
0.3156
|
0.2197
|
0.8318
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:04:44 |
1.2.4 |
DBpedia Spotlight |
orig. ACE subset (uploaded) |
D2KB |
0.6355
|
0.8226
|
0.5178
|
0.5002
|
0.639
|
0.4184
|
0.5644
|
0.639
|
0.5135
|
0.7391
|
0.8226
|
0.6711
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:04:44 |
1.2.4 |
Dexter |
orig. ACE subset (uploaded) |
|
0.2394
|
0.1706
|
0.401
|
0.2403
|
0.2014
|
0.3349
|
0.2591
|
0.2014
|
0.4141
|
0.2569
|
0.1706
|
0.5197
|
0
|
0
|
0
|
0
|
0
|
0
|
4,440.48
|
0.503
|
0
|
2016-09-29 16:06:35 |
1.2.4 |
Dexter |
orig. ACE subset (uploaded) |
Entity Recognition |
0.2802
|
0.1921
|
0.5178
|
0.2964
|
0.2404
|
0.4277
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:06:35 |
1.2.4 |
Dexter |
orig. ACE subset (uploaded) |
D2KB |
0.5199
|
0.9
|
0.3655
|
0.4047
|
0.6695
|
0.2975
|
0.7027
|
0.9095
|
0.6051
|
0.6207
|
0.9
|
0.4737
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.5
|
0
|
2016-09-29 16:06:35 |
1.2.4 |
Entityclassifier.eu NER |
orig. ACE subset (uploaded) |
|
0.1705
|
0.1027
|
0.5025
|
0.1648
|
0.1096
|
0.4019
|
0.1709
|
0.1096
|
0.4809
|
0.1774
|
0.1027
|
0.6513
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
77.7391
|
0
|
2
|
2016-09-29 16:04:48 |
1.2.4 |
Entityclassifier.eu NER |
orig. ACE subset (uploaded) |
Entity Recognition |
0.2946
|
0.1774
|
0.868
|
0.2856
|
0.187
|
0.8883
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:04:48 |
1.2.4 |
Entityclassifier.eu NER |
orig. ACE subset (uploaded) |
D2KB |
0.5159
|
0.6014
|
0.4518
|
0.3911
|
0.4272
|
0.3632
|
0.4272
|
0.4272
|
0.4337
|
0.5933
|
0.6014
|
0.5855
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:04:48 |
1.2.4 |
FOX |
orig. ACE subset (uploaded) |
|
0.1419
|
0.09
|
0.335
|
0.1846
|
0.1423
|
0.3159
|
0.2024
|
0.1535
|
0.3483
|
0.1495
|
0.0929
|
0.3816
|
0.1357
|
0.1241
|
0.1963
|
0.1039
|
0.0734
|
0.1778
|
8,643.4
|
0
|
0
|
2016-09-29 16:08:24 |
1.2.4 |
FOX |
orig. ACE subset (uploaded) |
Entity Recognition |
0.2409
|
0.1528
|
0.5685
|
0.2718
|
0.2052
|
0.4724
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:08:24 |
1.2.4 |
FOX |
orig. ACE subset (uploaded) |
D2KB |
0
|
0
|
0
|
0
|
0
|
0
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:08:24 |
1.2.4 |
FRED |
orig. ACE subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:25:52 |
1.2.4 |
FREME NER |
orig. ACE subset (uploaded) |
|
0.2149
|
0.1371
|
0.4975
|
0.197
|
0.143
|
0.3674
|
0.2094
|
0.143
|
0.4546
|
0.2261
|
0.1371
|
0.6447
|
0
|
0
|
0
|
0
|
0
|
0
|
385.96
|
0.6222
|
0
|
2016-09-29 16:05:19 |
1.2.4 |
FREME NER |
orig. ACE subset (uploaded) |
Entity Recognition |
0.2895
|
0.1846
|
0.6701
|
0.2814
|
0.2075
|
0.5062
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.6222
|
0
|
2016-09-29 16:05:19 |
1.2.4 |
FREME NER |
orig. ACE subset (uploaded) |
D2KB |
0.6018
|
0.75
|
0.5025
|
0.4426
|
0.5483
|
0.3758
|
0.7409
|
0.7883
|
0.7087
|
0.6972
|
0.75
|
0.6513
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.3694
|
0
|
2016-09-29 16:05:19 |
1.2.4 |
Kea |
orig. ACE subset (uploaded) |
|
0.0713
|
0.0403
|
0.3096
|
0.0952
|
0.0603
|
0.2978
|
0.0987
|
0.0603
|
0.3622
|
0.0732
|
0.0403
|
0.4013
|
0
|
0
|
0
|
0
|
0
|
0
|
2,546.04
|
0.5047
|
0
|
2016-09-29 16:06:22 |
1.2.4 |
Kea |
orig. ACE subset (uploaded) |
Entity Recognition |
0.1411
|
0.0905
|
0.3198
|
0.1235
|
0.0882
|
0.233
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.5147
|
0
|
2016-09-29 16:06:22 |
1.2.4 |
Kea |
orig. ACE subset (uploaded) |
D2KB |
0
|
0
|
0
|
0
|
0
|
0
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:06:22 |
1.2.4 |
NERD-ML |
orig. ACE subset (uploaded) |
|
0.2687
|
0.2374
|
0.3096
|
0.2066
|
0.2229
|
0.2221
|
0.2312
|
0.2229
|
0.2716
|
0.2983
|
0.2374
|
0.4013
|
0
|
0
|
0
|
0
|
0
|
0
|
142,116
|
0.97
|
1
|
2016-09-29 17:02:07 |
1.2.4 |
NERD-ML |
orig. ACE subset (uploaded) |
Entity Recognition |
0.347
|
0.2743
|
0.4721
|
0.2769
|
0.2692
|
0.332
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.4196
|
0
|
2016-09-29 17:02:07 |
1.2.4 |
NERD-ML |
orig. ACE subset (uploaded) |
D2KB |
0.5355
|
0.7345
|
0.4213
|
0.3951
|
0.4988
|
0.3376
|
0.6814
|
0.7388
|
0.6437
|
0.6264
|
0.7345
|
0.5461
|
0.24
|
0.24
|
0.24
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 17:02:07 |
1.2.4 |
TagMe 2 |
orig. ACE subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:05:17 |
1.2.4 |
WAT |
orig. ACE subset (uploaded) |
|
0.2826
|
0.2213
|
0.3909
|
0.2913
|
0.3068
|
0.3446
|
0.3214
|
0.3068
|
0.4231
|
0.308
|
0.2213
|
0.5066
|
0
|
0
|
0
|
0
|
0
|
0
|
1,584.08
|
0.3639
|
0
|
2016-09-29 16:05:57 |
1.2.4 |
WAT |
orig. ACE subset (uploaded) |
Entity Recognition |
0.3105
|
0.2409
|
0.4365
|
0.3177
|
0.3299
|
0.3834
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.3594
|
0
|
2016-09-29 16:05:57 |
1.2.4 |
WAT |
orig. ACE subset (uploaded) |
D2KB |
0.6442
|
0.814
|
0.533
|
0.5045
|
0.6511
|
0.4199
|
0.5727
|
0.6511
|
0.5207
|
0.7473
|
0.814
|
0.6908
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.0422
|
0
|
2016-09-29 16:05:57 |
1.2.4 |
xLisa |
orig. ACE subset (uploaded) |
|
0.2662
|
0.2005
|
0.3959
|
0.2484
|
0.2166
|
0.3427
|
0.271
|
0.2166
|
0.4229
|
0.2884
|
0.2005
|
0.5132
|
0
|
0
|
0
|
0
|
0
|
0
|
4,080.88
|
0.249
|
0
|
2016-09-29 16:07:09 |
1.2.4 |
xLisa |
orig. ACE subset (uploaded) |
Entity Recognition |
0.3049
|
0.2161
|
0.5178
|
0.2818
|
0.226
|
0.427
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.208
|
0
|
2016-09-29 16:07:09 |
1.2.4 |
xLisa |
orig. ACE subset (uploaded) |
D2KB |
0.6941
|
0.8252
|
0.599
|
0.5352
|
0.6254
|
0.4819
|
0.7603
|
0.7854
|
0.7574
|
0.8
|
0.8252
|
0.7763
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.024
|
0
|
2016-09-29 16:07:09 |
1.2.4 |
AIDA |
orig. AIDA subset (uploaded) |
|
0.5733
|
0.6888
|
0.491
|
0.4644
|
0.6095
|
0.3824
|
0.6358
|
0.6095
|
0.7158
|
0.7301
|
0.6888
|
0.7766
|
0
|
0
|
0
|
0
|
0
|
0
|
26,519.76
|
0.1442
|
0
|
2016-09-29 16:16:39 |
1.2.4 |
AIDA |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.8584
|
0.9987
|
0.7526
|
0.7941
|
0.9987
|
0.6709
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:16:39 |
1.2.4 |
AIDA |
orig. AIDA subset (uploaded) |
D2KB |
0.576
|
0.6986
|
0.49
|
0.4687
|
0.6323
|
0.382
|
0.648
|
0.6323
|
0.715
|
0.7349
|
0.6986
|
0.7751
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.1442
|
0
|
2016-09-29 16:16:39 |
1.2.4 |
Babelfy |
orig. AIDA subset (uploaded) |
|
0.4281
|
0.3911
|
0.473
|
0.3095
|
0.3087
|
0.3267
|
0.3866
|
0.3082
|
0.5998
|
0.5121
|
0.3901
|
0.7451
|
0
|
0
|
0
|
0
|
0
|
0
|
1,163.16
|
0.3615
|
0
|
2016-09-29 16:06:52 |
1.2.4 |
Babelfy |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.7221
|
0.6512
|
0.8104
|
0.6858
|
0.6683
|
0.7323
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.3498
|
0
|
2016-09-29 16:06:52 |
1.2.4 |
Babelfy |
orig. AIDA subset (uploaded) |
D2KB |
0.5739
|
0.6796
|
0.4967
|
0.4416
|
0.5665
|
0.3685
|
0.5974
|
0.5659
|
0.6688
|
0.727
|
0.6788
|
0.7826
|
0.0039
|
0.04
|
0.0021
|
0.0103
|
1
|
0.0052
|
|
0
|
0
|
2016-09-29 16:06:52 |
1.2.4 |
DBpedia Spotlight |
orig. AIDA subset (uploaded) |
|
0.5072
|
0.584
|
0.4483
|
0.4136
|
0.4807
|
0.3731
|
0.5351
|
0.4807
|
0.6599
|
0.6405
|
0.584
|
0.7091
|
0
|
0
|
0
|
0
|
0
|
0
|
204.96
|
0
|
0
|
2016-09-29 16:05:43 |
1.2.4 |
DBpedia Spotlight |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.7389
|
0.8506
|
0.6531
|
0.684
|
0.8075
|
0.6104
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:05:43 |
1.2.4 |
DBpedia Spotlight |
orig. AIDA subset (uploaded) |
D2KB |
0.5583
|
0.7504
|
0.4445
|
0.4668
|
0.6788
|
0.3675
|
0.642
|
0.6788
|
0.644
|
0.726
|
0.7504
|
0.7031
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:05:43 |
1.2.4 |
Dexter |
orig. AIDA subset (uploaded) |
|
0.4848
|
0.6522
|
0.3858
|
0.3604
|
0.5162
|
0.2842
|
0.4947
|
0.5162
|
0.502
|
0.6305
|
0.6522
|
0.6102
|
0
|
0
|
0
|
0
|
0
|
0
|
2,817.68
|
0.5013
|
0
|
2016-09-29 16:07:10 |
1.2.4 |
Dexter |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.7019
|
0.9214
|
0.5668
|
0.6015
|
0.8686
|
0.4732
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:07:10 |
1.2.4 |
Dexter |
orig. AIDA subset (uploaded) |
D2KB |
0.4486
|
0.7143
|
0.327
|
0.3691
|
0.6439
|
0.2692
|
0.5364
|
0.6439
|
0.4808
|
0.6
|
0.7143
|
0.5172
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.5015
|
0
|
2016-09-29 16:07:10 |
1.2.4 |
Entityclassifier.eu NER |
orig. AIDA subset (uploaded) |
|
0.2696
|
0.3391
|
0.2237
|
0.308
|
0.3274
|
0.294
|
0.3892
|
0.3274
|
0.5358
|
0.3463
|
0.3391
|
0.3538
|
0
|
0
|
0
|
0
|
0
|
0
|
69.72
|
0
|
0
|
2016-09-29 16:05:51 |
1.2.4 |
Entityclassifier.eu NER |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.6648
|
0.8362
|
0.5517
|
0.7268
|
0.7538
|
0.7096
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:05:51 |
1.2.4 |
Entityclassifier.eu NER |
orig. AIDA subset (uploaded) |
D2KB |
0.2885
|
0.4633
|
0.2095
|
0.3395
|
0.4403
|
0.2795
|
0.4556
|
0.4403
|
0.5096
|
0.3864
|
0.4633
|
0.3313
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:05:51 |
1.2.4 |
FOX |
orig. AIDA subset (uploaded) |
|
0.5183
|
0.5894
|
0.4626
|
0.3993
|
0.5047
|
0.3393
|
0.4509
|
0.4749
|
0.45
|
0.6063
|
0.5912
|
0.6222
|
0.2409
|
0.5016
|
0.1644
|
0.284
|
0.5794
|
0.1881
|
12,336.48
|
0
|
0
|
2016-09-29 16:11:00 |
1.2.4 |
FOX |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.8752
|
0.9952
|
0.781
|
0.7849
|
0.996
|
0.6653
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:11:00 |
1.2.4 |
FOX |
orig. AIDA subset (uploaded) |
D2KB |
0.5155
|
0.5931
|
0.4559
|
0.3949
|
0.5087
|
0.3323
|
0.4578
|
0.4931
|
0.45
|
0.6112
|
0.6006
|
0.6222
|
0.2125
|
0.4476
|
0.1451
|
0.2598
|
0.55
|
0.1701
|
|
0
|
0
|
2016-09-29 16:11:00 |
1.2.4 |
FRED |
orig. AIDA subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:23:28 |
1.2.4 |
FREME NER |
orig. AIDA subset (uploaded) |
|
0.5156
|
0.612
|
0.4455
|
0.3716
|
0.465
|
0.3199
|
0.4974
|
0.465
|
0.557
|
0.6551
|
0.612
|
0.7046
|
0
|
0
|
0
|
0
|
0
|
0
|
268.2
|
0.3846
|
0
|
2016-09-29 16:06:44 |
1.2.4 |
FREME NER |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.8202
|
0.9606
|
0.7156
|
0.7366
|
0.9412
|
0.6269
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.2681
|
0
|
2016-09-29 16:06:44 |
1.2.4 |
FREME NER |
orig. AIDA subset (uploaded) |
D2KB |
0.5282
|
0.6527
|
0.4436
|
0.3894
|
0.5338
|
0.3208
|
0.5385
|
0.5338
|
0.561
|
0.6763
|
0.6527
|
0.7016
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.3686
|
0
|
2016-09-29 16:06:44 |
1.2.4 |
Kea |
orig. AIDA subset (uploaded) |
|
0.406
|
0.4874
|
0.3479
|
0.2194
|
0.2204
|
0.2297
|
0.27
|
0.2204
|
0.3956
|
0.5169
|
0.4874
|
0.5502
|
0
|
0
|
0
|
0
|
0
|
0
|
1,062.88
|
0.5044
|
0
|
2016-09-29 16:07:00 |
1.2.4 |
Kea |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.5907
|
0.6475
|
0.5431
|
0.3863
|
0.3585
|
0.4407
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.4979
|
0
|
2016-09-29 16:07:00 |
1.2.4 |
Kea |
orig. AIDA subset (uploaded) |
D2KB |
0.4718
|
0.7643
|
0.3412
|
0.288
|
0.4056
|
0.2284
|
0.3919
|
0.4056
|
0.3986
|
0.6327
|
0.7643
|
0.5397
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.4888
|
0
|
2016-09-29 16:07:00 |
1.2.4 |
NERD-ML |
orig. AIDA subset (uploaded) |
|
0.5304
|
0.7253
|
0.418
|
0.3289
|
0.4593
|
0.2709
|
0.449
|
0.4593
|
0.4551
|
0.6918
|
0.7253
|
0.6612
|
0
|
0
|
0
|
0
|
0
|
0
|
143,162.5217
|
0.7706
|
2
|
2016-09-29 17:02:03 |
1.2.4 |
NERD-ML |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.6981
|
0.7094
|
0.6872
|
0.5315
|
0.4987
|
0.5897
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.1035
|
0
|
2016-09-29 17:02:03 |
1.2.4 |
NERD-ML |
orig. AIDA subset (uploaded) |
D2KB |
0.6026
|
0.7972
|
0.4844
|
0.4106
|
0.5393
|
0.3424
|
0.5582
|
0.5393
|
0.5944
|
0.7813
|
0.7972
|
0.7661
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.1185
|
0
|
2016-09-29 17:02:03 |
1.2.4 |
TagMe 2 |
orig. AIDA subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:06:21 |
1.2.4 |
WAT |
orig. AIDA subset (uploaded) |
|
0.5919
|
0.6948
|
0.5156
|
0.4927
|
0.6481
|
0.418
|
0.6726
|
0.6481
|
0.7601
|
0.7503
|
0.6948
|
0.8156
|
0
|
0
|
0
|
0
|
0
|
0
|
1,268.44
|
0.1782
|
0
|
2016-09-29 16:07:25 |
1.2.4 |
WAT |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.8923
|
0.9617
|
0.8322
|
0.8524
|
0.9537
|
0.7828
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0393
|
0
|
2016-09-29 16:07:25 |
1.2.4 |
WAT |
orig. AIDA subset (uploaded) |
D2KB |
0.6173
|
0.7394
|
0.5299
|
0.5216
|
0.6917
|
0.4377
|
0.7139
|
0.6917
|
0.7908
|
0.7857
|
0.7394
|
0.8381
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.0782
|
0
|
2016-09-29 16:07:25 |
1.2.4 |
xLisa |
orig. AIDA subset (uploaded) |
|
0.3321
|
0.3643
|
0.3052
|
0.2721
|
0.2991
|
0.265
|
0.3406
|
0.2991
|
0.4963
|
0.4152
|
0.3643
|
0.4828
|
0
|
0
|
0
|
0
|
0
|
0
|
2,372.88
|
0.052
|
0
|
2016-09-29 16:07:37 |
1.2.4 |
xLisa |
orig. AIDA subset (uploaded) |
Entity Recognition |
0.5157
|
0.5656
|
0.4739
|
0.5079
|
0.5486
|
0.5031
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.052
|
0
|
2016-09-29 16:07:37 |
1.2.4 |
xLisa |
orig. AIDA subset (uploaded) |
D2KB |
0.4179
|
0.591
|
0.3232
|
0.3524
|
0.5063
|
0.28
|
0.4849
|
0.5063
|
0.5158
|
0.5482
|
0.591
|
0.5112
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.012
|
0
|
2016-09-29 16:07:37 |
1.2.4 |
AIDA |
orig. OKE subset (uploaded) |
|
0.5921
|
0.8036
|
0.4688
|
0.5445
|
0.8007
|
0.4449
|
0.5974
|
0.8007
|
0.5318
|
0.6569
|
0.8036
|
0.5556
|
0
|
0
|
0
|
0
|
0
|
0
|
20,328.5333
|
0.0929
|
0
|
2016-09-29 16:16:32 |
1.2.4 |
AIDA |
orig. OKE subset (uploaded) |
Entity Recognition |
0.7039
|
0.9554
|
0.5573
|
0.6516
|
0.9341
|
0.5365
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0929
|
0
|
2016-09-29 16:16:32 |
1.2.4 |
AIDA |
orig. OKE subset (uploaded) |
D2KB |
0.5959
|
0.87
|
0.4531
|
0.5403
|
0.8577
|
0.4262
|
0.5988
|
0.8577
|
0.502
|
0.6641
|
0.87
|
0.537
|
0.4667
|
0.4667
|
0.4667
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:16:32 |
1.2.4 |
Babelfy |
orig. OKE subset (uploaded) |
|
0.4156
|
0.5517
|
0.3333
|
0.3859
|
0.5637
|
0.3492
|
0.431
|
0.5628
|
0.4254
|
0.4549
|
0.5478
|
0.3889
|
0.4667
|
0.4667
|
0.4667
|
0
|
0
|
0
|
167.6667
|
0.6471
|
0
|
2016-09-29 16:06:40 |
1.2.4 |
Babelfy |
orig. OKE subset (uploaded) |
Entity Recognition |
0.5291
|
0.4955
|
0.5677
|
0.5023
|
0.5151
|
0.5855
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.3546
|
0
|
2016-09-29 16:06:40 |
1.2.4 |
Babelfy |
orig. OKE subset (uploaded) |
D2KB |
0.5743
|
0.8173
|
0.4427
|
0.5502
|
0.788
|
0.452
|
0.6158
|
0.788
|
0.5558
|
0.634
|
0.8155
|
0.5185
|
0.5
|
0.5
|
0.5
|
0.0645
|
1
|
0.0333
|
|
0
|
0
|
2016-09-29 16:06:40 |
1.2.4 |
DBpedia Spotlight |
orig. OKE subset (uploaded) |
|
0.4675
|
0.6207
|
0.375
|
0.4362
|
0.6347
|
0.3623
|
0.4852
|
0.6347
|
0.4352
|
0.518
|
0.6207
|
0.4444
|
0.4667
|
0.4667
|
0.4667
|
0
|
0
|
0
|
84.7
|
0
|
0
|
2016-09-29 16:06:43 |
1.2.4 |
DBpedia Spotlight |
orig. OKE subset (uploaded) |
Entity Recognition |
0.5844
|
0.7759
|
0.4688
|
0.5558
|
0.801
|
0.4609
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:06:43 |
1.2.4 |
DBpedia Spotlight |
orig. OKE subset (uploaded) |
D2KB |
0.4848
|
0.8889
|
0.3333
|
0.4347
|
0.7744
|
0.3214
|
0.4936
|
0.7744
|
0.3888
|
0.547
|
0.8889
|
0.3951
|
0.4667
|
0.4667
|
0.4667
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:06:43 |
1.2.4 |
Dexter |
orig. OKE subset (uploaded) |
|
0.4983
|
0.7423
|
0.375
|
0.5045
|
0.7721
|
0.3991
|
0.5834
|
0.7721
|
0.5068
|
0.556
|
0.7423
|
0.4444
|
0
|
0
|
0
|
0
|
0
|
0
|
324.8333
|
0.5114
|
0
|
2016-09-29 16:06:53 |
1.2.4 |
Dexter |
orig. OKE subset (uploaded) |
Entity Recognition |
0.5842
|
0.8586
|
0.4427
|
0.5717
|
0.8652
|
0.4554
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:06:53 |
1.2.4 |
Dexter |
orig. OKE subset (uploaded) |
D2KB |
0.5
|
0.9167
|
0.3438
|
0.4985
|
0.8861
|
0.3721
|
0.5809
|
0.8861
|
0.4772
|
0.5641
|
0.9167
|
0.4074
|
0.4667
|
0.4667
|
0.4667
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:06:53 |
1.2.4 |
Entityclassifier.eu NER |
orig. OKE subset (uploaded) |
|
0.3133
|
0.3714
|
0.2708
|
0.3128
|
0.3594
|
0.2873
|
0.3345
|
0.3594
|
0.339
|
0.3444
|
0.3714
|
0.321
|
0.4667
|
0.4667
|
0.4667
|
0
|
0
|
0
|
35.9333
|
0
|
0
|
2016-09-29 16:06:45 |
1.2.4 |
Entityclassifier.eu NER |
orig. OKE subset (uploaded) |
Entity Recognition |
0.6205
|
0.7357
|
0.5365
|
0.6156
|
0.7416
|
0.5539
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:06:45 |
1.2.4 |
Entityclassifier.eu NER |
orig. OKE subset (uploaded) |
D2KB |
0.3333
|
0.6111
|
0.2292
|
0.3178
|
0.5763
|
0.2362
|
0.3513
|
0.5763
|
0.2706
|
0.3761
|
0.6111
|
0.2716
|
0.4667
|
0.4667
|
0.4667
|
0
|
0
|
0
|
|
0
|
0
|
2016-09-29 16:06:45 |
1.2.4 |
FOX |
orig. OKE subset (uploaded) |
|
0.5048
|
0.6529
|
0.4115
|
0.4694
|
0.6126
|
0.394
|
0.5143
|
0.6736
|
0.4539
|
0.5672
|
0.717
|
0.4691
|
0.4722
|
0.4889
|
0.4633
|
0.1333
|
0.2
|
0.1
|
6,143.8333
|
0
|
0
|
2016-09-29 16:09:49 |
1.2.4 |
FOX |
orig. OKE subset (uploaded) |
Entity Recognition |
0.7604
|
0.9835
|
0.6198
|
0.7265
|
0.9892
|
0.6035
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:09:49 |
1.2.4 |
FOX |
orig. OKE subset (uploaded) |
D2KB |
0.5067
|
0.7037
|
0.3958
|
0.4587
|
0.6564
|
0.3709
|
0.4933
|
0.6698
|
0.4158
|
0.5615
|
0.7449
|
0.4506
|
0.4722
|
0.4889
|
0.4633
|
0.15
|
0.3
|
0.1
|
|
0
|
0
|
2016-09-29 16:09:49 |
1.2.4 |
FRED |
orig. OKE subset (uploaded) |
|
0.3191
|
0.2332
|
0.5052
|
0.3289
|
0.2524
|
0.5199
|
0.5329
|
0.7115
|
0.4857
|
0.5692
|
0.7551
|
0.4568
|
0.141
|
0.0941
|
0.4556
|
0.1322
|
0.0723
|
0.7667
|
41,115.8276
|
0
|
1
|
2016-09-29 16:26:52 |
1.2.4 |
FRED |
orig. OKE subset (uploaded) |
Entity Recognition |
0.5461
|
0.399
|
0.8646
|
0.5547
|
0.4228
|
0.8803
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:26:52 |
1.2.4 |
FRED |
orig. OKE subset (uploaded) |
D2KB |
0.4724
|
0.5746
|
0.401
|
0.4679
|
0.5556
|
0.4298
|
0.4909
|
0.725
|
0.4112
|
0.5263
|
0.9091
|
0.3704
|
0.3656
|
0.3551
|
0.4689
|
0.3469
|
0.25
|
0.5667
|
|
0
|
0
|
2016-09-29 16:26:52 |
1.2.4 |
FREME NER |
orig. OKE subset (uploaded) |
|
0.4952
|
0.6341
|
0.4062
|
0.4755
|
0.6124
|
0.4084
|
0.5193
|
0.6124
|
0.4878
|
0.5474
|
0.6341
|
0.4815
|
0
|
0
|
0
|
0
|
0
|
0
|
158.7333
|
0.4451
|
0
|
2016-09-29 16:06:57 |
1.2.4 |
FREME NER |
orig. OKE subset (uploaded) |
Entity Recognition |
0.7066
|
0.896
|
0.5833
|
0.6786
|
0.8841
|
0.585
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0
|
0
|
2016-09-29 16:06:57 |
1.2.4 |
FREME NER |
orig. OKE subset (uploaded) |
D2KB |
0.5153
|
0.7379
|
0.3958
|
0.4874
|
0.7008
|
0.401
|
0.5359
|
0.7008
|
0.4764
|
0.5736
|
0.7379
|
0.4691
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.4451
|
0
|
2016-09-29 16:06:57 |
1.2.4 |
Kea |
orig. OKE subset (uploaded) |
|
0.4907
|
0.4449
|
0.5469
|
0.5108
|
0.5182
|
0.5506
|
0.5698
|
0.5182
|
0.6692
|
0.5276
|
0.4449
|
0.6481
|
0
|
0
|
0
|
0
|
0
|
0
|
202.9
|
0.4924
|
0
|
2016-09-29 16:07:04 |
1.2.4 |
Kea |
orig. OKE subset (uploaded) |
Entity Recognition |
0.6652
|
0.5792
|
0.7812
|
0.6927
|
0.6419
|
0.8006
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.4731
|
0
|
2016-09-29 16:07:04 |
1.2.4 |
Kea |
orig. OKE subset (uploaded) |
D2KB |
0.6306
|
0.8115
|
0.5156
|
0.5987
|
0.7991
|
0.4987
|
0.6653
|
0.7991
|
0.6145
|
0.6972
|
0.8115
|
0.6111
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.4481
|
0
|
2016-09-29 16:07:04 |
1.2.4 |
NERD-ML |
orig. OKE subset (uploaded) |
|
0.5413
|
0.5975
|
0.4948
|
0.5294
|
0.6018
|
0.503
|
0.5748
|
0.6018
|
0.6257
|
0.5919
|
0.5975
|
0.5864
|
0
|
0
|
0
|
0
|
0
|
0
|
116,046.4828
|
0.1398
|
1
|
2016-09-29 17:03:36 |
1.2.4 |
NERD-ML |
orig. OKE subset (uploaded) |
Entity Recognition |
0.6787
|
0.6701
|
0.6875
|
0.6828
|
0.6887
|
0.7216
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0573
|
0
|
2016-09-29 17:03:36 |
1.2.4 |
NERD-ML |
orig. OKE subset (uploaded) |
D2KB |
0.625
|
0.8482
|
0.4948
|
0.5936
|
0.7947
|
0.506
|
0.6546
|
0.7947
|
0.6209
|
0.6934
|
0.8482
|
0.5864
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.0584
|
0
|
2016-09-29 17:03:36 |
1.2.4 |
TagMe 2 |
orig. OKE subset (uploaded) |
|
The annotator caused too many single errors. |
2016-09-29 16:07:05 |
1.2.4 |
WAT |
orig. OKE subset (uploaded) |
|
0.5407
|
0.7217
|
0.4323
|
0.5002
|
0.6894
|
0.4107
|
0.5607
|
0.6894
|
0.5126
|
0.5993
|
0.7217
|
0.5123
|
0
|
0
|
0
|
0
|
0
|
0
|
114.1
|
0.1659
|
0
|
2016-09-29 16:07:09 |
1.2.4 |
WAT |
orig. OKE subset (uploaded) |
Entity Recognition |
0.7312
|
0.9141
|
0.6094
|
0.696
|
0.897
|
0.5978
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.0485
|
0
|
2016-09-29 16:07:09 |
1.2.4 |
WAT |
orig. OKE subset (uploaded) |
D2KB |
0.5498
|
0.8081
|
0.4167
|
0.4948
|
0.7297
|
0.3928
|
0.5528
|
0.7297
|
0.477
|
0.613
|
0.8081
|
0.4938
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.0641
|
0
|
2016-09-29 16:07:09 |
1.2.4 |
xLisa |
orig. OKE subset (uploaded) |
|
0.4852
|
0.5028
|
0.4688
|
0.4781
|
0.5174
|
0.4909
|
0.5215
|
0.5174
|
0.6141
|
0.5279
|
0.5028
|
0.5556
|
0
|
0
|
0
|
0
|
0
|
0
|
270.6667
|
0.229
|
0
|
2016-09-29 16:07:18 |
1.2.4 |
xLisa |
orig. OKE subset (uploaded) |
Entity Recognition |
0.5449
|
0.5915
|
0.5052
|
0.5437
|
0.6194
|
0.5444
|
|
|
|
|
|
|
|
|
|
|
|
|
|
0.256
|
0
|
2016-09-29 16:07:18 |
1.2.4 |
xLisa |
orig. OKE subset (uploaded) |
D2KB |
0.6561
|
0.8443
|
0.5365
|
0.6462
|
0.8699
|
0.5636
|
0.7348
|
0.8699
|
0.6978
|
0.7254
|
0.8443
|
0.6358
|
0
|
0
|
0
|
0
|
0
|
0
|
|
0.033
|
0
|
2016-09-29 16:07:18 |
1.2.4 |