|
CoEPrA 2006
Comparative Evaluation of Prediction Algorithms
|
Results for Classification Problem 1
|
Winners: Wuju Li and Gavin Cawley, with identical AUROC, but
with different MCC (Matthews correlation coefficient): Wuju Li MCC = 0.7303
(prediction),
and Gavin Cawley MCC = 0.7273 (prediction).
All results are ranked after AUROC and then after MCC.
Rank | Group | Results | TP | TN | FP | FN | Se | Sp | Ac | MCC | AUROC |
1 | Wuju Li | Prediction | 40 | 36 | 8 | 4 | 0.9091 | 0.8182 | 0.8636 | 0.7303 | 0.8636 |
2 | Gavin Cawley | Prediction | 38 | 38 | 6 | 6 | 0.8636 | 0.8636 | 0.8636 | 0.7273 | 0.8636 |
3 | Mehdi Jalali Heravi | Prediction | 36 | 39 | 5 | 8 | 0.8182 | 0.8864 | 0.8523 | 0.7062 | 0.8523 |
4 | Matt Segall | Prediction | 39 | 35 | 9 | 5 | 0.8864 | 0.7955 | 0.8409 | 0.6847 | 0.8409 |
5 | Reiji Teramoto | Prediction | 40 | 33 | 11 | 4 | 0.9091 | 0.7500 | 0.8295 | 0.6676 | 0.8296 |
6 | Joao Aires-de-Sousa | Prediction | 38 | 35 | 9 | 6 | 0.8636 | 0.7955 | 0.8295 | 0.6606 | 0.8296 |
7 | Fatih Amasyali | Prediction | 32 | 40 | 4 | 12 | 0.7273 | 0.9091 | 0.8182 | 0.6472 | 0.8182 |
8 | Hendrik Blockeel | Prediction | 32 | 39 | 5 | 12 | 0.7273 | 0.8864 | 0.8068 | 0.6216 | 0.8068 |
9 | Levon Budagyan | Prediction | 38 | 33 | 11 | 6 | 0.8636 | 0.7500 | 0.8068 | 0.6176 | 0.8068 |
10 | David Farrelly | Prediction | 34 | 37 | 7 | 10 | 0.7727 | 0.8409 | 0.8068 | 0.6151 | 0.8068 |
11 | Wit Jakuczun | Prediction | 37 | 34 | 10 | 7 | 0.8409 | 0.7727 | 0.8068 | 0.6151 | 0.8068 |
12 | Scott Oloff | Prediction | 36 | 35 | 9 | 8 | 0.8182 | 0.7955 | 0.8068 | 0.6138 | 0.8068 |
13 | Robert Kirk DeLisle | Prediction | 35 | 35 | 9 | 9 | 0.7955 | 0.7955 | 0.7955 | 0.5909 | 0.7954 |
14 | Shikha Varma-O'Brien | Prediction | 35 | 33 | 11 | 9 | 0.7955 | 0.7500 | 0.7727 | 0.5460 | 0.7727 |
15 | Bart De Moor | Prediction | 30 | 37 | 7 | 14 | 0.6818 | 0.8409 | 0.7614 | 0.5295 | 0.7614 |
16 | Bhaskar Kulkarni | Prediction | 36 | 31 | 13 | 8 | 0.8182 | 0.7045 | 0.7614 | 0.5261 | 0.7614 |
17 | Curt Breneman | Prediction | 37 | 26 | 18 | 7 | 0.8409 | 0.5909 | 0.7159 | 0.4460 | 0.7159 |
18 | Elizabeth Jacob | Prediction | 29 | 33 | 11 | 15 | 0.6591 | 0.7500 | 0.7045 | 0.4108 | 0.7046 |
19 | Marco Gori | Prediction | 36 | 21 | 23 | 8 | 0.8182 | 0.4773 | 0.6477 | 0.3143 | 0.6477 |
20 | Effendi Widjaja | Prediction | 28 | 28 | 16 | 16 | 0.6364 | 0.6364 | 0.6364 | 0.2727 | 0.6364 |
21 | Alexander Zelikovsky | Prediction | 31 | 20 | 24 | 13 | 0.7045 | 0.4545 | 0.5795 | 0.1643 | 0.5796 |
22 | Walter Knapp | Prediction | 21 | 28 | 16 | 23 | 0.4773 | 0.6364 | 0.5568 | 0.1151 | 0.5568 |
23 | Artem Cherkasov | Prediction | 25 | 24 | 20 | 19 | 0.5682 | 0.5455 | 0.5568 | 0.1137 | 0.5568 |
|
|
|