CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Fold - scored higher in this pairwise comparison

  4. Performance of Multilign(20) - scored lower in this pairwise comparison

  5. Compile and download dataset for Fold & Multilign(20) [.zip] - may take several seconds...


Overview

Metric Fold Multilign(20)
MCC 0.596 > 0.521
Average MCC ± 95% Confidence Intervals 0.583 ± 0.194 > 0.526 ± 0.210
Sensitivity 0.524 > 0.428
Positive Predictive Value 0.685 > 0.643
Total TP 174 > 142
Total TN 40910 < 40943
Total FP 94 > 86
Total FP CONTRA 11 > 8
Total FP INCONS 69 < 71
Total FP COMP 14 > 7
Total FN 158 < 190
P-value 1.95402773876e-08

^top




Performance plots


^top





Performance of Fold - scored higher in this pairwise comparison

1. Total counts & total scores for Fold

Total Base Pair Counts
Total TP 174
Total TN 40910
Total FP 94
Total FP CONTRA 11
Total FP INCONS 69
Total FP COMP 14
Total FN 158
Total Scores
MCC 0.596
Average MCC ± 95% Confidence Intervals 0.583 ± 0.194
Sensitivity 0.524
Positive Predictive Value 0.685
Nr of predictions 10

^top



2. Individual counts for Fold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2XXA_G 0.93 0.86 1.00 36 5115 0 0 0 0 6
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.57 0.48 0.69 20 3887 9 1 8 0 22
4A1C_3 0.68 0.57 0.82 31 7102 7 1 6 0 23
4A1C_2 0.14 0.15 0.14 5 11744 43 5 27 11 28
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.32 0.26 0.42 5 1263 7 1 6 0 14
4ENC_A 0.31 0.26 0.38 5 1313 8 1 7 0 14

^top



Performance of Multilign(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Multilign(20)

Total Base Pair Counts
Total TP 142
Total TN 40943
Total FP 86
Total FP CONTRA 8
Total FP INCONS 71
Total FP COMP 7
Total FN 190
Total Scores
MCC 0.521
Average MCC ± 95% Confidence Intervals 0.526 ± 0.210
Sensitivity 0.428
Positive Predictive Value 0.643
Nr of predictions 10

^top



2. Individual counts for Multilign(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2XXA_G 0.00 0.00 0.00 0 5139 12 1 11 0 42
3AMU_B 0.63 0.56 0.71 15 2982 8 0 6 2 12
3RKF_A 0.77 0.62 0.95 21 2189 1 0 1 0 13
3SD1_A 0.57 0.48 0.69 20 3887 9 1 8 0 22
4A1C_3 0.70 0.59 0.84 32 7102 6 0 6 0 22
4A1C_2 0.15 0.15 0.15 5 11747 33 3 26 4 28
4AOB_A 0.49 0.38 0.64 16 4346 10 1 8 1 26
4ENB_A 0.34 0.26 0.45 5 1264 6 1 5 0 14
4ENC_A 0.65 0.47 0.90 9 1316 1 1 0 0 10

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.