CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of HotKnots - scored higher in this pairwise comparison

  4. Performance of Murlet(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for HotKnots & Murlet(seed) [.zip] - may take several seconds...


Overview

Metric HotKnots Murlet(seed)
MCC 0.677 > 0.539
Average MCC ± 95% Confidence Intervals 0.730 ± 0.102 > 0.545 ± 0.074
Sensitivity 0.608 > 0.337
Positive Predictive Value 0.759 < 0.868
Total TP 476 > 264
Total TN 104172 < 104495
Total FP 196 > 46
Total FP CONTRA 26 > 5
Total FP INCONS 125 > 35
Total FP COMP 45 > 6
Total FN 307 < 519
P-value 5.19332990918e-08

^top




Performance plots


^top





Performance of HotKnots - scored higher in this pairwise comparison

1. Total counts & total scores for HotKnots

Total Base Pair Counts
Total TP 476
Total TN 104172
Total FP 196
Total FP CONTRA 26
Total FP INCONS 125
Total FP COMP 45
Total FN 307
Total Scores
MCC 0.677
Average MCC ± 95% Confidence Intervals 0.730 ± 0.102
Sensitivity 0.608
Positive Predictive Value 0.759
Nr of predictions 26

^top



2. Individual counts for HotKnots [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A 0.61 0.55 0.69 11 1524 5 0 5 0 9
2XKV_B 0.51 0.50 0.53 10 4541 23 0 9 14 10
2XXA_G 0.34 0.31 0.39 13 5118 20 1 19 0 29
3A3A_A 0.87 0.76 1.00 28 3627 0 0 0 0 9
3GX2_A 0.68 0.55 0.85 22 4345 5 0 4 1 18
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3JYX_4 0.32 0.30 0.33 10 12216 31 5 15 11 23
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NPB_A 0.78 0.65 0.94 30 6989 5 0 2 3 16
3O58_3 0.23 0.26 0.21 9 12360 34 10 24 0 26
3PDR_A 0.67 0.56 0.82 40 12831 11 0 9 2 32
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.64 0.52 0.79 22 3888 6 1 5 0 20
4A1C_2 0.14 0.15 0.14 5 11745 42 6 25 11 28
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.89 0.79 1.00 15 1260 0 0 0 0 4
4ENC_A 0.86 0.79 0.94 15 1310 1 1 0 0 4

^top



Performance of Murlet(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for Murlet(seed)

Total Base Pair Counts
Total TP 264
Total TN 104495
Total FP 46
Total FP CONTRA 5
Total FP INCONS 35
Total FP COMP 6
Total FN 519
Total Scores
MCC 0.539
Average MCC ± 95% Confidence Intervals 0.545 ± 0.074
Sensitivity 0.337
Positive Predictive Value 0.868
Nr of predictions 26

^top



2. Individual counts for Murlet(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.52 0.27 1.00 3 403 0 0 0 0 8
2KE6_A 0.66 0.53 0.83 10 1116 2 0 2 0 9
2KUR_A 0.63 0.48 0.83 10 1116 2 0 2 0 11
2KUU_A 0.63 0.48 0.83 10 1116 2 0 2 0 11
2KUV_A 0.85 0.73 1.00 16 1112 0 0 0 0 6
2KUW_A 0.84 0.76 0.94 16 1111 1 0 1 0 5
2L1F_A 0.82 0.75 0.90 18 2060 2 0 2 0 6
2L1F_B 0.80 0.72 0.90 18 2125 2 0 2 0 7
2L94_A 0.59 0.40 0.89 8 981 1 0 1 0 12
2LC8_A -0.01 0.00 0.00 0 1528 12 0 12 0 20
2XKV_B 0.45 0.20 1.00 4 4556 2 0 0 2 16
2XXA_G 0.38 0.14 1.00 6 5145 0 0 0 0 36
3A3A_A 0.57 0.32 1.00 12 3643 0 0 0 0 25
3GX2_A 0.59 0.35 1.00 14 4357 1 0 0 1 26
3IVN_B 0.53 0.39 0.75 12 2330 4 2 2 0 19
3JYX_4 0.23 0.09 0.60 3 12241 4 0 2 2 30
3LA5_A 0.58 0.41 0.82 14 2468 3 1 2 0 20
3NPB_A 0.49 0.28 0.87 13 7006 2 1 1 0 33
3O58_3 0.45 0.20 1.00 7 12396 0 0 0 0 28
3PDR_A 0.44 0.19 1.00 14 12866 0 0 0 0 58
3RKF_A 0.53 0.35 0.80 12 2196 3 1 2 0 22
3SD1_A 0.47 0.26 0.85 11 3903 2 0 2 0 31
4A1C_2 0.46 0.21 1.00 7 11774 0 0 0 0 26
4AOB_A 0.58 0.33 1.00 14 4357 1 0 0 1 28
4ENB_A 0.56 0.32 1.00 6 1269 0 0 0 0 13
4ENC_A 0.56 0.32 1.00 6 1320 0 0 0 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.