CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of RNAalifold(20) - scored higher in this pairwise comparison

  4. Performance of Murlet(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for RNAalifold(20) & Murlet(seed) [.zip] - may take several seconds...


Overview

Metric RNAalifold(20) Murlet(seed)
MCC 0.595 > 0.491
Average MCC ± 95% Confidence Intervals 0.572 ± 0.090 > 0.494 ± 0.047
Sensitivity 0.436 > 0.269
Positive Predictive Value 0.817 < 0.901
Total TP 250 > 154
Total TN 89433 < 89568
Total FP 71 > 23
Total FP CONTRA 7 > 5
Total FP INCONS 49 > 12
Total FP COMP 15 > 6
Total FN 323 < 419
P-value 2.66715895098e-08

^top




Performance plots


^top





Performance of RNAalifold(20) - scored higher in this pairwise comparison

1. Total counts & total scores for RNAalifold(20)

Total Base Pair Counts
Total TP 250
Total TN 89433
Total FP 71
Total FP CONTRA 7
Total FP INCONS 49
Total FP COMP 15
Total FN 323
Total Scores
MCC 0.595
Average MCC ± 95% Confidence Intervals 0.572 ± 0.090
Sensitivity 0.436
Positive Predictive Value 0.817
Nr of predictions 17

^top



2. Individual counts for RNAalifold(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.60 0.36 1.00 4 402 0 0 0 0 7
2L94_A 0.53 0.50 0.59 10 973 7 0 7 0 10
2XKV_B 0.45 0.20 1.00 4 4556 3 0 0 3 16
2XXA_G 0.41 0.17 1.00 7 5144 0 0 0 0 35
3GX2_A 0.77 0.60 1.00 24 4347 1 0 0 1 16
3IVN_B 0.74 0.58 0.95 18 2327 1 1 0 0 13
3JYX_4 0.39 0.30 0.50 10 12226 15 0 10 5 23
3LA5_A 0.75 0.56 1.00 19 2466 0 0 0 0 15
3NPB_A 0.68 0.48 0.96 22 6998 3 1 0 2 24
3O58_3 0.37 0.26 0.53 9 12386 8 2 6 0 26
3PDR_A 0.76 0.61 0.96 44 12834 3 0 2 1 28
3RKF_A 0.68 0.50 0.94 17 2193 1 0 1 0 17
3SD1_A 0.70 0.60 0.83 25 3886 5 1 4 0 17
4A1C_2 0.17 0.15 0.19 5 11755 23 2 19 2 28
4AOB_A 0.72 0.52 1.00 22 4349 1 0 0 1 20
4ENB_A 0.46 0.21 1.00 4 1271 0 0 0 0 15
4ENC_A 0.56 0.32 1.00 6 1320 0 0 0 0 13

^top



Performance of Murlet(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for Murlet(seed)

Total Base Pair Counts
Total TP 154
Total TN 89568
Total FP 23
Total FP CONTRA 5
Total FP INCONS 12
Total FP COMP 6
Total FN 419
Total Scores
MCC 0.491
Average MCC ± 95% Confidence Intervals 0.494 ± 0.047
Sensitivity 0.269
Positive Predictive Value 0.901
Nr of predictions 17

^top



2. Individual counts for Murlet(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.52 0.27 1.00 3 403 0 0 0 0 8
2L94_A 0.59 0.40 0.89 8 981 1 0 1 0 12
2XKV_B 0.45 0.20 1.00 4 4556 2 0 0 2 16
2XXA_G 0.38 0.14 1.00 6 5145 0 0 0 0 36
3GX2_A 0.59 0.35 1.00 14 4357 1 0 0 1 26
3IVN_B 0.53 0.39 0.75 12 2330 4 2 2 0 19
3JYX_4 0.23 0.09 0.60 3 12241 4 0 2 2 30
3LA5_A 0.58 0.41 0.82 14 2468 3 1 2 0 20
3NPB_A 0.49 0.28 0.87 13 7006 2 1 1 0 33
3O58_3 0.45 0.20 1.00 7 12396 0 0 0 0 28
3PDR_A 0.44 0.19 1.00 14 12866 0 0 0 0 58
3RKF_A 0.53 0.35 0.80 12 2196 3 1 2 0 22
3SD1_A 0.47 0.26 0.85 11 3903 2 0 2 0 31
4A1C_2 0.46 0.21 1.00 7 11774 0 0 0 0 26
4AOB_A 0.58 0.33 1.00 14 4357 1 0 0 1 28
4ENB_A 0.56 0.32 1.00 6 1269 0 0 0 0 13
4ENC_A 0.56 0.32 1.00 6 1320 0 0 0 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.