CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Sfold - scored higher in this pairwise comparison

  4. Performance of RNAalifold(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for Sfold & RNAalifold(seed) [.zip] - may take several seconds...


Overview

Metric Sfold RNAalifold(seed)
MCC 0.629 > 0.593
Average MCC ± 95% Confidence Intervals 0.697 ± 0.089 > 0.597 ± 0.088
Sensitivity 0.544 > 0.397
Positive Predictive Value 0.730 < 0.887
Total TP 559 > 408
Total TN 236496 < 236802
Total FP 260 > 68
Total FP CONTRA 32 > 12
Total FP INCONS 175 > 40
Total FP COMP 53 > 16
Total FN 468 < 619
P-value 5.23657817852e-08

^top




Performance plots


^top





Performance of Sfold - scored higher in this pairwise comparison

1. Total counts & total scores for Sfold

Total Base Pair Counts
Total TP 559
Total TN 236496
Total FP 260
Total FP CONTRA 32
Total FP INCONS 175
Total FP COMP 53
Total FN 468
Total Scores
MCC 0.629
Average MCC ± 95% Confidence Intervals 0.697 ± 0.089
Sensitivity 0.544
Positive Predictive Value 0.730
Nr of predictions 29

^top



2. Individual counts for Sfold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.92 0.89 0.94 17 1110 2 0 1 1 2
2KUR_A 0.90 0.86 0.95 18 1109 1 0 1 0 3
2KUU_A 0.87 0.81 0.94 17 1110 2 0 1 1 4
2KUV_A 0.88 0.82 0.95 18 1109 1 0 1 0 4
2KUW_A 0.90 0.86 0.95 18 1109 1 0 1 0 3
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A 0.45 0.35 0.58 7 1528 5 0 5 0 13
2XKV_B 0.51 0.50 0.53 10 4541 23 0 9 14 10
2XXA_G 0.36 0.31 0.43 13 5121 17 1 16 0 29
3A3A_A 0.87 0.76 1.00 28 3627 0 0 0 0 9
3GX2_A 0.72 0.55 0.96 22 4348 2 0 1 1 18
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IYQ_A 0.33 0.34 0.32 32 60627 71 19 48 4 62
3IZ4_A 0.52 0.42 0.65 56 70790 31 3 27 1 76
3JYX_4 0.35 0.30 0.42 10 12222 23 3 11 9 23
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NPB_A 0.77 0.65 0.91 30 6988 6 1 2 3 16
3O58_3 0.43 0.34 0.55 12 12381 17 0 10 7 23
3PDR_A 0.69 0.56 0.85 40 12833 9 0 7 2 32
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.65 0.50 0.84 21 3891 4 1 3 0 21
4A1C_2 0.16 0.15 0.17 5 11751 34 2 23 9 28
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.51 0.26 1.00 5 1321 0 0 0 0 14

^top



Performance of RNAalifold(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for RNAalifold(seed)

Total Base Pair Counts
Total TP 408
Total TN 236802
Total FP 68
Total FP CONTRA 12
Total FP INCONS 40
Total FP COMP 16
Total FN 619
Total Scores
MCC 0.593
Average MCC ± 95% Confidence Intervals 0.597 ± 0.088
Sensitivity 0.397
Positive Predictive Value 0.887
Nr of predictions 29

^top



2. Individual counts for RNAalifold(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.52 0.27 1.00 3 403 0 0 0 0 8
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.84 0.76 0.94 16 1111 1 0 1 0 5
2KX8_A 0.00 0.00 0.00 0 861 0 0 0 0 18
2L1F_A 0.67 0.58 0.78 14 2062 4 0 4 0 10
2L1F_B 0.64 0.56 0.74 14 2126 5 0 5 0 11
2L94_A 0.59 0.40 0.89 8 981 1 0 1 0 12
2LC8_A -0.01 0.00 0.00 0 1528 12 0 12 0 20
2XKV_B 0.59 0.35 1.00 7 4553 2 0 0 2 13
2XXA_G 0.46 0.21 1.00 9 5142 0 0 0 0 33
3A3A_A 0.71 0.51 1.00 19 3636 0 0 0 0 18
3GX2_A 0.74 0.55 1.00 22 4349 1 0 0 1 18
3IVN_B 0.61 0.48 0.79 15 2327 4 2 2 0 16
3IYQ_A 0.38 0.21 0.69 20 60697 13 5 4 4 74
3IZ4_A 0.42 0.21 0.85 28 70843 5 1 4 0 104
3JYX_4 0.46 0.21 1.00 7 12239 2 0 0 2 26
3LA5_A 0.63 0.47 0.84 16 2466 3 1 2 0 18
3NPB_A 0.66 0.48 0.92 22 6997 3 1 1 1 24
3O58_3 0.51 0.26 1.00 9 12394 0 0 0 0 26
3PDR_A 0.68 0.46 1.00 33 12847 1 0 0 1 39
3RKF_A 0.63 0.47 0.84 16 2192 3 1 2 0 18
3SD1_A 0.58 0.40 0.85 17 3896 3 1 2 0 25
4A1C_2 0.39 0.15 1.00 5 11776 2 0 0 2 28
4AOB_A 0.72 0.52 1.00 22 4349 1 0 0 1 20
4ENB_A 0.56 0.32 1.00 6 1269 0 0 0 0 13
4ENC_A 0.56 0.32 1.00 6 1320 0 0 0 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.