CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of RNAalifold(seed) - scored higher in this pairwise comparison

  4. Performance of MaxExpect - scored lower in this pairwise comparison

  5. Compile and download dataset for RNAalifold(seed) & MaxExpect [.zip] - may take several seconds...


Overview

Metric RNAalifold(seed) MaxExpect
MCC 0.588 > 0.584
Average MCC ± 95% Confidence Intervals 0.596 ± 0.095 < 0.646 ± 0.114
Sensitivity 0.394 < 0.529
Positive Predictive Value 0.881 > 0.649
Total TP 386 < 518
Total TN 232763 > 232403
Total FP 68 < 349
Total FP CONTRA 12 < 39
Total FP INCONS 40 < 241
Total FP COMP 16 < 69
Total FN 593 > 461
P-value 0.14339240505

^top




Performance plots


^top





Performance of RNAalifold(seed) - scored higher in this pairwise comparison

1. Total counts & total scores for RNAalifold(seed)

Total Base Pair Counts
Total TP 386
Total TN 232763
Total FP 68
Total FP CONTRA 12
Total FP INCONS 40
Total FP COMP 16
Total FN 593
Total Scores
MCC 0.588
Average MCC ± 95% Confidence Intervals 0.596 ± 0.095
Sensitivity 0.394
Positive Predictive Value 0.881
Nr of predictions 27

^top



2. Individual counts for RNAalifold(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.84 0.76 0.94 16 1111 1 0 1 0 5
2KX8_A 0.00 0.00 0.00 0 861 0 0 0 0 18
2L1F_B 0.64 0.56 0.74 14 2126 5 0 5 0 11
2L1F_A 0.67 0.58 0.78 14 2062 4 0 4 0 10
2L94_A 0.59 0.40 0.89 8 981 1 0 1 0 12
2LC8_A -0.01 0.00 0.00 0 1528 12 0 12 0 20
2XKV_B 0.59 0.35 1.00 7 4553 2 0 0 2 13
2XXA_G 0.46 0.21 1.00 9 5142 0 0 0 0 33
3GX2_A 0.74 0.55 1.00 22 4349 1 0 0 1 18
3IVN_B 0.61 0.48 0.79 15 2327 4 2 2 0 16
3IYQ_A 0.38 0.21 0.69 20 60697 13 5 4 4 74
3IZ4_A 0.42 0.21 0.85 28 70843 5 1 4 0 104
3JYX_4 0.46 0.21 1.00 7 12239 2 0 0 2 26
3LA5_A 0.63 0.47 0.84 16 2466 3 1 2 0 18
3NPB_A 0.66 0.48 0.92 22 6997 3 1 1 1 24
3O58_3 0.51 0.26 1.00 9 12394 0 0 0 0 26
3PDR_A 0.68 0.46 1.00 33 12847 1 0 0 1 39
3RKF_A 0.63 0.47 0.84 16 2192 3 1 2 0 18
3SD1_A 0.58 0.40 0.85 17 3896 3 1 2 0 25
4A1C_2 0.39 0.15 1.00 5 11776 2 0 0 2 28
4AOB_A 0.72 0.52 1.00 22 4349 1 0 0 1 20
4ENB_A 0.56 0.32 1.00 6 1269 0 0 0 0 13
4ENC_A 0.56 0.32 1.00 6 1320 0 0 0 0 13

^top



Performance of MaxExpect - scored lower in this pairwise comparison

1. Total counts & total scores for MaxExpect

Total Base Pair Counts
Total TP 518
Total TN 232403
Total FP 349
Total FP CONTRA 39
Total FP INCONS 241
Total FP COMP 69
Total FN 461
Total Scores
MCC 0.584
Average MCC ± 95% Confidence Intervals 0.646 ± 0.114
Sensitivity 0.529
Positive Predictive Value 0.649
Nr of predictions 27

^top



2. Individual counts for MaxExpect [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KE6_A 0.92 0.89 0.94 17 1110 2 0 1 1 2
2KUR_A 0.90 0.86 0.95 18 1109 1 0 1 0 3
2KUU_A 0.87 0.81 0.94 17 1110 2 0 1 1 4
2KUV_A 0.88 0.82 0.95 18 1109 1 0 1 0 4
2KUW_A 0.90 0.86 0.95 18 1109 1 0 1 0 3
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2XKV_B 0.51 0.50 0.53 10 4541 24 0 9 15 10
2XXA_G 0.25 0.24 0.27 10 5114 27 1 26 0 32
3GX2_A 0.77 0.63 0.96 25 4345 2 0 1 1 15
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IYQ_A 0.29 0.31 0.27 29 60617 84 19 61 4 65
3IZ4_A 0.54 0.46 0.64 61 70781 39 3 31 5 71
3JYX_4 0.31 0.30 0.31 10 12214 34 4 18 12 23
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NPB_A 0.71 0.61 0.82 28 6987 9 0 6 3 18
3O58_3 0.35 0.34 0.35 12 12369 35 2 20 13 23
3PDR_A 0.76 0.63 0.94 45 12832 5 0 3 2 27
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.58 0.48 0.71 20 3888 8 1 7 0 22
4A1C_2 0.14 0.15 0.14 5 11746 41 4 26 11 28
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.31 0.26 0.38 5 1313 8 1 7 0 14

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.