CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of RNASampler(20) - scored higher in this pairwise comparison

  4. Performance of MaxExpect - scored lower in this pairwise comparison

  5. Compile and download dataset for RNASampler(20) & MaxExpect [.zip] - may take several seconds...


Overview

Metric RNASampler(20) MaxExpect
MCC 0.636 > 0.588
Average MCC ± 95% Confidence Intervals 0.650 ± 0.077 > 0.595 ± 0.085
Sensitivity 0.484 < 0.516
Positive Predictive Value 0.840 > 0.675
Total TP 483 < 515
Total TN 201744 > 201556
Total FP 148 < 329
Total FP CONTRA 20 < 30
Total FP INCONS 72 < 218
Total FP COMP 56 < 81
Total FN 515 > 483
P-value 5.23657817852e-08

^top




Performance plots


^top





Performance of RNASampler(20) - scored higher in this pairwise comparison

1. Total counts & total scores for RNASampler(20)

Total Base Pair Counts
Total TP 483
Total TN 201744
Total FP 148
Total FP CONTRA 20
Total FP INCONS 72
Total FP COMP 56
Total FN 515
Total Scores
MCC 0.636
Average MCC ± 95% Confidence Intervals 0.650 ± 0.077
Sensitivity 0.484
Positive Predictive Value 0.840
Nr of predictions 26

^top



2. Individual counts for RNASampler(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2L94_A 0.92 0.90 0.95 18 971 1 0 1 0 2
2WRQ_Y 0.57 0.59 0.56 10 2832 13 5 3 5 7
2XKV_B 0.45 0.20 1.00 4 4556 2 0 0 2 16
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.31 0.10 1.00 4 5147 0 0 0 0 38
3A2K_C 0.86 0.75 1.00 21 2905 0 0 0 0 7
3AMU_B 0.82 0.70 0.95 19 2983 3 0 1 2 8
3GX2_A 0.74 0.55 1.00 22 4349 1 0 0 1 18
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IZ4_A 0.47 0.32 0.69 42 70815 23 6 13 4 90
3IZF_C 0.74 0.57 0.97 31 6871 1 0 1 0 23
3JYV_7 0.81 0.66 1.00 21 2829 0 0 0 0 11
3JYX_4 0.32 0.30 0.34 10 12217 26 4 15 7 23
3JYX_3 0.58 0.44 0.75 12 6312 11 0 4 7 15
3LA5_A 0.76 0.59 1.00 20 2465 0 0 0 0 14
3NPB_A 0.68 0.48 0.96 22 6998 4 1 0 3 24
3O58_3 0.43 0.34 0.55 12 12381 18 2 8 8 23
3O58_2 0.79 0.71 0.87 27 7229 5 2 2 1 11
3PDR_A 0.70 0.53 0.93 38 12839 5 0 3 2 34
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.67 0.48 0.95 20 3895 1 0 1 0 22
4A1C_3 0.74 0.56 1.00 30 7110 0 0 0 0 24
4A1C_2 0.18 0.15 0.23 5 11759 30 0 17 13 28
4AOB_A 0.58 0.40 0.85 17 4351 4 0 3 1 25
4ENB_A 0.60 0.37 1.00 7 1268 0 0 0 0 12
4ENC_A 0.76 0.58 1.00 11 1315 0 0 0 0 8

^top



Performance of MaxExpect - scored lower in this pairwise comparison

1. Total counts & total scores for MaxExpect

Total Base Pair Counts
Total TP 515
Total TN 201556
Total FP 329
Total FP CONTRA 30
Total FP INCONS 218
Total FP COMP 81
Total FN 483
Total Scores
MCC 0.588
Average MCC ± 95% Confidence Intervals 0.595 ± 0.085
Sensitivity 0.516
Positive Predictive Value 0.675
Nr of predictions 26

^top



2. Individual counts for MaxExpect [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2WRQ_Y 0.53 0.53 0.53 9 2833 13 5 3 5 8
2XKV_B 0.51 0.50 0.53 10 4541 24 0 9 15 10
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.25 0.24 0.27 10 5114 27 1 26 0 32
3A2K_C 0.42 0.39 0.46 11 2902 13 2 11 0 17
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3GX2_A 0.77 0.63 0.96 25 4345 2 0 1 1 15
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IZ4_A 0.54 0.46 0.64 61 70781 39 3 31 5 71
3IZF_C 0.71 0.61 0.83 33 6863 7 1 6 0 21
3JYV_7 0.41 0.31 0.56 10 2832 8 0 8 0 22
3JYX_4 0.31 0.30 0.31 10 12214 34 4 18 12 23
3JYX_3 0.64 0.63 0.65 17 6302 19 1 8 10 10
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NPB_A 0.71 0.61 0.82 28 6987 9 0 6 3 18
3O58_3 0.35 0.34 0.35 12 12369 35 2 20 13 23
3O58_2 0.75 0.76 0.74 29 7221 11 3 7 1 9
3PDR_A 0.76 0.63 0.94 45 12832 5 0 3 2 27
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.58 0.48 0.71 20 3888 8 1 7 0 22
4A1C_3 0.69 0.57 0.84 31 7103 6 0 6 0 23
4A1C_2 0.14 0.15 0.14 5 11746 41 4 26 11 28
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.31 0.26 0.38 5 1313 8 1 7 0 14

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.