CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of MXScarna(seed) - scored higher in this pairwise comparison

  4. Performance of Alterna - scored lower in this pairwise comparison

  5. Compile and download dataset for MXScarna(seed) & Alterna [.zip] - may take several seconds...


Overview

Metric MXScarna(seed) Alterna
MCC 0.725 > 0.655
Average MCC ± 95% Confidence Intervals 0.709 ± 0.088 > 0.681 ± 0.099
Sensitivity 0.609 > 0.587
Positive Predictive Value 0.869 > 0.737
Total TP 471 > 454
Total TN 69086 > 69012
Total FP 94 < 188
Total FP CONTRA 12 < 20
Total FP INCONS 59 < 142
Total FP COMP 23 < 26
Total FN 302 < 319
P-value 5.19332990918e-08

^top




Performance plots


^top





Performance of MXScarna(seed) - scored higher in this pairwise comparison

1. Total counts & total scores for MXScarna(seed)

Total Base Pair Counts
Total TP 471
Total TN 69086
Total FP 94
Total FP CONTRA 12
Total FP INCONS 59
Total FP COMP 23
Total FN 302
Total Scores
MCC 0.725
Average MCC ± 95% Confidence Intervals 0.709 ± 0.088
Sensitivity 0.609
Positive Predictive Value 0.869
Nr of predictions 29

^top



2. Individual counts for MXScarna(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.89 0.84 0.94 16 1111 2 0 1 1 3
2KUR_A 0.87 0.81 0.94 17 1110 1 0 1 0 4
2KUU_A 0.84 0.76 0.94 16 1111 2 0 1 1 5
2KUV_A 0.85 0.77 0.94 17 1110 1 0 1 0 5
2KUW_A 0.76 0.67 0.88 14 1112 2 0 2 0 7
2KX8_A -0.01 0.00 0.00 0 859 2 0 2 0 18
2L1F_A 0.91 0.88 0.95 21 2058 1 0 1 0 3
2L1F_B 0.96 0.92 1.00 23 2122 0 0 0 0 2
2L94_A 0.57 0.55 0.61 11 972 7 0 7 0 9
2LC8_A -0.01 0.00 0.00 0 1530 12 0 10 2 20
2WRQ_Y 0.57 0.59 0.56 10 2832 11 5 3 3 7
2WWQ_V 0.56 0.46 0.68 13 2907 7 0 6 1 15
2XKV_B 0.59 0.55 0.65 11 4543 18 0 6 12 9
2XQD_Y 0.77 0.67 0.90 18 2830 2 0 2 0 9
2ZZM_B 0.56 0.44 0.74 14 3467 5 4 1 0 18
2ZZN_D 0.86 0.74 1.00 20 2465 0 0 0 0 7
3A2K_C 0.84 0.71 1.00 20 2906 0 0 0 0 8
3A3A_A 0.77 0.65 0.92 24 3629 3 0 2 1 13
3AKZ_H 0.86 0.75 1.00 21 2680 0 0 0 0 7
3AMU_B 0.84 0.70 1.00 19 2984 1 0 0 1 8
3GX2_A 0.70 0.60 0.83 24 4342 6 0 5 1 16
3IVN_B 0.65 0.45 0.93 14 2331 1 1 0 0 17
3J16_L 0.82 0.67 1.00 20 2755 0 0 0 0 10
3JYV_7 0.79 0.63 1.00 20 2830 0 0 0 0 12
3LA5_A 0.75 0.56 1.00 19 2466 0 0 0 0 15
3RKF_A 0.72 0.53 1.00 18 2193 0 0 0 0 16
3SD1_A 0.63 0.55 0.74 23 3885 8 1 7 0 19
3UZL_B 0.66 0.49 0.90 18 3550 2 1 1 0 19

^top



Performance of Alterna - scored lower in this pairwise comparison

1. Total counts & total scores for Alterna

Total Base Pair Counts
Total TP 454
Total TN 69012
Total FP 188
Total FP CONTRA 20
Total FP INCONS 142
Total FP COMP 26
Total FN 319
Total Scores
MCC 0.655
Average MCC ± 95% Confidence Intervals 0.681 ± 0.099
Sensitivity 0.587
Positive Predictive Value 0.737
Nr of predictions 29

^top



2. Individual counts for Alterna [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.92 0.89 0.94 17 1110 2 0 1 1 2
2KUR_A 0.90 0.86 0.95 18 1109 1 0 1 0 3
2KUU_A 0.87 0.81 0.94 17 1110 2 0 1 1 4
2KUV_A 0.88 0.82 0.95 18 1109 1 0 1 0 4
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.88 0.83 0.94 15 845 1 0 1 0 3
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A 0.46 0.40 0.53 8 1525 7 0 7 0 12
2WRQ_Y 0.57 0.59 0.56 10 2832 13 5 3 5 7
2WWQ_V 0.76 0.68 0.86 19 2904 5 0 3 2 9
2XKV_B 0.45 0.45 0.45 9 4540 25 0 11 14 11
2XQD_Y 0.67 0.59 0.76 16 2829 5 0 5 0 11
2ZZM_B 0.10 0.09 0.13 3 3463 20 2 18 0 29
2ZZN_D 0.84 0.78 0.91 21 2462 2 0 2 0 6
3A2K_C 0.44 0.43 0.46 12 2900 14 2 12 0 16
3A3A_A 0.84 0.70 1.00 26 3629 0 0 0 0 11
3AKZ_H 0.40 0.39 0.42 11 2675 15 4 11 0 17
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3GX2_A 0.47 0.40 0.57 16 4343 13 1 11 1 24
3IVN_B 0.74 0.61 0.90 19 2325 2 1 1 0 12
3J16_L 0.63 0.53 0.76 16 2754 5 1 4 0 14
3JYV_7 -0.01 0.00 0.00 0 2828 22 0 22 0 32
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3RKF_A 0.69 0.56 0.86 19 2189 3 1 2 0 15
3SD1_A 0.46 0.38 0.57 16 3888 12 1 11 0 26
3UZL_B 0.52 0.43 0.64 16 3545 9 2 7 0 21

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.