CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Afold - scored higher in this pairwise comparison

  4. Performance of Carnac(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for Afold & Carnac(seed) [.zip] - may take several seconds...


Overview

Metric Afold Carnac(seed)
MCC 0.678 > 0.311
Average MCC ± 95% Confidence Intervals 0.728 ± 0.107 > 0.209 ± 0.147
Sensitivity 0.624 > 0.097
Positive Predictive Value 0.742 < 1.000
Total TP 416 > 65
Total TN 93305 < 93801
Total FP 201 > 0
Total FP CONTRA 20 > 0
Total FP INCONS 125 > 0
Total FP COMP 56 > 0
Total FN 251 < 602
P-value 5.23657817852e-08

^top




Performance plots


^top





Performance of Afold - scored higher in this pairwise comparison

1. Total counts & total scores for Afold

Total Base Pair Counts
Total TP 416
Total TN 93305
Total FP 201
Total FP CONTRA 20
Total FP INCONS 125
Total FP COMP 56
Total FN 251
Total Scores
MCC 0.678
Average MCC ± 95% Confidence Intervals 0.728 ± 0.107
Sensitivity 0.624
Positive Predictive Value 0.742
Nr of predictions 23

^top



2. Individual counts for Afold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2L1F_A 0.96 0.96 0.96 23 2056 1 0 1 0 1
2L1F_B 0.96 0.96 0.96 24 2120 1 0 1 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A 0.61 0.55 0.69 11 1524 6 0 5 1 9
2XXA_G 0.34 0.31 0.39 13 5118 20 1 19 0 29
3A3A_A 0.84 0.70 1.00 26 3629 0 0 0 0 11
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IZF_C 0.66 0.57 0.76 31 6862 10 1 9 0 23
3JYX_4 0.31 0.30 0.31 10 12214 35 5 17 13 23
3JYX_3 0.54 0.56 0.54 15 6300 24 1 12 11 12
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NPB_A 0.74 0.61 0.90 28 6990 5 0 3 2 18
3O58_3 0.34 0.34 0.34 12 12368 37 2 21 14 23
3O58_2 0.66 0.66 0.66 25 7222 14 4 9 1 13
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
4A1C_2 0.14 0.15 0.14 5 11745 43 5 26 12 28
4ENB_A 0.67 0.58 0.79 11 1261 3 1 2 0 8

^top



Performance of Carnac(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for Carnac(seed)

Total Base Pair Counts
Total TP 65
Total TN 93801
Total FP 0
Total FP CONTRA 0
Total FP INCONS 0
Total FP COMP 0
Total FN 602
Total Scores
MCC 0.311
Average MCC ± 95% Confidence Intervals 0.209 ± 0.147
Sensitivity 0.097
Positive Predictive Value 1.000
Nr of predictions 23

^top



2. Individual counts for Carnac(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.00 0.00 0.00 0 1128 0 0 0 0 19
2KUR_A 0.57 0.33 1.00 7 1121 0 0 0 0 14
2KUU_A 0.57 0.33 1.00 7 1121 0 0 0 0 14
2KUV_A 0.64 0.41 1.00 9 1119 0 0 0 0 13
2KUW_A 0.65 0.43 1.00 9 1119 0 0 0 0 12
2L1F_A 0.00 0.00 0.00 0 2080 0 0 0 0 24
2L1F_B 0.00 0.00 0.00 0 2145 0 0 0 0 25
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A 0.44 0.20 1.00 4 1536 0 0 0 0 16
2XXA_G 0.00 0.00 0.00 0 5151 0 0 0 0 42
3A3A_A 0.00 0.00 0.00 0 3655 0 0 0 0 37
3IVN_B 0.00 0.00 0.00 0 2346 0 0 0 0 31
3IZF_C 0.00 0.00 0.00 0 6903 0 0 0 0 54
3JYX_4 0.00 0.00 0.00 0 12246 0 0 0 0 33
3JYX_3 0.00 0.00 0.00 0 6328 0 0 0 0 27
3LA5_A 0.00 0.00 0.00 0 2485 0 0 0 0 34
3NPB_A 0.00 0.00 0.00 0 7021 0 0 0 0 46
3O58_3 0.00 0.00 0.00 0 12403 0 0 0 0 35
3O58_2 0.00 0.00 0.00 0 7260 0 0 0 0 38
3RKF_A 0.00 0.00 0.00 0 2211 0 0 0 0 34
4A1C_2 0.00 0.00 0.00 0 11781 0 0 0 0 33
4ENB_A 0.00 0.00 0.00 0 1275 0 0 0 0 19

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.