CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Carnac(20) - scored higher in this pairwise comparison

  4. Performance of Mastr(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for Carnac(20) & Mastr(seed) [.zip] - may take several seconds...


Overview

Metric Carnac(20) Mastr(seed)
MCC 0.582 > 0.000
Average MCC ± 95% Confidence Intervals 0.536 ± 0.094 > 0.000 ± 0.000
Sensitivity 0.371 > 0.000
Positive Predictive Value 0.915 > 0.000
Total TP 396 > 0
Total TN 209673 < 210106
Total FP 59 > 0
Total FP CONTRA 8 > 0
Total FP INCONS 29 > 0
Total FP COMP 22 > 0
Total FN 670 < 1066
P-value 5.06544643719e-08

^top




Performance plots


^top





Performance of Carnac(20) - scored higher in this pairwise comparison

1. Total counts & total scores for Carnac(20)

Total Base Pair Counts
Total TP 396
Total TN 209673
Total FP 59
Total FP CONTRA 8
Total FP INCONS 29
Total FP COMP 22
Total FN 670
Total Scores
MCC 0.582
Average MCC ± 95% Confidence Intervals 0.536 ± 0.094
Sensitivity 0.371
Positive Predictive Value 0.915
Nr of predictions 28

^top



2. Individual counts for Carnac(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.73 0.55 1.00 6 400 0 0 0 0 5
2L94_A 0.00 0.00 0.00 0 990 0 0 0 0 20
2WRQ_Y 0.57 0.59 0.56 10 2832 13 5 3 5 7
2XKV_B 0.32 0.10 1.00 2 4558 1 0 0 1 18
2XQD_Y 0.79 0.63 1.00 17 2833 0 0 0 0 10
2XXA_G 0.27 0.07 1.00 3 5148 0 0 0 0 39
3A2K_C 0.78 0.61 1.00 17 2909 0 0 0 0 11
3AMU_B 0.69 0.59 0.80 16 2983 6 0 4 2 11
3G4S_9 0.50 0.28 0.89 16 7363 2 1 1 0 41
3GX2_A 0.57 0.33 1.00 13 4358 0 0 0 0 27
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IZ4_A 0.47 0.23 0.94 31 70843 2 0 2 0 101
3IZF_C 0.73 0.56 0.97 30 6872 1 0 1 0 24
3JYV_7 0.68 0.50 0.94 16 2833 1 0 1 0 16
3JYX_4 0.46 0.21 1.00 7 12239 2 0 0 2 26
3JYX_3 0.64 0.56 0.75 15 6308 10 1 4 5 12
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NPB_A 0.44 0.20 1.00 9 7012 2 0 0 2 37
3O58_2 0.83 0.71 0.96 27 7232 2 0 1 1 11
3O58_3 0.51 0.26 1.00 9 12394 0 0 0 0 26
3PDR_A 0.62 0.40 0.97 29 12850 3 0 1 2 43
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.60 0.38 0.94 16 3899 1 0 1 0 26
4A1C_2 0.33 0.15 0.71 5 11774 3 0 2 1 28
4A1C_3 0.67 0.52 0.88 28 7108 4 0 4 0 26
4AOB_A 0.49 0.33 0.74 14 4352 6 1 4 1 28
4ENB_A 0.00 0.00 0.00 0 1275 0 0 0 0 19
4ENC_A 0.00 0.00 0.00 0 1326 0 0 0 0 19

^top



Performance of Mastr(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for Mastr(seed)

Total Base Pair Counts
Total TP 0
Total TN 210106
Total FP 0
Total FP CONTRA 0
Total FP INCONS 0
Total FP COMP 0
Total FN 1066
Total Scores
MCC 0.000
Average MCC ± 95% Confidence Intervals 0.000 ± 0.000
Sensitivity 0.000
Positive Predictive Value 0.000
Nr of predictions 28

^top



2. Individual counts for Mastr(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.00 0.00 0.00 0 406 0 0 0 0 11
2L94_A 0.00 0.00 0.00 0 990 0 0 0 0 20
2WRQ_Y 0.00 0.00 0.00 0 2850 0 0 0 0 17
2XKV_B 0.00 0.00 0.00 0 4560 0 0 0 0 20
2XQD_Y 0.00 0.00 0.00 0 2850 0 0 0 0 27
2XXA_G 0.00 0.00 0.00 0 5151 0 0 0 0 42
3A2K_C 0.00 0.00 0.00 0 2926 0 0 0 0 28
3AMU_B 0.00 0.00 0.00 0 3003 0 0 0 0 27
3G4S_9 0.00 0.00 0.00 0 7381 0 0 0 0 57
3GX2_A 0.00 0.00 0.00 0 4371 0 0 0 0 40
3IVN_B 0.00 0.00 0.00 0 2346 0 0 0 0 31
3IZ4_A 0.00 0.00 0.00 0 70876 0 0 0 0 132
3IZF_C 0.00 0.00 0.00 0 6903 0 0 0 0 54
3JYV_7 0.00 0.00 0.00 0 2850 0 0 0 0 32
3JYX_4 0.00 0.00 0.00 0 12246 0 0 0 0 33
3JYX_3 0.00 0.00 0.00 0 6328 0 0 0 0 27
3LA5_A 0.00 0.00 0.00 0 2485 0 0 0 0 34
3NPB_A 0.00 0.00 0.00 0 7021 0 0 0 0 46
3O58_2 0.00 0.00 0.00 0 7260 0 0 0 0 38
3O58_3 0.00 0.00 0.00 0 12403 0 0 0 0 35
3PDR_A 0.00 0.00 0.00 0 12880 0 0 0 0 72
3RKF_A 0.00 0.00 0.00 0 2211 0 0 0 0 34
3SD1_A 0.00 0.00 0.00 0 3916 0 0 0 0 42
4A1C_2 0.00 0.00 0.00 0 11781 0 0 0 0 33
4A1C_3 0.00 0.00 0.00 0 7140 0 0 0 0 54
4AOB_A 0.00 0.00 0.00 0 4371 0 0 0 0 42
4ENB_A 0.00 0.00 0.00 0 1275 0 0 0 0 19
4ENC_A 0.00 0.00 0.00 0 1326 0 0 0 0 19

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.