CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Murlet(20) - scored higher in this pairwise comparison

  4. Performance of Carnac(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for Murlet(20) & Carnac(seed) [.zip] - may take several seconds...


Overview

Metric Murlet(20) Carnac(seed)
MCC 0.587 > 0.197
Average MCC ± 95% Confidence Intervals 0.571 ± 0.075 > 0.092 ± 0.132
Sensitivity 0.425 > 0.039
Positive Predictive Value 0.817 < 1.000
Total TP 317 > 29
Total TN 116982 < 117341
Total FP 95 > 0
Total FP CONTRA 6 > 0
Total FP INCONS 65 > 0
Total FP COMP 24 > 0
Total FN 429 < 717
P-value 5.19332990918e-08

^top




Performance plots


^top





Performance of Murlet(20) - scored higher in this pairwise comparison

1. Total counts & total scores for Murlet(20)

Total Base Pair Counts
Total TP 317
Total TN 116982
Total FP 95
Total FP CONTRA 6
Total FP INCONS 65
Total FP COMP 24
Total FN 429
Total Scores
MCC 0.587
Average MCC ± 95% Confidence Intervals 0.571 ± 0.075
Sensitivity 0.425
Positive Predictive Value 0.817
Nr of predictions 21

^top



2. Individual counts for Murlet(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.67 0.45 1.00 5 401 0 0 0 0 6
2L94_A 0.53 0.50 0.59 10 973 7 0 7 0 10
2XKV_B 0.45 0.20 1.00 4 4556 3 0 0 3 16
2XXA_G 0.41 0.17 1.00 7 5144 0 0 0 0 35
3GX2_A 0.61 0.38 1.00 15 4356 1 0 0 1 25
3IVN_B 0.69 0.48 1.00 15 2331 0 0 0 0 16
3IZF_C 0.71 0.56 0.91 30 6870 4 0 3 1 24
3JYX_4 0.36 0.27 0.47 9 12227 15 0 10 5 24
3JYX_3 0.60 0.52 0.70 14 6308 11 0 6 5 13
3LA5_A 0.68 0.47 1.00 16 2469 0 0 0 0 18
3NPB_A 0.55 0.35 0.89 16 7003 2 1 1 0 30
3O58_3 0.33 0.23 0.47 8 12386 12 2 7 3 27
3O58_2 0.89 0.82 0.97 31 7228 2 0 1 1 7
3PDR_A 0.70 0.53 0.93 38 12839 3 0 3 0 34
3RKF_A 0.68 0.47 1.00 16 2195 0 0 0 0 18
3SD1_A 0.68 0.57 0.83 24 3887 5 1 4 0 18
4A1C_3 0.59 0.41 0.85 22 7114 4 0 4 0 32
4A1C_2 0.17 0.15 0.20 5 11756 24 2 18 4 28
4AOB_A 0.72 0.55 0.96 23 4347 2 0 1 1 19
4ENB_A 0.46 0.21 1.00 4 1271 0 0 0 0 15
4ENC_A 0.51 0.26 1.00 5 1321 0 0 0 0 14

^top



Performance of Carnac(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for Carnac(seed)

Total Base Pair Counts
Total TP 29
Total TN 117341
Total FP 0
Total FP CONTRA 0
Total FP INCONS 0
Total FP COMP 0
Total FN 717
Total Scores
MCC 0.197
Average MCC ± 95% Confidence Intervals 0.092 ± 0.132
Sensitivity 0.039
Positive Predictive Value 1.000
Nr of predictions 21

^top



2. Individual counts for Carnac(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2XKV_B 0.00 0.00 0.00 0 4560 0 0 0 0 20
2XXA_G 0.00 0.00 0.00 0 5151 0 0 0 0 42
3GX2_A 0.00 0.00 0.00 0 4371 0 0 0 0 40
3IVN_B 0.00 0.00 0.00 0 2346 0 0 0 0 31
3IZF_C 0.00 0.00 0.00 0 6903 0 0 0 0 54
3JYX_4 0.00 0.00 0.00 0 12246 0 0 0 0 33
3JYX_3 0.00 0.00 0.00 0 6328 0 0 0 0 27
3LA5_A 0.00 0.00 0.00 0 2485 0 0 0 0 34
3NPB_A 0.00 0.00 0.00 0 7021 0 0 0 0 46
3O58_3 0.00 0.00 0.00 0 12403 0 0 0 0 35
3O58_2 0.00 0.00 0.00 0 7260 0 0 0 0 38
3PDR_A 0.00 0.00 0.00 0 12880 0 0 0 0 72
3RKF_A 0.00 0.00 0.00 0 2211 0 0 0 0 34
3SD1_A 0.00 0.00 0.00 0 3916 0 0 0 0 42
4A1C_3 0.00 0.00 0.00 0 7140 0 0 0 0 54
4A1C_2 0.00 0.00 0.00 0 11781 0 0 0 0 33
4AOB_A 0.00 0.00 0.00 0 4371 0 0 0 0 42
4ENB_A 0.00 0.00 0.00 0 1275 0 0 0 0 19
4ENC_A 0.00 0.00 0.00 0 1326 0 0 0 0 19

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.