CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of RDfolder - scored higher in this pairwise comparison

  4. Performance of Murlet(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for RDfolder & Murlet(seed) [.zip] - may take several seconds...


Overview

Metric RDfolder Murlet(seed)
MCC 0.593 > 0.589
Average MCC ± 95% Confidence Intervals 0.604 ± 0.159 > 0.587 ± 0.086
Sensitivity 0.483 > 0.410
Positive Predictive Value 0.737 < 0.856
Total TP 252 > 214
Total TN 42975 < 43067
Total FP 94 > 40
Total FP CONTRA 11 > 4
Total FP INCONS 79 > 32
Total FP COMP 4 = 4
Total FN 270 < 308
P-value 0.711548191155

^top




Performance plots


^top





Performance of RDfolder - scored higher in this pairwise comparison

1. Total counts & total scores for RDfolder

Total Base Pair Counts
Total TP 252
Total TN 42975
Total FP 94
Total FP CONTRA 11
Total FP INCONS 79
Total FP COMP 4
Total FN 270
Total Scores
MCC 0.593
Average MCC ± 95% Confidence Intervals 0.604 ± 0.159
Sensitivity 0.483
Positive Predictive Value 0.737
Nr of predictions 20

^top



2. Individual counts for RDfolder [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.89 0.79 1.00 15 1113 1 0 0 1 4
2KUR_A 0.87 0.76 1.00 16 1112 0 0 0 0 5
2KUU_A 0.84 0.71 1.00 15 1113 1 0 0 1 6
2KUV_A 0.85 0.73 1.00 16 1112 0 0 0 0 6
2KUW_A 0.87 0.76 1.00 16 1112 0 0 0 0 5
2L1F_A -0.01 0.00 0.00 0 2067 13 2 11 0 24
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A -0.01 0.00 0.00 0 1526 14 2 12 0 20
2XKV_B 0.00 0.00 0.00 0 4538 22 5 17 0 20
3A3A_A 0.53 0.41 0.71 15 3634 6 0 6 0 22
3GX2_A 0.50 0.40 0.64 16 4346 10 1 8 1 24
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.30 0.17 0.54 7 3903 6 0 6 0 35
4AOB_A 0.35 0.26 0.48 11 4348 13 1 11 1 31
4ENB_A 0.43 0.32 0.60 6 1265 4 0 4 0 13
4ENC_A 0.43 0.32 0.60 6 1316 4 0 4 0 13

^top



Performance of Murlet(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for Murlet(seed)

Total Base Pair Counts
Total TP 214
Total TN 43067
Total FP 40
Total FP CONTRA 4
Total FP INCONS 32
Total FP COMP 4
Total FN 308
Total Scores
MCC 0.589
Average MCC ± 95% Confidence Intervals 0.587 ± 0.086
Sensitivity 0.410
Positive Predictive Value 0.856
Nr of predictions 20

^top



2. Individual counts for Murlet(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.52 0.27 1.00 3 403 0 0 0 0 8
2KE6_A 0.66 0.53 0.83 10 1116 2 0 2 0 9
2KUR_A 0.63 0.48 0.83 10 1116 2 0 2 0 11
2KUU_A 0.63 0.48 0.83 10 1116 2 0 2 0 11
2KUV_A 0.85 0.73 1.00 16 1112 0 0 0 0 6
2KUW_A 0.84 0.76 0.94 16 1111 1 0 1 0 5
2L1F_A 0.82 0.75 0.90 18 2060 2 0 2 0 6
2L1F_B 0.80 0.72 0.90 18 2125 2 0 2 0 7
2L94_A 0.59 0.40 0.89 8 981 1 0 1 0 12
2LC8_A -0.01 0.00 0.00 0 1528 12 0 12 0 20
2XKV_B 0.45 0.20 1.00 4 4556 2 0 0 2 16
3A3A_A 0.57 0.32 1.00 12 3643 0 0 0 0 25
3GX2_A 0.59 0.35 1.00 14 4357 1 0 0 1 26
3IVN_B 0.53 0.39 0.75 12 2330 4 2 2 0 19
3LA5_A 0.58 0.41 0.82 14 2468 3 1 2 0 20
3RKF_A 0.53 0.35 0.80 12 2196 3 1 2 0 22
3SD1_A 0.47 0.26 0.85 11 3903 2 0 2 0 31
4AOB_A 0.58 0.33 1.00 14 4357 1 0 0 1 28
4ENB_A 0.56 0.32 1.00 6 1269 0 0 0 0 13
4ENC_A 0.56 0.32 1.00 6 1320 0 0 0 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.