CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Murlet(20) - scored higher in this pairwise comparison

  4. Performance of RDfolder - scored lower in this pairwise comparison

  5. Compile and download dataset for Murlet(20) & RDfolder [.zip] - may take several seconds...


Overview

Metric Murlet(20) RDfolder
MCC 0.651 > 0.529
Average MCC ± 95% Confidence Intervals 0.633 ± 0.066 > 0.546 ± 0.174
Sensitivity 0.490 > 0.431
Positive Predictive Value 0.871 > 0.659
Total TP 217 > 191
Total TN 42487 > 42446
Total FP 40 < 107
Total FP CONTRA 7 < 14
Total FP INCONS 25 < 85
Total FP COMP 8 = 8
Total FN 226 < 252
P-value 2.22210847902e-08

^top




Performance plots


^top





Performance of Murlet(20) - scored higher in this pairwise comparison

1. Total counts & total scores for Murlet(20)

Total Base Pair Counts
Total TP 217
Total TN 42487
Total FP 40
Total FP CONTRA 7
Total FP INCONS 25
Total FP COMP 8
Total FN 226
Total Scores
MCC 0.651
Average MCC ± 95% Confidence Intervals 0.633 ± 0.066
Sensitivity 0.490
Positive Predictive Value 0.871
Nr of predictions 16

^top



2. Individual counts for Murlet(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.67 0.45 1.00 5 401 0 0 0 0 6
2L94_A 0.53 0.50 0.59 10 973 7 0 7 0 10
2WRQ_Y 0.41 0.41 0.41 7 2833 12 6 4 2 10
2XKV_B 0.45 0.20 1.00 4 4556 3 0 0 3 16
2XQD_Y 0.80 0.70 0.90 19 2829 2 0 2 0 8
3A2K_C 0.78 0.68 0.90 19 2905 2 0 2 0 9
3AMU_B 0.77 0.67 0.90 18 2983 3 0 2 1 9
3GX2_A 0.61 0.38 1.00 15 4356 1 0 0 1 25
3IVN_B 0.69 0.48 1.00 15 2331 0 0 0 0 16
3JYV_7 0.67 0.53 0.85 17 2830 3 0 3 0 15
3LA5_A 0.68 0.47 1.00 16 2469 0 0 0 0 18
3RKF_A 0.68 0.47 1.00 16 2195 0 0 0 0 18
3SD1_A 0.68 0.57 0.83 24 3887 5 1 4 0 18
4AOB_A 0.72 0.55 0.96 23 4347 2 0 1 1 19
4ENB_A 0.46 0.21 1.00 4 1271 0 0 0 0 15
4ENC_A 0.51 0.26 1.00 5 1321 0 0 0 0 14

^top



Performance of RDfolder - scored lower in this pairwise comparison

1. Total counts & total scores for RDfolder

Total Base Pair Counts
Total TP 191
Total TN 42446
Total FP 107
Total FP CONTRA 14
Total FP INCONS 85
Total FP COMP 8
Total FN 252
Total Scores
MCC 0.529
Average MCC ± 95% Confidence Intervals 0.546 ± 0.174
Sensitivity 0.431
Positive Predictive Value 0.659
Nr of predictions 16

^top



2. Individual counts for RDfolder [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2WRQ_Y 0.57 0.59 0.56 10 2832 12 5 3 4 7
2XKV_B 0.00 0.00 0.00 0 4538 22 5 17 0 20
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
3A2K_C 0.86 0.75 1.00 21 2905 0 0 0 0 7
3AMU_B 0.18 0.15 0.22 4 2985 16 2 12 2 23
3GX2_A 0.50 0.40 0.64 16 4346 10 1 8 1 24
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3JYV_7 -0.01 0.00 0.00 0 2830 20 0 20 0 32
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.30 0.17 0.54 7 3903 6 0 6 0 35
4AOB_A 0.35 0.26 0.48 11 4348 13 1 11 1 31
4ENB_A 0.43 0.32 0.60 6 1265 4 0 4 0 13
4ENC_A 0.43 0.32 0.60 6 1316 4 0 4 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.