CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of MXScarna(20) - scored higher in this pairwise comparison

  4. Performance of RDfolder - scored lower in this pairwise comparison

  5. Compile and download dataset for MXScarna(20) & RDfolder [.zip] - may take several seconds...


Overview

Metric MXScarna(20) RDfolder
MCC 0.695 > 0.529
Average MCC ± 95% Confidence Intervals 0.685 ± 0.090 > 0.546 ± 0.174
Sensitivity 0.564 > 0.431
Positive Predictive Value 0.862 > 0.659
Total TP 250 > 191
Total TN 42446 = 42446
Total FP 53 < 107
Total FP CONTRA 9 < 14
Total FP INCONS 31 < 85
Total FP COMP 13 > 8
Total FN 193 < 252
P-value 1.39551335374e-08

^top




Performance plots


^top





Performance of MXScarna(20) - scored higher in this pairwise comparison

1. Total counts & total scores for MXScarna(20)

Total Base Pair Counts
Total TP 250
Total TN 42446
Total FP 53
Total FP CONTRA 9
Total FP INCONS 31
Total FP COMP 13
Total FN 193
Total Scores
MCC 0.695
Average MCC ± 95% Confidence Intervals 0.685 ± 0.090
Sensitivity 0.564
Positive Predictive Value 0.862
Nr of predictions 16

^top



2. Individual counts for MXScarna(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2L94_A 0.73 0.70 0.78 14 972 4 0 4 0 6
2WRQ_Y 0.57 0.59 0.56 10 2832 13 5 3 5 7
2XKV_B 0.45 0.20 1.00 4 4556 3 0 0 3 16
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
3A2K_C 0.66 0.57 0.76 16 2905 6 1 4 1 12
3AMU_B 0.86 0.74 1.00 20 2983 2 0 0 2 7
3GX2_A 0.70 0.58 0.85 23 4344 5 0 4 1 17
3IVN_B 0.74 0.58 0.95 18 2327 1 1 0 0 13
3JYV_7 0.79 0.63 1.00 20 2830 0 0 0 0 12
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3RKF_A 0.72 0.53 1.00 18 2193 0 0 0 0 16
3SD1_A 0.63 0.55 0.74 23 3885 8 2 6 0 19
4AOB_A 0.62 0.55 0.72 23 4339 10 0 9 1 19
4ENB_A 0.26 0.11 0.67 2 1272 1 0 1 0 17
4ENC_A 0.60 0.37 1.00 7 1319 0 0 0 0 12

^top



Performance of RDfolder - scored lower in this pairwise comparison

1. Total counts & total scores for RDfolder

Total Base Pair Counts
Total TP 191
Total TN 42446
Total FP 107
Total FP CONTRA 14
Total FP INCONS 85
Total FP COMP 8
Total FN 252
Total Scores
MCC 0.529
Average MCC ± 95% Confidence Intervals 0.546 ± 0.174
Sensitivity 0.431
Positive Predictive Value 0.659
Nr of predictions 16

^top



2. Individual counts for RDfolder [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2WRQ_Y 0.57 0.59 0.56 10 2832 12 5 3 4 7
2XKV_B 0.00 0.00 0.00 0 4538 22 5 17 0 20
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
3A2K_C 0.86 0.75 1.00 21 2905 0 0 0 0 7
3AMU_B 0.18 0.15 0.22 4 2985 16 2 12 2 23
3GX2_A 0.50 0.40 0.64 16 4346 10 1 8 1 24
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3JYV_7 -0.01 0.00 0.00 0 2830 20 0 20 0 32
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.30 0.17 0.54 7 3903 6 0 6 0 35
4AOB_A 0.35 0.26 0.48 11 4348 13 1 11 1 31
4ENB_A 0.43 0.32 0.60 6 1265 4 0 4 0 13
4ENC_A 0.43 0.32 0.60 6 1316 4 0 4 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.