CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of RNASampler(20) - scored higher in this pairwise comparison

  4. Performance of RDfolder - scored lower in this pairwise comparison

  5. Compile and download dataset for RNASampler(20) & RDfolder [.zip] - may take several seconds...


Overview

Metric RNASampler(20) RDfolder
MCC 0.744 > 0.529
Average MCC ± 95% Confidence Intervals 0.746 ± 0.074 > 0.546 ± 0.174
Sensitivity 0.587 > 0.431
Positive Predictive Value 0.949 > 0.659
Total TP 260 > 191
Total TN 42462 > 42446
Total FP 25 < 107
Total FP CONTRA 5 < 14
Total FP INCONS 9 < 85
Total FP COMP 11 > 8
Total FN 183 < 252
P-value 3.05041766982e-08

^top




Performance plots


^top





Performance of RNASampler(20) - scored higher in this pairwise comparison

1. Total counts & total scores for RNASampler(20)

Total Base Pair Counts
Total TP 260
Total TN 42462
Total FP 25
Total FP CONTRA 5
Total FP INCONS 9
Total FP COMP 11
Total FN 183
Total Scores
MCC 0.744
Average MCC ± 95% Confidence Intervals 0.746 ± 0.074
Sensitivity 0.587
Positive Predictive Value 0.949
Nr of predictions 16

^top



2. Individual counts for RNASampler(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2L94_A 0.92 0.90 0.95 18 971 1 0 1 0 2
2WRQ_Y 0.57 0.59 0.56 10 2832 13 5 3 5 7
2XKV_B 0.45 0.20 1.00 4 4556 2 0 0 2 16
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
3A2K_C 0.86 0.75 1.00 21 2905 0 0 0 0 7
3AMU_B 0.82 0.70 0.95 19 2983 3 0 1 2 8
3GX2_A 0.74 0.55 1.00 22 4349 1 0 0 1 18
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3JYV_7 0.81 0.66 1.00 21 2829 0 0 0 0 11
3LA5_A 0.76 0.59 1.00 20 2465 0 0 0 0 14
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.67 0.48 0.95 20 3895 1 0 1 0 22
4AOB_A 0.58 0.40 0.85 17 4351 4 0 3 1 25
4ENB_A 0.60 0.37 1.00 7 1268 0 0 0 0 12
4ENC_A 0.76 0.58 1.00 11 1315 0 0 0 0 8

^top



Performance of RDfolder - scored lower in this pairwise comparison

1. Total counts & total scores for RDfolder

Total Base Pair Counts
Total TP 191
Total TN 42446
Total FP 107
Total FP CONTRA 14
Total FP INCONS 85
Total FP COMP 8
Total FN 252
Total Scores
MCC 0.529
Average MCC ± 95% Confidence Intervals 0.546 ± 0.174
Sensitivity 0.431
Positive Predictive Value 0.659
Nr of predictions 16

^top



2. Individual counts for RDfolder [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2WRQ_Y 0.57 0.59 0.56 10 2832 12 5 3 4 7
2XKV_B 0.00 0.00 0.00 0 4538 22 5 17 0 20
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
3A2K_C 0.86 0.75 1.00 21 2905 0 0 0 0 7
3AMU_B 0.18 0.15 0.22 4 2985 16 2 12 2 23
3GX2_A 0.50 0.40 0.64 16 4346 10 1 8 1 24
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3JYV_7 -0.01 0.00 0.00 0 2830 20 0 20 0 32
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.30 0.17 0.54 7 3903 6 0 6 0 35
4AOB_A 0.35 0.26 0.48 11 4348 13 1 11 1 31
4ENB_A 0.43 0.32 0.60 6 1265 4 0 4 0 13
4ENC_A 0.43 0.32 0.60 6 1316 4 0 4 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.