CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of CRWrnafold - scored higher in this pairwise comparison

  4. Performance of RDfolder - scored lower in this pairwise comparison

  5. Compile and download dataset for CRWrnafold & RDfolder [.zip] - may take several seconds...


Overview

Metric CRWrnafold RDfolder
MCC 0.613 > 0.465
Average MCC ± 95% Confidence Intervals 0.649 ± 0.156 > 0.543 ± 0.163
Sensitivity 0.544 > 0.365
Positive Predictive Value 0.701 > 0.606
Total TP 204 > 137
Total TN 28030 < 28095
Total FP 96 > 93
Total FP CONTRA 15 > 11
Total FP INCONS 72 < 78
Total FP COMP 9 > 4
Total FN 171 < 238
P-value 5.19332990918e-08

^top




Performance plots


^top





Performance of CRWrnafold - scored higher in this pairwise comparison

1. Total counts & total scores for CRWrnafold

Total Base Pair Counts
Total TP 204
Total TN 28030
Total FP 96
Total FP CONTRA 15
Total FP INCONS 72
Total FP COMP 9
Total FN 171
Total Scores
MCC 0.613
Average MCC ± 95% Confidence Intervals 0.649 ± 0.156
Sensitivity 0.544
Positive Predictive Value 0.701
Nr of predictions 23

^top



2. Individual counts for CRWrnafold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.85 0.73 1.00 8 343 1 0 0 1 3
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2YIE_X - 0.36 0.33 0.40 4 1368 9 2 4 3 8
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
3AMU_B 0.67 0.59 0.76 16 2982 7 0 5 2 11
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.39 0.31 0.50 5 1118 5 1 4 0 11
3J0L_1 - 0.76 0.63 0.92 12 1212 3 0 1 2 7
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J16_L 0.84 0.70 1.00 21 2754 0 0 0 0 9
3SD1_A 0.52 0.45 0.61 19 3885 12 2 10 0 23
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 0 0 0 0 1
3TS0_U - 1.00 1.00 1.00 6 247 0 0 0 0 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.59 0.48 0.74 20 4344 8 2 5 1 22
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8
4ENC_A 0.70 0.58 0.85 11 1313 2 1 1 0 8

^top



Performance of RDfolder - scored lower in this pairwise comparison

1. Total counts & total scores for RDfolder

Total Base Pair Counts
Total TP 137
Total TN 28095
Total FP 93
Total FP CONTRA 11
Total FP INCONS 78
Total FP COMP 4
Total FN 238
Total Scores
MCC 0.465
Average MCC ± 95% Confidence Intervals 0.543 ± 0.163
Sensitivity 0.365
Positive Predictive Value 0.606
Nr of predictions 23

^top



2. Individual counts for RDfolder [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1526 14 2 12 0 20
2LDL_A - 0.90 0.82 1.00 9 342 0 0 0 0 2
2LDT_A - 0.68 0.47 1.00 7 458 0 0 0 0 8
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2YIE_X - 0.38 0.33 0.44 4 1369 5 1 4 0 8
2YIE_Z - 0.43 0.42 0.45 5 1529 6 3 3 0 7
3AMU_B 0.18 0.15 0.22 4 2985 16 2 12 2 23
3J0L_7 - -0.01 0.00 0.00 0 1220 5 0 5 0 17
3J0L_8 - 0.86 0.75 1.00 6 184 0 0 0 0 2
3J0L_a - -0.01 0.00 0.00 0 1124 4 1 3 0 16
3J0L_1 - 0.65 0.47 0.90 9 1215 2 0 1 1 10
3J0L_g - -0.01 0.00 0.00 0 462 3 1 2 0 4
3J16_L 0.22 0.17 0.31 5 2759 11 0 11 0 25
3SD1_A 0.30 0.17 0.54 7 3903 6 0 6 0 35
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 0 0 0 0 1
3TS0_U - 0.91 0.83 1.00 5 248 0 0 0 0 1
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.35 0.26 0.48 11 4348 13 1 11 1 31
4ENB_A 0.43 0.32 0.60 6 1265 4 0 4 0 13
4ENC_A 0.43 0.32 0.60 6 1316 4 0 4 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.