CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of CRWrnafold - scored higher in this pairwise comparison

  4. Performance of Vsfold5 - scored lower in this pairwise comparison

  5. Compile and download dataset for CRWrnafold & Vsfold5 [.zip] - may take several seconds...


Overview

Metric CRWrnafold Vsfold5
MCC 0.580 > 0.454
Average MCC ± 95% Confidence Intervals 0.632 ± 0.126 > 0.554 ± 0.138
Sensitivity 0.517 > 0.398
Positive Predictive Value 0.659 > 0.528
Total TP 334 > 257
Total TN 69483 < 69503
Total FP 195 < 250
Total FP CONTRA 23 > 22
Total FP INCONS 150 < 208
Total FP COMP 22 > 20
Total FN 312 < 389
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of CRWrnafold - scored higher in this pairwise comparison

1. Total counts & total scores for CRWrnafold

Total Base Pair Counts
Total TP 334
Total TN 69483
Total FP 195
Total FP CONTRA 23
Total FP INCONS 150
Total FP COMP 22
Total FN 312
Total Scores
MCC 0.580
Average MCC ± 95% Confidence Intervals 0.632 ± 0.126
Sensitivity 0.517
Positive Predictive Value 0.659
Nr of predictions 31

^top



2. Individual counts for CRWrnafold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.85 0.73 1.00 8 343 1 0 0 1 3
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.93 0.88 1.00 14 652 0 0 0 0 2
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.52 0.44 0.63 17 6078 12 2 8 2 22
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2YIE_X - 0.36 0.33 0.40 4 1368 9 2 4 3 8
3AMU_B 0.67 0.59 0.76 16 2982 7 0 5 2 11
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.25 0.24 0.28 8 6187 23 2 19 2 25
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.39 0.31 0.50 5 1118 5 1 4 0 11
3J0L_1 - 0.76 0.63 0.92 12 1212 3 0 1 2 7
3J0L_h - 0.81 0.65 1.00 28 6077 0 0 0 0 15
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J16_L 0.84 0.70 1.00 21 2754 0 0 0 0 9
3SD1_A 0.52 0.45 0.61 19 3885 12 2 10 0 23
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 0 0 0 0 1
3TS0_U - 1.00 1.00 1.00 6 247 0 0 0 0 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
4A1C_2 0.13 0.15 0.13 5 11741 44 4 31 9 28
4A1C_3 0.70 0.59 0.84 32 7102 6 0 6 0 22
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.59 0.48 0.74 20 4344 8 2 5 1 22
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8
4ENC_A 0.70 0.58 0.85 11 1313 2 1 1 0 8

^top



Performance of Vsfold5 - scored lower in this pairwise comparison

1. Total counts & total scores for Vsfold5

Total Base Pair Counts
Total TP 257
Total TN 69503
Total FP 250
Total FP CONTRA 22
Total FP INCONS 208
Total FP COMP 20
Total FN 389
Total Scores
MCC 0.454
Average MCC ± 95% Confidence Intervals 0.554 ± 0.138
Sensitivity 0.398
Positive Predictive Value 0.528
Nr of predictions 31

^top



2. Individual counts for Vsfold5 [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1527 13 0 13 0 20
2LDL_A - 0.85 0.73 1.00 8 343 1 0 0 1 3
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LK3_A - 0.89 0.80 1.00 8 268 0 0 0 0 2
2LKR_A - 0.27 0.23 0.32 9 6077 19 2 17 0 30
2YIE_Z - -0.01 0.00 0.00 0 1529 11 3 8 0 12
2YIE_X - 0.30 0.33 0.29 4 1364 10 2 8 0 8
3AMU_B 0.67 0.59 0.76 16 2982 7 0 5 2 11
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.35 0.33 0.37 11 6186 21 3 16 2 22
3J0L_8 - 0.70 0.50 1.00 4 186 0 0 0 0 4
3J0L_a - 0.39 0.31 0.50 5 1118 5 2 3 0 11
3J0L_1 - 0.27 0.21 0.36 4 1214 7 1 6 0 15
3J0L_h - 0.18 0.14 0.24 6 6080 19 1 18 0 37
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J16_L 0.82 0.67 1.00 20 2755 0 0 0 0 10
3SD1_A 0.11 0.10 0.15 4 3890 22 0 22 0 38
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
4A1C_2 0.24 0.24 0.24 8 11748 37 3 22 12 25
4A1C_3 0.26 0.22 0.32 12 7103 25 2 23 0 42
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.18 0.14 0.25 6 4347 19 1 17 1 36
4ENB_A 0.89 0.79 1.00 15 1260 0 0 0 0 4
4ENC_A 0.86 0.79 0.94 15 1310 1 1 0 0 4

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.