CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of RNASLOpt - scored higher in this pairwise comparison

  4. Performance of Vsfold5 - scored lower in this pairwise comparison

  5. Compile and download dataset for RNASLOpt & Vsfold5 [.zip] - may take several seconds...


Overview

Metric RNASLOpt Vsfold5
MCC 0.586 > 0.468
Average MCC ± 95% Confidence Intervals 0.662 ± 0.118 > 0.593 ± 0.142
Sensitivity 0.492 > 0.408
Positive Predictive Value 0.704 > 0.545
Total TP 293 > 243
Total TN 63823 > 63793
Total FP 140 < 223
Total FP CONTRA 15 < 18
Total FP INCONS 108 < 185
Total FP COMP 17 < 20
Total FN 302 < 352
P-value 5.10776592382e-08

^top




Performance plots


^top





Performance of RNASLOpt - scored higher in this pairwise comparison

1. Total counts & total scores for RNASLOpt

Total Base Pair Counts
Total TP 293
Total TN 63823
Total FP 140
Total FP CONTRA 15
Total FP INCONS 108
Total FP COMP 17
Total FN 302
Total Scores
MCC 0.586
Average MCC ± 95% Confidence Intervals 0.662 ± 0.118
Sensitivity 0.492
Positive Predictive Value 0.704
Nr of predictions 29

^top



2. Individual counts for RNASLOpt [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.47 0.35 0.64 7 1529 4 0 4 0 13
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.68 0.62 0.75 24 6073 9 0 8 1 15
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
3J0L_2 - 0.39 0.36 0.43 12 6188 18 2 14 2 21
3J0L_1 - 0.65 0.47 0.90 9 1215 3 0 1 2 10
3J0L_8 - 0.70 0.50 1.00 4 186 0 0 0 0 4
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_a - 0.26 0.19 0.38 3 1120 5 1 4 0 13
3J0L_h - 0.70 0.49 1.00 21 6084 0 0 0 0 22
3J16_L 0.53 0.40 0.71 12 2758 5 0 5 0 18
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 2 0 0 2 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.48 0.32 0.71 12 3553 5 0 5 0 25
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.23 0.24 0.22 8 11744 35 8 21 6 25
4A1C_3 0.67 0.52 0.88 28 7108 4 0 4 0 26
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.26 0.19 0.38 8 4350 13 2 11 0 34
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.65 0.47 0.90 9 1316 1 1 0 0 10

^top



Performance of Vsfold5 - scored lower in this pairwise comparison

1. Total counts & total scores for Vsfold5

Total Base Pair Counts
Total TP 243
Total TN 63793
Total FP 223
Total FP CONTRA 18
Total FP INCONS 185
Total FP COMP 20
Total FN 352
Total Scores
MCC 0.468
Average MCC ± 95% Confidence Intervals 0.593 ± 0.142
Sensitivity 0.408
Positive Predictive Value 0.545
Nr of predictions 29

^top



2. Individual counts for Vsfold5 [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A -0.01 0.00 0.00 0 1527 13 0 13 0 20
2LDL_A - 0.85 0.73 1.00 8 343 1 0 0 1 3
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.89 0.80 1.00 8 268 0 0 0 0 2
2LKR_A - 0.27 0.23 0.32 9 6077 19 2 17 0 30
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
3J0L_2 - 0.35 0.33 0.37 11 6186 21 3 16 2 22
3J0L_1 - 0.27 0.21 0.36 4 1214 7 1 6 0 15
3J0L_8 - 0.70 0.50 1.00 4 186 0 0 0 0 4
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_a - 0.39 0.31 0.50 5 1118 5 2 3 0 11
3J0L_h - 0.18 0.14 0.24 6 6080 19 1 18 0 37
3J16_L 0.82 0.67 1.00 20 2755 0 0 0 0 10
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.16 0.14 0.20 5 3545 20 1 19 0 32
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_2 0.24 0.24 0.24 8 11748 37 3 22 12 25
4A1C_3 0.26 0.22 0.32 12 7103 25 2 23 0 42
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.18 0.14 0.25 6 4347 19 1 17 1 36
4ENB_A 0.89 0.79 1.00 15 1260 0 0 0 0 4
4ENC_A 0.86 0.79 0.94 15 1310 1 1 0 0 4

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.