CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of ProbKnot - scored higher in this pairwise comparison

  4. Performance of RNASLOpt - scored lower in this pairwise comparison

  5. Compile and download dataset for ProbKnot & RNASLOpt [.zip] - may take several seconds...


Overview

Metric ProbKnot RNASLOpt
MCC 0.611 > 0.591
Average MCC ± 95% Confidence Intervals 0.684 ± 0.125 > 0.668 ± 0.115
Sensitivity 0.558 > 0.498
Positive Predictive Value 0.676 < 0.709
Total TP 338 > 302
Total TN 64090 < 64164
Total FP 188 > 141
Total FP CONTRA 23 > 16
Total FP INCONS 139 > 108
Total FP COMP 26 > 17
Total FN 268 < 304
P-value 1.25365426827e-07

^top




Performance plots


^top





Performance of ProbKnot - scored higher in this pairwise comparison

1. Total counts & total scores for ProbKnot

Total Base Pair Counts
Total TP 338
Total TN 64090
Total FP 188
Total FP CONTRA 23
Total FP INCONS 139
Total FP COMP 26
Total FN 268
Total Scores
MCC 0.611
Average MCC ± 95% Confidence Intervals 0.684 ± 0.125
Sensitivity 0.558
Positive Predictive Value 0.676
Nr of predictions 30

^top



2. Individual counts for ProbKnot [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.85 0.77 0.94 30 6073 4 0 2 2 9
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.88 0.85 0.92 11 484 1 0 1 0 2
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.55 0.50 0.62 8 1115 5 2 3 0 8
3J0L_1 - 0.76 0.63 0.92 12 1212 3 0 1 2 7
3J0L_h - 0.77 0.65 0.90 28 6074 3 0 3 0 15
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_g - -0.01 0.00 0.00 0 458 7 2 5 0 4
3J0L_2 - 0.27 0.27 0.28 9 6184 26 2 21 3 24
3J16_L 0.35 0.33 0.38 10 2749 16 1 15 0 20
3SN2_B 1.00 1.00 1.00 12 394 0 0 0 0 0
3TRZ_Z - 0.91 0.83 1.00 5 205 2 0 0 2 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.45 0.35 0.59 13 3138 9 1 8 0 24
3UZL_B 0.73 0.62 0.85 23 3543 4 0 4 0 14
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.73 0.61 0.87 33 7102 6 1 4 1 21
4A1C_2 0.13 0.15 0.12 5 11738 49 7 31 11 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.73 0.58 0.92 11 1263 1 1 0 0 8
4ENC_A 0.45 0.42 0.50 8 1310 8 1 7 0 11

^top



Performance of RNASLOpt - scored lower in this pairwise comparison

1. Total counts & total scores for RNASLOpt

Total Base Pair Counts
Total TP 302
Total TN 64164
Total FP 141
Total FP CONTRA 16
Total FP INCONS 108
Total FP COMP 17
Total FN 304
Total Scores
MCC 0.591
Average MCC ± 95% Confidence Intervals 0.668 ± 0.115
Sensitivity 0.498
Positive Predictive Value 0.709
Nr of predictions 30

^top



2. Individual counts for RNASLOpt [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.47 0.35 0.64 7 1529 4 0 4 0 13
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.68 0.62 0.75 24 6073 9 0 8 1 15
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
3J0L_8 - 0.70 0.50 1.00 4 186 0 0 0 0 4
3J0L_a - 0.26 0.19 0.38 3 1120 5 1 4 0 13
3J0L_1 - 0.65 0.47 0.90 9 1215 3 0 1 2 10
3J0L_h - 0.70 0.49 1.00 21 6084 0 0 0 0 22
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.39 0.36 0.43 12 6188 18 2 14 2 21
3J16_L 0.53 0.40 0.71 12 2758 5 0 5 0 18
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 2 0 0 2 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.48 0.32 0.71 12 3553 5 0 5 0 25
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.67 0.52 0.88 28 7108 4 0 4 0 26
4A1C_2 0.23 0.24 0.22 8 11744 35 8 21 6 25
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.26 0.19 0.38 8 4350 13 2 11 0 34
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.65 0.47 0.90 9 1316 1 1 0 0 10

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.