CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of IPknot - scored higher in this pairwise comparison

  4. Performance of Cylofold - scored lower in this pairwise comparison

  5. Compile and download dataset for IPknot & Cylofold [.zip] - may take several seconds...


Overview

Metric IPknot Cylofold
MCC 0.669 > 0.583
Average MCC ± 95% Confidence Intervals 0.681 ± 0.103 > 0.624 ± 0.107
Sensitivity 0.559 > 0.498
Positive Predictive Value 0.809 > 0.692
Total TP 348 > 310
Total TN 56319 > 56301
Total FP 93 < 145
Total FP CONTRA 11 < 14
Total FP INCONS 71 < 124
Total FP COMP 11 > 7
Total FN 275 < 313
P-value 5.1503931209e-08

^top




Performance plots


^top





Performance of IPknot - scored higher in this pairwise comparison

1. Total counts & total scores for IPknot

Total Base Pair Counts
Total TP 348
Total TN 56319
Total FP 93
Total FP CONTRA 11
Total FP INCONS 71
Total FP COMP 11
Total FN 275
Total Scores
MCC 0.669
Average MCC ± 95% Confidence Intervals 0.681 ± 0.103
Sensitivity 0.559
Positive Predictive Value 0.809
Nr of predictions 30

^top



2. Individual counts for IPknot [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.40 0.30 0.55 6 1529 5 1 4 0 14
2LDL_A - 0.90 0.82 1.00 9 342 0 0 0 0 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.84 0.77 0.91 30 6072 4 0 3 1 9
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2YIE_Z - 0.43 0.42 0.45 5 1529 6 3 3 0 7
2YIE_X - 0.67 0.58 0.78 7 1369 3 1 1 1 5
3AMU_B 0.70 0.59 0.84 16 2984 5 0 3 2 11
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_a - 0.21 0.19 0.25 3 1116 9 1 8 0 13
3J0L_h - 0.78 0.60 1.00 26 6079 2 0 0 2 17
3J0L_7 - -0.01 0.00 0.00 0 1218 7 0 7 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.39 0.36 0.43 12 6188 18 2 14 2 21
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.61 0.48 0.80 20 3891 5 0 5 0 22
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.68 0.54 0.87 20 3137 3 1 2 0 17
3UZL_B 0.72 0.54 0.95 20 3549 1 0 1 0 17
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.42 0.33 0.54 14 4345 13 1 11 1 28
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.52 0.42 0.67 8 1314 4 0 4 0 11

^top



Performance of Cylofold - scored lower in this pairwise comparison

1. Total counts & total scores for Cylofold

Total Base Pair Counts
Total TP 310
Total TN 56301
Total FP 145
Total FP CONTRA 14
Total FP INCONS 124
Total FP COMP 7
Total FN 313
Total Scores
MCC 0.583
Average MCC ± 95% Confidence Intervals 0.624 ± 0.107
Sensitivity 0.498
Positive Predictive Value 0.692
Nr of predictions 30

^top



2. Individual counts for Cylofold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.61 0.55 0.69 11 1524 5 0 5 0 9
2LDL_A - 0.73 0.55 1.00 6 345 0 0 0 0 5
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.50 0.44 0.59 17 6076 12 2 10 0 22
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2YIE_Z - -0.01 0.00 0.00 0 1529 11 3 8 0 12
2YIE_X - 0.30 0.33 0.29 4 1364 10 2 8 0 8
3AMU_B 0.67 0.59 0.76 16 2982 7 0 5 2 11
3J0L_1 - 0.65 0.47 0.90 9 1215 2 0 1 1 10
3J0L_a - 0.22 0.19 0.27 3 1117 8 1 7 0 13
3J0L_h - 0.48 0.37 0.62 16 6079 10 0 10 0 27
3J0L_7 - 0.30 0.29 0.33 5 1210 10 0 10 0 12
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.39 0.36 0.43 12 6188 18 2 14 2 21
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.62 0.50 0.78 21 3889 6 0 6 0 21
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 0.64 0.42 1.00 5 401 0 0 0 0 7
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.45 0.38 0.54 14 3544 12 1 11 0 23
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.35 0.26 0.48 11 4348 13 1 11 1 31
4ENB_A 0.89 0.79 1.00 15 1260 0 0 0 0 4
4ENC_A 0.86 0.79 0.94 15 1310 1 1 0 0 4

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.