CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Cylofold - scored higher in this pairwise comparison

  4. Performance of RDfolder - scored lower in this pairwise comparison

  5. Compile and download dataset for Cylofold & RDfolder [.zip] - may take several seconds...


Overview

Metric Cylofold RDfolder
MCC 0.706 > 0.588
Average MCC ± 95% Confidence Intervals 0.702 ± 0.077 > 0.613 ± 0.097
Sensitivity 0.613 > 0.494
Positive Predictive Value 0.821 > 0.710
Total TP 556 > 448
Total TN 69923 < 69969
Total FP 143 < 195
Total FP CONTRA 22 < 23
Total FP INCONS 99 < 160
Total FP COMP 22 > 12
Total FN 351 < 459
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of Cylofold - scored higher in this pairwise comparison

1. Total counts & total scores for Cylofold

Total Base Pair Counts
Total TP 556
Total TN 69923
Total FP 143
Total FP CONTRA 22
Total FP INCONS 99
Total FP COMP 22
Total FN 351
Total Scores
MCC 0.706
Average MCC ± 95% Confidence Intervals 0.702 ± 0.077
Sensitivity 0.613
Positive Predictive Value 0.821
Nr of predictions 48

^top



2. Individual counts for Cylofold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.70 0.50 1.00 5 346 0 0 0 0 5
2KZL_A - 0.72 0.53 1.00 10 1475 0 0 0 0 9
2L1F_B 0.92 0.84 1.00 21 2124 0 0 0 0 4
2L1F_A 0.91 0.83 1.00 20 2060 0 0 0 0 4
2L2K_A - 0.82 0.68 1.00 13 848 0 0 0 0 6
2L3C_B - 0.76 0.59 1.00 10 551 0 0 0 0 7
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.89 0.79 1.00 27 2458 0 0 0 0 7
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.46 0.26 0.83 5 624 1 0 1 0 14
2LC8_A 0.61 0.55 0.69 11 1524 5 0 5 0 9
2LDL_A - 0.73 0.55 1.00 6 345 0 0 0 0 5
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2XKV_B 0.38 0.40 0.36 8 4538 23 7 7 9 12
2XQD_Y 0.81 0.78 0.84 21 2825 4 4 0 0 6
2Y9C_V - 0.59 0.54 0.65 13 2258 8 1 6 1 11
2YIE_X - 0.30 0.33 0.29 4 1364 10 2 8 0 8
2YIE_Z - -0.01 0.00 0.00 0 1529 11 3 8 0 12
3ADB_C - 0.78 0.71 0.87 27 4155 4 0 4 0 11
3AKZ_H 0.66 0.57 0.76 16 2680 6 0 5 1 12
3AM1_B - 0.76 0.63 0.92 22 3216 2 0 2 0 13
3AMU_B 0.67 0.59 0.76 16 2982 7 0 5 2 11
3J0L_a - 0.22 0.19 0.27 3 1117 8 1 7 0 13
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_7 - 0.30 0.29 0.33 5 1210 10 0 10 0 12
3J0L_1 - 0.65 0.47 0.90 9 1215 2 0 1 1 10
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3NKB_B - 0.40 0.31 0.53 8 2001 7 0 7 0 18
3NMU_E - 0.20 0.17 0.25 1 557 6 1 2 3 5
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.62 0.50 0.78 21 3889 6 0 6 0 21
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 0.64 0.42 1.00 5 401 0 0 0 0 7
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.35 0.26 0.48 11 4348 13 1 11 1 31
4ENB_A 0.89 0.79 1.00 15 1260 0 0 0 0 4
4ENC_A 0.86 0.79 0.94 15 1310 1 1 0 0 4

^top



Performance of RDfolder - scored lower in this pairwise comparison

1. Total counts & total scores for RDfolder

Total Base Pair Counts
Total TP 448
Total TN 69969
Total FP 195
Total FP CONTRA 23
Total FP INCONS 160
Total FP COMP 12
Total FN 459
Total Scores
MCC 0.588
Average MCC ± 95% Confidence Intervals 0.613 ± 0.097
Sensitivity 0.494
Positive Predictive Value 0.710
Nr of predictions 48

^top



2. Individual counts for RDfolder [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KX8_A 0.88 0.78 1.00 14 847 0 0 0 0 4
2KXM_A - 0.70 0.50 1.00 5 346 0 0 0 0 5
2KZL_A - 0.78 0.74 0.82 14 1468 3 1 2 0 5
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L1F_A -0.01 0.00 0.00 0 2067 13 2 11 0 24
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.46 0.26 0.83 5 624 1 0 1 0 14
2LC8_A -0.01 0.00 0.00 0 1526 14 2 12 0 20
2LDL_A - 0.90 0.82 1.00 9 342 0 0 0 0 2
2LDT_A - 0.68 0.47 1.00 7 458 0 0 0 0 8
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2XKV_B 0.00 0.00 0.00 0 4538 22 5 17 0 20
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2Y9C_V - 0.57 0.50 0.67 12 2260 7 1 5 1 12
2YIE_X - 0.38 0.33 0.44 4 1369 5 1 4 0 8
2YIE_Z - 0.43 0.42 0.45 5 1529 6 3 3 0 7
3ADB_C - 0.46 0.39 0.54 15 4158 13 0 13 0 23
3AKZ_H 0.48 0.43 0.55 12 2679 11 1 9 1 16
3AM1_B - 0.47 0.43 0.54 15 3212 13 1 12 0 20
3AMU_B 0.18 0.15 0.22 4 2985 16 2 12 2 23
3J0L_a - -0.01 0.00 0.00 0 1124 4 1 3 0 16
3J0L_g - -0.01 0.00 0.00 0 462 3 1 2 0 4
3J0L_7 - -0.01 0.00 0.00 0 1220 5 0 5 0 17
3J0L_1 - 0.65 0.47 0.90 9 1215 2 0 1 1 10
3J16_L 0.22 0.17 0.31 5 2759 11 0 11 0 25
3NKB_B - 0.37 0.31 0.47 8 1999 9 0 9 0 18
3NMU_E - 0.41 0.17 1.00 1 560 3 0 0 3 5
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.91 0.83 1.00 10 731 0 0 0 0 2
3R4F_A - 0.76 0.68 0.85 17 2125 3 1 2 0 8
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.30 0.17 0.54 7 3903 6 0 6 0 35
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 0 0 0 0 1
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.35 0.26 0.48 11 4348 13 1 11 1 31
4ENB_A 0.43 0.32 0.60 6 1265 4 0 4 0 13
4ENC_A 0.43 0.32 0.60 6 1316 4 0 4 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.