CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of CentroidFold - scored higher in this pairwise comparison

  4. Performance of Fold - scored lower in this pairwise comparison

  5. Compile and download dataset for CentroidFold & Fold [.zip] - may take several seconds...


Overview

Metric CentroidFold Fold
MCC 0.556 > 0.531
Average MCC ± 95% Confidence Intervals 0.663 ± 0.054 > 0.655 ± 0.059
Sensitivity 0.464 < 0.476
Positive Predictive Value 0.668 > 0.593
Total TP 2072 < 2126
Total TN 2786026 > 2785542
Total FP 1144 < 1609
Total FP CONTRA 98 < 150
Total FP INCONS 933 < 1311
Total FP COMP 113 < 148
Total FN 2393 > 2339
P-value 3.56938820447e-08

^top




Performance plots


  1. Comparison of performance of CentroidFold and Fold. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for CentroidFold and Fold).

  2. Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for CentroidFold and Fold).

  3. Comparison of average Matthews Correlation Coefficients (MCCs) for CentroidFold and Fold. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for CentroidFold and Fold).

^top





Performance of CentroidFold - scored higher in this pairwise comparison

1. Total counts & total scores for CentroidFold

Total Base Pair Counts
Total TP 2072
Total TN 2786026
Total FP 1144
Total FP CONTRA 98
Total FP INCONS 933
Total FP COMP 113
Total FN 2393
Total Scores
MCC 0.556
Average MCC ± 95% Confidence Intervals 0.663 ± 0.054
Sensitivity 0.464
Positive Predictive Value 0.668
Nr of predictions 113

^top



2. Individual counts for CentroidFold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.47 0.31 0.71 5 696 2 0 2 0 11
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.89 0.80 1.00 8 343 0 0 0 0 2
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.92 0.90 0.95 18 971 1 0 1 0 2
2LA5_A - 0.42 0.26 0.71 5 623 2 0 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A 0.49 0.35 0.70 7 1530 3 1 2 0 13
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.82 0.74 0.91 29 6073 4 0 3 1 10
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LU0_A - 0.93 0.88 1.00 14 1162 0 0 0 0 2
2LWK_A - 0.92 0.92 0.92 12 483 1 0 1 0 1
2M58_A - 0.09 0.06 0.14 1 1646 6 0 6 0 16
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WWQ_V 0.80 0.68 0.95 19 2906 3 0 1 2 9
2XKV_B 0.51 0.50 0.53 10 4541 25 0 9 16 10
2XQD_Y 0.75 0.67 0.86 18 2829 3 0 3 0 9
2XXA_G 0.15 0.12 0.20 5 5126 20 1 19 0 37
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.66 0.63 0.71 15 2257 8 1 5 2 9
2YIE_Z - 0.43 0.42 0.45 5 1529 6 3 3 0 7
2YIE_X - 0.67 0.58 0.78 7 1369 3 1 1 1 5
3ADB_C - 0.92 0.84 1.00 32 4154 0 0 0 0 6
3AKZ_H 0.43 0.39 0.48 11 2678 12 2 10 0 17
3AM1_B - 0.68 0.63 0.73 22 3210 8 1 7 0 13
3AMU_B 0.70 0.59 0.84 16 2984 5 0 3 2 11
3IYQ_A 0.36 0.37 0.34 35 60624 71 17 50 4 59
3IZ4_A 0.55 0.45 0.68 59 70789 33 4 24 5 73
3IZF_C 0.68 0.61 0.77 33 6860 10 1 9 0 21
3J0L_h - 0.77 0.65 0.90 28 6074 5 0 3 2 15
3J0L_1 - 0.65 0.47 0.90 9 1215 2 0 1 1 10
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_2 - 0.25 0.24 0.28 8 6187 24 0 21 3 25
3J0L_a - 0.41 0.31 0.56 5 1119 4 2 2 0 11
3J0L_g - 0.00 0.00 0.00 0 465 0 0 0 0 4
3J0L_7 - -0.01 0.00 0.00 0 1220 5 0 5 0 17
3J16_L 0.50 0.40 0.63 12 2756 7 0 7 0 18
3J20_1 0.91 0.87 0.95 20 2905 2 0 1 1 3
3J20_2 0.56 0.48 0.67 303 1116310 158 8 144 6 330
3J20_0 0.44 0.40 0.50 12 2826 13 0 12 1 18
3J2C_M - 0.40 0.29 0.57 59 106387 47 5 40 2 148
3J2C_O - 0.76 0.65 0.89 41 10250 6 0 5 1 22
3J2L_3 0.53 0.49 0.58 26 7830 21 0 19 2 27
3J3D_C 0.49 0.43 0.57 12 2754 9 0 9 0 16
3J3E_8 0.00 0.00 0.00 0 7485 21 2 16 3 33
3J3E_7 0.46 0.37 0.59 20 7106 14 1 13 0 34
3J3F_8 0.34 0.33 0.34 12 12211 34 4 19 11 24
3J3F_7 0.20 0.18 0.23 9 7221 30 1 29 0 41
3J3V_B 0.47 0.37 0.60 21 6986 14 1 13 0 36
3NDB_M - 0.80 0.70 0.91 43 9133 5 0 4 1 18
3NKB_B - 0.57 0.50 0.65 13 1996 7 0 7 0 13
3NMU_E - 0.71 0.50 1.00 3 558 3 0 0 3 3
3NPB_A 0.77 0.70 0.86 32 6984 7 1 4 2 14
3O58_2 0.82 0.76 0.88 29 7227 7 1 3 3 9
3O58_3 0.38 0.29 0.50 10 12383 10 0 10 0 25
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 1 0 0 1 1
3PDR_A 0.73 0.60 0.90 43 12832 7 0 5 2 29
3R4F_A - 0.81 0.76 0.86 19 2123 3 1 2 0 6
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.58 0.48 0.71 20 3888 8 1 7 0 22
3SIU_F - 0.79 0.64 1.00 7 371 0 0 0 0 4
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.57 0.46 0.71 17 3136 7 0 7 0 20
3UZL_B 0.72 0.54 0.95 20 3549 1 0 1 0 17
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
3W1K_J 0.56 0.50 0.63 19 4156 11 2 9 0 19
3W3S_B 0.87 0.78 0.97 31 4721 2 0 1 1 9
3ZEX_G - 0.36 0.28 0.46 21 16425 29 2 23 4 53
3ZEX_F - 0.00 0.00 0.00 0 2619 9 2 7 0 12
3ZEX_C 0.47 0.27 0.82 14 14179 3 1 2 0 38
3ZEX_H - 0.19 0.18 0.21 7 9011 27 4 23 0 31
3ZEX_B - 0.23 0.16 0.34 87 1072121 178 9 163 6 471
3ZEX_D 0.73 0.59 0.91 29 6989 3 0 3 0 20
3ZEX_E - 0.00 0.00 0.00 0 21895 52 3 47 2 77
3ZND_W 0.20 0.22 0.19 5 2977 23 1 20 2 18
4A1C_2 0.16 0.15 0.17 5 11752 29 5 19 5 28
4A1C_3 0.67 0.56 0.81 30 7103 7 1 6 0 24
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.45 0.33 0.61 14 4348 10 1 8 1 28
4ATO_G - 0.31 0.20 0.50 2 524 2 0 2 0 8
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.73 0.58 0.92 11 1314 1 1 0 0 8
4FNJ_A - 0.15 0.13 0.22 2 586 7 0 7 0 14
4FRG_B 0.24 0.22 0.28 7 3461 18 3 15 0 25
4FRN_A 0.40 0.28 0.59 10 5134 7 2 5 0 26
4HXH_A - 1.00 1.00 1.00 6 319 0 0 0 0 0
4JF2_A 0.78 0.61 1.00 19 2831 0 0 0 0 12
4JRC_A - 0.81 0.70 0.94 16 1523 1 0 1 0 7

^top



Performance of Fold - scored lower in this pairwise comparison

1. Total counts & total scores for Fold

Total Base Pair Counts
Total TP 2126
Total TN 2785542
Total FP 1609
Total FP CONTRA 150
Total FP INCONS 1311
Total FP COMP 148
Total FN 2339
Total Scores
MCC 0.531
Average MCC ± 95% Confidence Intervals 0.655 ± 0.059
Sensitivity 0.476
Positive Predictive Value 0.593
Nr of predictions 113

^top



2. Individual counts for Fold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.83 0.69 1.00 11 692 0 0 0 0 5
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.83 0.70 1.00 7 344 0 0 0 0 3
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_A 0.89 0.88 0.91 21 2057 2 0 2 0 3
2L1F_B 0.90 0.88 0.92 22 2121 2 0 2 0 3
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.85 0.79 0.91 31 6071 5 0 3 2 8
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LU0_A - 0.93 0.88 1.00 14 1162 0 0 0 0 2
2LWK_A - 0.96 0.92 1.00 12 484 0 0 0 0 1
2M58_A - -0.01 0.00 0.00 0 1638 15 0 15 0 17
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WWQ_V 0.76 0.64 0.90 18 2906 3 0 2 1 10
2XKV_B 0.51 0.50 0.53 10 4541 24 0 9 15 10
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.93 0.86 1.00 36 5115 0 0 0 0 6
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.65 0.63 0.68 15 2256 8 1 6 1 9
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2YIE_X - 0.25 0.25 0.27 3 1367 8 2 6 0 9
3ADB_C - 0.80 0.74 0.88 28 4154 4 0 4 0 10
3AKZ_H 0.84 0.75 0.95 21 2679 1 1 0 0 7
3AM1_B - 0.78 0.71 0.86 25 3211 4 0 4 0 10
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3IYQ_A 0.29 0.31 0.27 29 60618 83 20 59 4 65
3IZ4_A 0.53 0.46 0.61 61 70776 44 5 34 5 71
3IZF_C 0.70 0.59 0.82 32 6864 7 1 6 0 22
3J0L_h - 0.81 0.65 1.00 28 6077 2 0 0 2 15
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_2 - 0.25 0.24 0.26 8 6185 25 2 21 2 25
3J0L_a - 0.20 0.19 0.23 3 1115 10 2 8 0 13
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_7 - -0.01 0.00 0.00 0 1213 12 0 12 0 17
3J16_L 0.63 0.53 0.76 16 2754 5 0 5 0 14
3J20_1 0.96 0.91 1.00 21 2905 0 0 0 0 2
3J20_2 0.45 0.40 0.51 256 1116260 253 15 234 4 377
3J20_0 0.45 0.40 0.52 12 2827 12 0 11 1 18
3J2C_M - 0.19 0.15 0.23 32 106350 110 5 104 1 175
3J2C_O - 0.59 0.54 0.65 34 10244 18 1 17 0 29
3J2L_3 0.62 0.53 0.74 28 7837 12 0 10 2 25
3J3D_C 0.47 0.43 0.52 12 2752 11 1 10 0 16
3J3E_8 0.00 0.00 0.00 0 7478 34 2 23 9 33
3J3E_7 0.46 0.37 0.57 20 7105 15 1 14 0 34
3J3F_8 0.28 0.28 0.29 10 12211 39 5 20 14 26
3J3F_7 0.79 0.68 0.92 34 7223 4 0 3 1 16
3J3V_B 0.51 0.42 0.63 24 6983 14 1 13 0 33
3NDB_M - 0.84 0.74 0.96 45 9133 3 0 2 1 16
3NKB_B - 0.35 0.31 0.42 8 1997 11 0 11 0 18
3NMU_E - -0.01 0.00 0.00 0 552 11 2 7 2 6
3NPB_A 0.70 0.61 0.80 28 6986 10 1 6 3 18
3O58_2 0.71 0.71 0.71 27 7222 12 3 8 1 11
3O58_3 0.29 0.31 0.28 11 12363 41 3 26 12 24
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.77 0.64 0.94 46 12831 5 0 3 2 26
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.57 0.48 0.69 20 3887 9 1 8 0 22
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 1.00 1.00 1.00 12 394 0 0 0 0 0
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.45 0.35 0.59 13 3138 9 1 8 0 24
3UZL_B 0.77 0.62 0.96 23 3546 1 0 1 0 14
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
3W1K_J 0.87 0.79 0.97 30 4155 1 1 0 0 8
3W3S_B 0.85 0.75 0.97 30 4722 2 0 1 1 10
3ZEX_G - 0.76 0.65 0.89 48 16417 12 0 6 6 26
3ZEX_F - 0.00 0.00 0.00 0 2617 11 2 9 0 12
3ZEX_C 0.22 0.21 0.24 11 14151 45 4 30 11 41
3ZEX_H - 0.18 0.18 0.19 7 9008 30 5 25 0 31
3ZEX_B - 0.27 0.24 0.30 135 1071923 334 34 288 12 423
3ZEX_D 0.76 0.67 0.87 33 6983 5 1 4 0 16
3ZEX_E - 0.00 0.00 0.00 0 21890 57 2 53 2 77
3ZND_W 0.20 0.22 0.19 5 2977 23 1 20 2 18
4A1C_2 0.14 0.15 0.14 5 11744 43 5 27 11 28
4A1C_3 0.68 0.57 0.82 31 7102 7 1 6 0 23
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ATO_G - 0.32 0.30 0.38 3 520 5 1 4 0 7
4ENB_A 0.32 0.26 0.42 5 1263 7 1 6 0 14
4ENC_A 0.31 0.26 0.38 5 1313 8 1 7 0 14
4FNJ_A - 0.79 0.63 1.00 10 585 0 0 0 0 6
4FRG_B 0.24 0.22 0.27 7 3460 19 3 16 0 25
4FRN_A 0.41 0.36 0.46 13 5123 15 2 13 0 23
4HXH_A - 1.00 1.00 1.00 6 319 0 0 0 0 0
4JF2_A 0.78 0.61 1.00 19 2831 0 0 0 0 12
4JRC_A - 0.29 0.26 0.35 6 1523 11 0 11 0 17

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.