CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Sfold - scored higher in this pairwise comparison

  4. Performance of UNAFold - scored lower in this pairwise comparison

  5. Compile and download dataset for Sfold & UNAFold [.zip] - may take several seconds...


Overview

Metric Sfold UNAFold
MCC 0.527 > 0.508
Average MCC ± 95% Confidence Intervals 0.708 ± 0.049 < 0.709 ± 0.049
Sensitivity 0.448 < 0.454
Positive Predictive Value 0.621 > 0.569
Total TP 2751 < 2791
Total TN 13412870 > 13412396
Total FP 1869 < 2327
Total FP CONTRA 252 < 301
Total FP INCONS 1428 < 1813
Total FP COMP 189 < 213
Total FN 3395 > 3355
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of Sfold - scored higher in this pairwise comparison

1. Total counts & total scores for Sfold

Total Base Pair Counts
Total TP 2751
Total TN 13412870
Total FP 1869
Total FP CONTRA 252
Total FP INCONS 1428
Total FP COMP 189
Total FN 3395
Total Scores
MCC 0.527
Average MCC ± 95% Confidence Intervals 0.708 ± 0.049
Sensitivity 0.448
Positive Predictive Value 0.621
Nr of predictions 121

^top



2. Individual counts for Sfold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2K5Z_A - 1.00 1.00 1.00 11 395 0 0 0 0 0
2K63_A - 0.95 0.90 1.00 9 397 0 0 0 0 1
2K66_A - 0.95 0.90 1.00 9 222 0 0 0 0 1
2KD8_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.92 0.89 0.94 17 1110 2 0 1 1 2
2KEZ_A - 0.89 0.80 1.00 8 268 0 0 0 0 2
2KFC_A - -0.02 0.00 0.00 0 623 7 0 7 0 20
2KGP_A - 1.00 1.00 1.00 9 291 1 0 0 1 0
2KMJ_A - 1.00 1.00 1.00 11 367 0 0 0 0 0
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.83 0.69 1.00 11 692 0 0 0 0 5
2KUR_A 0.90 0.86 0.95 18 1109 1 0 1 0 3
2KUU_A 0.87 0.81 0.94 17 1110 2 0 1 1 4
2KUV_A 0.88 0.82 0.95 18 1109 1 0 1 0 4
2KUW_A 0.90 0.86 0.95 18 1109 1 0 1 0 3
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.89 0.80 1.00 8 343 0 0 0 0 2
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A 0.45 0.35 0.58 7 1528 5 0 5 0 13
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.89 0.79 1.00 31 6074 1 0 0 1 8
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.88 0.85 0.92 11 484 1 0 1 0 2
2RP0_A - 0.64 0.42 1.00 5 346 0 0 0 0 7
2RPT_A - 1.00 1.00 1.00 7 183 0 0 0 0 0
2RRC_A - 0.83 0.70 1.00 7 224 0 0 0 0 3
2WDL_A - 0.41 0.34 0.50 410 3937401 411 25 385 1 794
2WRQ_Y 0.53 0.53 0.53 9 2833 13 5 3 5 8
2WW9_E - 0.53 0.29 1.00 4 557 0 0 0 0 10
2WW9_D - 0.29 0.12 0.75 3 1949 1 0 1 0 23
2WW9_F - 0.69 0.70 0.70 7 290 3 0 3 0 3
2WWQ_V 0.80 0.68 0.95 19 2906 2 0 1 1 9
2XKV_B 0.51 0.50 0.53 10 4541 23 0 9 14 10
2XQD_Y 0.77 0.67 0.90 18 2830 2 0 2 0 9
2XXA_G 0.36 0.31 0.43 13 5121 17 1 16 0 29
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.65 0.63 0.68 15 2256 8 1 6 1 9
2YIE_X - 0.58 0.33 1.00 4 1374 0 0 0 0 8
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2ZY6_A - 0.58 0.58 0.58 7 691 5 1 4 0 5
2ZZM_B 0.12 0.09 0.17 3 3468 15 0 15 0 29
2ZZN_D 0.82 0.78 0.88 21 2461 3 0 3 0 6
3A2K_C 0.42 0.39 0.46 11 2902 13 2 11 0 17
3A3A_A 0.87 0.76 1.00 28 3627 0 0 0 0 9
3ADB_C - 0.62 0.55 0.70 21 4156 9 0 9 0 17
3AKZ_H 0.44 0.39 0.50 11 2679 11 2 9 0 17
3AM1_B - 0.69 0.63 0.76 22 3211 7 1 6 0 13
3AMU_B 0.70 0.59 0.84 16 2984 5 0 3 2 11
3DW4_A - -0.02 0.00 0.00 0 345 6 0 6 0 10
3G4S_9 0.51 0.39 0.69 22 7349 10 1 9 0 35
3GCA_A - 0.54 0.29 1.00 5 523 0 0 0 0 12
3GX2_A 0.72 0.55 0.96 22 4348 2 0 1 1 18
3HAY_E - 0.91 0.83 1.00 15 2263 6 0 0 6 3
3HJW_D - 0.94 0.89 1.00 16 1637 2 0 0 2 2
3IAB_R - 0.92 0.86 1.00 12 1023 0 0 0 0 2
3ID5_D - 0.49 0.33 0.75 3 492 1 0 1 0 6
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IWN_A 0.63 0.58 0.70 19 4251 9 0 8 1 14
3IYQ_A 0.33 0.34 0.32 32 60627 71 19 48 4 62
3IZ4_A 0.52 0.42 0.65 56 70790 31 3 27 1 76
3IZF_C 0.71 0.61 0.83 33 6863 7 0 7 0 21
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_2 - 0.36 0.33 0.39 11 6188 19 2 15 2 22
3J0L_g - -0.01 0.00 0.00 0 460 5 1 4 0 4
3J0L_7 - -0.01 0.00 0.00 0 1222 3 0 3 0 17
3J0L_h - 0.75 0.60 0.93 26 6077 4 0 2 2 17
3J0L_1 - 0.76 0.63 0.92 12 1212 3 0 1 2 7
3J0L_a - 0.51 0.50 0.53 8 1113 7 3 4 0 8
3J16_L 0.29 0.23 0.37 7 2756 12 0 12 0 23
3JYV_7 -0.01 0.00 0.00 0 2834 16 0 16 0 32
3JYX_3 0.62 0.63 0.61 17 6300 19 1 10 8 10
3JYX_5 - 0.35 0.32 0.39 286 5022127 525 142 310 73 607
3JYX_4 0.35 0.30 0.42 10 12222 23 3 11 9 23
3KIY_A - 0.43 0.34 0.55 424 4053360 352 20 324 8 817
3KTW_C - 0.74 0.63 0.87 27 4529 5 2 2 1 16
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NDB_M - 0.81 0.69 0.95 42 9136 3 0 2 1 19
3NKB_B - 0.64 0.54 0.78 14 1998 4 0 4 0 12
3NMU_E - 0.61 0.50 0.75 3 557 4 0 1 3 3
3NPB_A 0.77 0.65 0.91 30 6988 6 1 2 3 16
3O58_2 0.74 0.74 0.74 28 7222 11 3 7 1 10
3O58_3 0.43 0.34 0.55 12 12381 17 0 10 7 23
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.69 0.56 0.85 40 12833 9 0 7 2 32
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.65 0.50 0.84 21 3891 4 1 3 0 21
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 2 0 0 2 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.51 0.32 0.80 12 3555 3 2 1 0 25
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.69 0.57 0.84 31 7103 6 1 5 0 23
4A1C_2 0.16 0.15 0.17 5 11751 34 2 23 9 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.51 0.26 1.00 5 1321 0 0 0 0 14

^top



Performance of UNAFold - scored lower in this pairwise comparison

1. Total counts & total scores for UNAFold

Total Base Pair Counts
Total TP 2791
Total TN 13412396
Total FP 2327
Total FP CONTRA 301
Total FP INCONS 1813
Total FP COMP 213
Total FN 3355
Total Scores
MCC 0.508
Average MCC ± 95% Confidence Intervals 0.709 ± 0.049
Sensitivity 0.454
Positive Predictive Value 0.569
Nr of predictions 121

^top



2. Individual counts for UNAFold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2K5Z_A - 0.95 0.91 1.00 10 396 0 0 0 0 1
2K63_A - 0.95 0.90 1.00 9 397 0 0 0 0 1
2K66_A - 0.95 0.90 1.00 9 222 0 0 0 0 1
2KD8_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
2KDQ_B 0.95 0.91 1.00 10 396 0 0 0 0 1
2KE6_A 0.97 0.95 1.00 18 1110 1 0 0 1 1
2KEZ_A - 0.89 0.80 1.00 8 268 0 0 0 0 2
2KFC_A - -0.02 0.00 0.00 0 623 7 0 7 0 20
2KGP_A - 1.00 1.00 1.00 9 291 1 0 0 1 0
2KMJ_A - 1.00 1.00 1.00 11 367 0 0 0 0 0
2KPV_A - 0.96 0.92 1.00 12 549 0 0 0 0 1
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KU0_A - 0.83 0.69 1.00 11 692 0 0 0 0 5
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.83 0.70 1.00 7 344 0 0 0 0 3
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.81 0.67 1.00 10 455 0 0 0 0 5
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.93 0.87 1.00 34 6071 1 0 0 1 5
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2RP0_A - 0.64 0.42 1.00 5 346 0 0 0 0 7
2RPT_A - 1.00 1.00 1.00 7 183 0 0 0 0 0
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2WDL_A - 0.40 0.34 0.47 415 3937338 469 30 438 1 789
2WRQ_Y 0.57 0.59 0.56 10 2832 13 5 3 5 7
2WW9_E - 0.53 0.29 1.00 4 557 0 0 0 0 10
2WW9_D - 0.18 0.12 0.30 3 1943 7 3 4 0 23
2WW9_F - 0.59 0.60 0.60 6 290 4 0 4 0 4
2WWQ_V 0.78 0.68 0.90 19 2905 3 0 2 1 9
2XKV_B 0.47 0.45 0.50 9 4542 21 0 9 12 11
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.34 0.31 0.39 13 5118 20 1 19 0 29
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.62 0.58 0.67 14 2257 8 1 6 1 10
2YIE_X - 0.36 0.33 0.40 4 1368 6 2 4 0 8
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2ZY6_A - 0.58 0.58 0.58 7 691 5 1 4 0 5
2ZZM_B 0.21 0.19 0.25 6 3462 18 0 18 0 26
2ZZN_D 0.84 0.78 0.91 21 2462 2 0 2 0 6
3A2K_C 0.42 0.39 0.46 11 2902 13 2 11 0 17
3A3A_A 0.87 0.76 1.00 28 3627 0 0 0 0 9
3ADB_C - 0.80 0.74 0.88 28 4154 4 0 4 0 10
3AKZ_H 0.43 0.39 0.48 11 2678 12 2 10 0 17
3AM1_B - 0.68 0.63 0.73 22 3210 8 1 7 0 13
3AMU_B 0.70 0.59 0.84 16 2984 5 0 3 2 11
3DW4_A - 0.71 0.60 0.86 6 344 1 0 1 0 4
3G4S_9 0.50 0.39 0.67 22 7348 11 1 10 0 35
3GCA_A - 0.54 0.29 1.00 5 523 0 0 0 0 12
3GX2_A 0.68 0.55 0.85 22 4345 5 0 4 1 18
3HAY_E - 0.91 0.83 1.00 15 2263 6 0 0 6 3
3HJW_D - 0.91 0.83 1.00 15 1638 2 0 0 2 3
3IAB_R - 0.92 0.86 1.00 12 1023 0 0 0 0 2
3ID5_D - 0.44 0.33 0.60 3 491 5 0 2 3 6
3IVN_B 0.78 0.61 1.00 19 2327 0 0 0 0 12
3IWN_A 0.74 0.67 0.81 22 4251 6 0 5 1 11
3IYQ_A 0.31 0.33 0.28 31 60617 82 22 56 4 63
3IZ4_A 0.51 0.45 0.58 60 70772 50 4 40 6 72
3IZF_C 0.70 0.61 0.80 33 6862 8 1 7 0 21
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_2 - 0.25 0.24 0.26 8 6185 25 2 21 2 25
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_7 - 0.48 0.41 0.58 7 1213 5 0 5 0 10
3J0L_h - 0.75 0.60 0.93 26 6077 4 0 2 2 17
3J0L_1 - 0.70 0.58 0.85 11 1212 2 0 2 0 8
3J0L_a - 0.51 0.50 0.53 8 1113 7 3 4 0 8
3J16_L 0.26 0.23 0.30 7 2752 16 1 15 0 23
3JYV_7 0.22 0.19 0.29 6 2829 15 0 15 0 26
3JYX_3 0.62 0.63 0.61 17 6300 22 1 10 11 10
3JYX_5 - 0.31 0.31 0.31 277 5021967 702 167 454 81 616
3JYX_4 0.32 0.30 0.34 10 12217 31 3 16 12 23
3KIY_A - 0.41 0.35 0.48 429 4053241 467 22 436 9 812
3KTW_C - 0.77 0.65 0.90 28 4529 4 2 1 1 15
3LA5_A 0.78 0.62 1.00 21 2464 0 0 0 0 13
3NDB_M - 0.84 0.74 0.96 45 9133 3 0 2 1 16
3NKB_B - 0.59 0.54 0.67 14 1995 7 0 7 0 12
3NMU_E - 0.54 0.50 0.60 3 556 5 0 2 3 3
3NPB_A 0.78 0.65 0.94 30 6989 5 0 2 3 16
3O58_2 0.71 0.71 0.71 27 7222 12 4 7 1 11
3O58_3 0.35 0.34 0.35 12 12369 33 1 21 11 23
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.77 0.64 0.94 46 12831 5 0 3 2 26
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.64 0.52 0.79 22 3888 6 1 5 0 20
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.48 0.38 0.61 14 3547 9 0 9 0 23
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.70 0.59 0.82 32 7101 7 1 6 0 22
4A1C_2 0.14 0.15 0.14 5 11745 42 5 26 11 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8
4ENC_A 0.32 0.26 0.42 5 1314 7 1 6 0 14

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.