CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Fold - scored higher in this pairwise comparison

  4. Performance of ProbKnot - scored lower in this pairwise comparison

  5. Compile and download dataset for Fold & ProbKnot [.zip] - may take several seconds...


Overview

Metric Fold ProbKnot
MCC 0.660 > 0.646
Average MCC ± 95% Confidence Intervals 0.706 ± 0.070 > 0.705 ± 0.068
Sensitivity 0.600 > 0.597
Positive Predictive Value 0.730 > 0.703
Total TP 1122 > 1117
Total TN 310625 > 310571
Total FP 494 < 559
Total FP CONTRA 63 < 79
Total FP INCONS 351 < 394
Total FP COMP 80 < 86
Total FN 748 < 753
P-value 6.06606238843e-08

^top




Performance plots


^top





Performance of Fold - scored higher in this pairwise comparison

1. Total counts & total scores for Fold

Total Base Pair Counts
Total TP 1122
Total TN 310625
Total FP 494
Total FP CONTRA 63
Total FP INCONS 351
Total FP COMP 80
Total FN 748
Total Scores
MCC 0.660
Average MCC ± 95% Confidence Intervals 0.706 ± 0.070
Sensitivity 0.600
Positive Predictive Value 0.730
Nr of predictions 74

^top



2. Individual counts for Fold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KRL_A - 0.76 0.60 0.96 24 5126 5 0 1 4 16
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.83 0.70 1.00 7 344 0 0 0 0 3
2KZL_A - 0.86 0.74 1.00 14 1471 0 0 0 0 5
2L1F_B 0.90 0.88 0.92 22 2121 2 0 2 0 3
2L1F_A 0.89 0.88 0.91 21 2057 2 0 2 0 3
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.39 0.26 0.63 5 622 3 1 2 0 14
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.85 0.79 0.91 31 6071 5 0 3 2 8
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.96 0.92 1.00 12 484 0 0 0 0 1
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2XKV_B 0.51 0.50 0.53 10 4541 24 0 9 15 10
2XQD_Y 0.88 0.78 1.00 21 2829 0 0 0 0 6
2XXA_G 0.93 0.86 1.00 36 5115 0 0 0 0 6
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.65 0.63 0.68 15 2256 8 1 6 1 9
2YIE_X - 0.25 0.25 0.27 3 1367 8 2 6 0 9
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
3AKZ_H 0.84 0.75 0.95 21 2679 1 1 0 0 7
3AM1_B - 0.78 0.71 0.86 25 3211 4 0 4 0 10
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3IYQ_A 0.29 0.31 0.27 29 60618 83 20 59 4 65
3IZ4_A 0.53 0.46 0.61 61 70776 44 5 34 5 71
3IZF_C 0.70 0.59 0.82 32 6864 7 1 6 0 22
3J0L_h - 0.81 0.65 1.00 28 6077 2 0 0 2 15
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_a - 0.20 0.19 0.23 3 1115 10 2 8 0 13
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_2 - 0.25 0.24 0.26 8 6185 25 2 21 2 25
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_7 - -0.01 0.00 0.00 0 1213 12 0 12 0 17
3J16_L 0.63 0.53 0.76 16 2754 5 0 5 0 14
3NDB_M - 0.84 0.74 0.96 45 9133 3 0 2 1 16
3NKB_B - 0.35 0.31 0.42 8 1997 11 0 11 0 18
3NMU_E - -0.01 0.00 0.00 0 552 11 2 7 2 6
3NPB_A 0.70 0.61 0.80 28 6986 10 1 6 3 18
3O58_2 0.71 0.71 0.71 27 7222 12 3 8 1 11
3O58_3 0.29 0.31 0.28 11 12363 41 3 26 12 24
3OVB_D - 1.00 1.00 1.00 11 584 1 0 0 1 0
3OVS_D - 0.96 0.92 1.00 12 549 0 0 0 0 1
3P22_G - 0.96 0.92 1.00 11 730 0 0 0 0 1
3PDR_A 0.77 0.64 0.94 46 12831 5 0 3 2 26
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.57 0.48 0.69 20 3887 9 1 8 0 22
3SIU_F - 0.85 0.73 1.00 8 370 0 0 0 0 3
3SN2_B 1.00 1.00 1.00 12 394 0 0 0 0 0
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.45 0.35 0.59 13 3138 9 1 8 0 24
3UZL_B 0.77 0.62 0.96 23 3546 1 0 1 0 14
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.68 0.57 0.82 31 7102 7 1 6 0 23
4A1C_2 0.14 0.15 0.14 5 11744 43 5 27 11 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.32 0.26 0.42 5 1263 7 1 6 0 14
4ENC_A 0.31 0.26 0.38 5 1313 8 1 7 0 14

^top



Performance of ProbKnot - scored lower in this pairwise comparison

1. Total counts & total scores for ProbKnot

Total Base Pair Counts
Total TP 1117
Total TN 310571
Total FP 559
Total FP CONTRA 79
Total FP INCONS 394
Total FP COMP 86
Total FN 753
Total Scores
MCC 0.646
Average MCC ± 95% Confidence Intervals 0.705 ± 0.068
Sensitivity 0.597
Positive Predictive Value 0.703
Nr of predictions 74

^top



2. Individual counts for ProbKnot [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KRL_A - 0.69 0.60 0.80 24 5121 11 2 4 5 16
2KX8_A 0.94 0.89 1.00 16 845 0 0 0 0 2
2KXM_A - 0.78 0.70 0.88 7 343 1 0 1 0 3
2KZL_A - 0.83 0.74 0.93 14 1470 1 0 1 0 5
2L1F_B 0.98 0.96 1.00 24 2121 0 0 0 0 1
2L1F_A 0.98 0.96 1.00 23 2057 0 0 0 0 1
2L2K_A - 0.94 0.89 1.00 17 844 0 0 0 0 2
2L3C_B - 0.91 0.82 1.00 14 547 0 0 0 0 3
2L3E_A - 0.96 0.92 1.00 12 583 1 0 0 1 1
2L3J_B 0.94 0.88 1.00 30 2455 0 0 0 0 4
2L5Z_A - 0.86 0.75 1.00 9 316 0 0 0 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LA5_A - 0.45 0.32 0.67 6 621 3 0 3 0 13
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LI4_A - 0.93 0.88 1.00 14 482 0 0 0 0 2
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.85 0.77 0.94 30 6073 4 0 2 2 9
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.88 0.85 0.92 11 484 1 0 1 0 2
2RRC_A - 0.70 0.50 1.00 5 226 0 0 0 0 5
2XKV_B 0.51 0.50 0.53 10 4541 24 0 9 15 10
2XQD_Y 0.90 0.81 1.00 22 2828 1 0 0 1 5
2XXA_G 0.26 0.24 0.29 10 5116 25 1 24 0 32
2Y8W_B - 1.00 1.00 1.00 6 184 1 0 0 1 0
2Y9C_V - 0.65 0.63 0.68 15 2256 8 1 6 1 9
2YIE_X - 0.34 0.33 0.36 4 1367 7 2 5 0 8
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
3AKZ_H 0.73 0.75 0.72 21 2672 8 4 4 0 7
3AM1_B - 0.74 0.71 0.78 25 3208 7 1 6 0 10
3AMU_B 0.65 0.59 0.73 16 2981 8 0 6 2 11
3IYQ_A 0.28 0.31 0.26 29 60616 85 22 59 4 65
3IZ4_A 0.52 0.46 0.60 61 70774 46 6 35 5 71
3IZF_C 0.72 0.61 0.85 33 6864 6 0 6 0 21
3J0L_h - 0.77 0.65 0.90 28 6074 3 0 3 0 15
3J0L_1 - 0.76 0.63 0.92 12 1212 3 0 1 2 7
3J0L_a - 0.55 0.50 0.62 8 1115 5 2 3 0 8
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_2 - 0.27 0.27 0.28 9 6184 26 2 21 3 24
3J0L_g - -0.01 0.00 0.00 0 458 7 2 5 0 4
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J16_L 0.35 0.33 0.38 10 2749 16 1 15 0 20
3NDB_M - 0.77 0.69 0.88 42 9132 7 0 6 1 19
3NKB_B - 0.59 0.54 0.67 14 1995 7 0 7 0 12
3NMU_E - -0.01 0.00 0.00 0 552 11 2 7 2 6
3NPB_A 0.72 0.61 0.85 28 6988 8 1 4 3 18
3O58_2 0.76 0.76 0.76 29 7222 10 3 6 1 9
3O58_3 0.31 0.34 0.29 12 12362 41 4 25 12 23
3OVB_D - 1.00 1.00 1.00 11 584 2 0 0 2 0
3OVS_D - 0.92 0.92 0.92 12 548 1 0 1 0 1
3P22_G - 0.96 0.92 1.00 11 730 1 0 0 1 1
3PDR_A 0.74 0.64 0.85 46 12826 10 1 7 2 26
3R4F_A - 0.96 0.92 1.00 23 2122 0 0 0 0 2
3R9X_C - 0.84 0.80 0.89 8 586 2 0 1 1 2
3RKF_A 0.73 0.59 0.91 20 2189 2 1 1 0 14
3SD1_A 0.55 0.48 0.65 20 3885 11 2 9 0 22
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 1.00 1.00 1.00 12 394 0 0 0 0 0
3TRZ_Z - 0.91 0.83 1.00 5 205 2 0 0 2 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.45 0.35 0.59 13 3138 9 1 8 0 24
3UZL_B 0.73 0.62 0.85 23 3543 4 0 4 0 14
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.73 0.61 0.87 33 7102 6 1 4 1 21
4A1C_2 0.13 0.15 0.12 5 11738 49 7 31 11 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.50 0.40 0.63 17 4344 11 2 8 1 25
4ENB_A 0.73 0.58 0.92 11 1263 1 1 0 0 8
4ENC_A 0.45 0.42 0.50 8 1310 8 1 7 0 11

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.