CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

  4. Performance of IPknot - scored lower in this pairwise comparison

  5. Compile and download dataset for CentroidHomfold‑LAST & IPknot [.zip] - may take several seconds...


Overview

Metric CentroidHomfold‑LAST IPknot
MCC 0.670 > 0.669
Average MCC ± 95% Confidence Intervals 0.703 ± 0.100 < 0.705 ± 0.094
Sensitivity 0.522 < 0.567
Positive Predictive Value 0.866 > 0.796
Total TP 395 < 429
Total TN 77025 > 76942
Total FP 78 < 129
Total FP CONTRA 6 < 17
Total FP INCONS 55 < 93
Total FP COMP 17 < 19
Total FN 362 > 328
P-value 0.893076023681

^top




Performance plots


^top





Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

1. Total counts & total scores for CentroidHomfold‑LAST

Total Base Pair Counts
Total TP 395
Total TN 77025
Total FP 78
Total FP CONTRA 6
Total FP INCONS 55
Total FP COMP 17
Total FN 362
Total Scores
MCC 0.670
Average MCC ± 95% Confidence Intervals 0.703 ± 0.100
Sensitivity 0.522
Positive Predictive Value 0.866
Nr of predictions 37

^top



2. Individual counts for CentroidHomfold‑LAST [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1529 11 0 11 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.72 0.53 1.00 8 457 0 0 0 0 7
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.00 0.00 0.00 0 6101 4 0 4 0 39
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2YIE_X - 0.76 0.58 1.00 7 1371 0 0 0 0 5
2YIE_Z - 0.82 0.67 1.00 8 1532 0 0 0 0 4
3AMU_B 0.82 0.70 0.95 19 2983 3 0 1 2 8
3J0L_7 - 0.60 0.41 0.88 7 1217 1 0 1 0 10
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - -0.01 0.00 0.00 0 1125 3 0 3 0 16
3J0L_1 - 0.65 0.47 0.90 9 1215 2 0 1 1 10
3J0L_h - 0.76 0.63 0.93 27 6076 4 0 2 2 16
3J0L_g - 0.00 0.00 0.00 0 465 0 0 0 0 4
3J0L_2 - 0.49 0.24 1.00 8 6208 0 0 0 0 25
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3RKF_A 0.72 0.53 1.00 18 2193 0 0 0 0 16
3SD1_A 0.64 0.45 0.90 19 3895 2 0 2 0 23
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 0.91 0.83 1.00 10 396 0 0 0 0 2
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.58 0.43 0.80 16 3140 4 0 4 0 21
3UZL_B 0.72 0.54 0.95 20 3549 1 0 1 0 17
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.68 0.56 0.83 30 7104 6 0 6 0 24
4A1C_2 0.16 0.15 0.18 5 11753 29 5 18 6 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.71 0.50 1.00 21 4350 1 0 0 1 21
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.76 0.58 1.00 11 1315 0 0 0 0 8

^top



Performance of IPknot - scored lower in this pairwise comparison

1. Total counts & total scores for IPknot

Total Base Pair Counts
Total TP 429
Total TN 76942
Total FP 129
Total FP CONTRA 17
Total FP INCONS 93
Total FP COMP 19
Total FN 328
Total Scores
MCC 0.669
Average MCC ± 95% Confidence Intervals 0.705 ± 0.094
Sensitivity 0.567
Positive Predictive Value 0.796
Nr of predictions 37

^top



2. Individual counts for IPknot [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A 0.40 0.30 0.55 6 1529 5 1 4 0 14
2LDL_A - 0.90 0.82 1.00 9 342 0 0 0 0 2
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.84 0.77 0.91 30 6072 4 0 3 1 9
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
2YIE_X - 0.67 0.58 0.78 7 1369 3 1 1 1 5
2YIE_Z - 0.43 0.42 0.45 5 1529 6 3 3 0 7
3AMU_B 0.70 0.59 0.84 16 2984 5 0 3 2 11
3J0L_7 - -0.01 0.00 0.00 0 1218 7 0 7 0 17
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.21 0.19 0.25 3 1116 9 1 8 0 13
3J0L_1 - 0.76 0.63 0.92 12 1212 2 0 1 1 7
3J0L_h - 0.78 0.60 1.00 26 6079 2 0 0 2 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_2 - 0.39 0.36 0.43 12 6188 18 2 14 2 21
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.61 0.48 0.80 20 3891 5 0 5 0 22
3SIU_F - 0.73 0.55 1.00 6 372 0 0 0 0 5
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.68 0.54 0.87 20 3137 3 1 2 0 17
3UZL_B 0.72 0.54 0.95 20 3549 1 0 1 0 17
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.69 0.57 0.84 31 7103 6 1 5 0 23
4A1C_2 0.17 0.15 0.19 5 11755 26 4 17 5 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.42 0.33 0.54 14 4345 13 1 11 1 28
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.52 0.42 0.67 8 1314 4 0 4 0 11

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.