CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

  4. Performance of CRWrnafold - scored lower in this pairwise comparison

  5. Compile and download dataset for CentroidHomfold‑LAST & CRWrnafold [.zip] - may take several seconds...


Overview

Metric CentroidHomfold‑LAST CRWrnafold
MCC 0.648 > 0.576
Average MCC ± 95% Confidence Intervals 0.679 ± 0.118 > 0.630 ± 0.126
Sensitivity 0.501 < 0.513
Positive Predictive Value 0.845 > 0.654
Total TP 321 < 329
Total TN 69465 > 69342
Total FP 74 < 196
Total FP CONTRA 6 < 24
Total FP INCONS 53 < 150
Total FP COMP 15 < 22
Total FN 320 > 312
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

1. Total counts & total scores for CentroidHomfold‑LAST

Total Base Pair Counts
Total TP 321
Total TN 69465
Total FP 74
Total FP CONTRA 6
Total FP INCONS 53
Total FP COMP 15
Total FN 320
Total Scores
MCC 0.648
Average MCC ± 95% Confidence Intervals 0.679 ± 0.118
Sensitivity 0.501
Positive Predictive Value 0.845
Nr of predictions 31

^top



2. Individual counts for CentroidHomfold‑LAST [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1529 11 0 11 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LDT_A - 0.72 0.53 1.00 8 457 0 0 0 0 7
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.00 0.00 0.00 0 6101 4 0 4 0 39
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2YIE_Z - 0.82 0.67 1.00 8 1532 0 0 0 0 4
2YIE_X - 0.76 0.58 1.00 7 1371 0 0 0 0 5
3AMU_B 0.82 0.70 0.95 19 2983 3 0 1 2 8
3J0L_2 - 0.49 0.24 1.00 8 6208 0 0 0 0 25
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - -0.01 0.00 0.00 0 1125 3 0 3 0 16
3J0L_1 - 0.65 0.47 0.90 9 1215 2 0 1 1 10
3J0L_h - 0.76 0.63 0.93 27 6076 4 0 2 2 16
3J0L_7 - 0.60 0.41 0.88 7 1217 1 0 1 0 10
3J0L_g - 0.00 0.00 0.00 0 465 0 0 0 0 4
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3SD1_A 0.64 0.45 0.90 19 3895 2 0 2 0 23
3SN2_B 0.91 0.83 1.00 10 396 0 0 0 0 2
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.58 0.43 0.80 16 3140 4 0 4 0 21
4A1C_2 0.16 0.15 0.18 5 11753 29 5 18 6 28
4A1C_3 0.68 0.56 0.83 30 7104 6 0 6 0 24
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.71 0.50 1.00 21 4350 1 0 0 1 21
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.76 0.58 1.00 11 1315 0 0 0 0 8

^top



Performance of CRWrnafold - scored lower in this pairwise comparison

1. Total counts & total scores for CRWrnafold

Total Base Pair Counts
Total TP 329
Total TN 69342
Total FP 196
Total FP CONTRA 24
Total FP INCONS 150
Total FP COMP 22
Total FN 312
Total Scores
MCC 0.576
Average MCC ± 95% Confidence Intervals 0.630 ± 0.126
Sensitivity 0.513
Positive Predictive Value 0.654
Nr of predictions 31

^top



2. Individual counts for CRWrnafold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LBS_A - 1.00 1.00 1.00 14 482 0 0 0 0 0
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
2LDL_A - 0.85 0.73 1.00 8 343 1 0 0 1 3
2LDT_A - 0.85 0.73 1.00 11 454 0 0 0 0 4
2LHP_A - 0.93 0.88 1.00 14 652 0 0 0 0 2
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.52 0.44 0.63 17 6078 12 2 8 2 22
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2YIE_Z - -0.01 0.00 0.00 0 1525 15 3 12 0 12
2YIE_X - 0.36 0.33 0.40 4 1368 9 2 4 3 8
3AMU_B 0.67 0.59 0.76 16 2982 7 0 5 2 11
3J0L_2 - 0.25 0.24 0.28 8 6187 23 2 19 2 25
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_a - 0.39 0.31 0.50 5 1118 5 1 4 0 11
3J0L_1 - 0.76 0.63 0.92 12 1212 3 0 1 2 7
3J0L_h - 0.81 0.65 1.00 28 6077 0 0 0 0 15
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J16_L 0.84 0.70 1.00 21 2754 0 0 0 0 9
3SD1_A 0.52 0.45 0.61 19 3885 12 2 10 0 23
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 0 0 0 0 1
3TS0_U - 1.00 1.00 1.00 6 247 0 0 0 0 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
4A1C_2 0.13 0.15 0.13 5 11741 44 4 31 9 28
4A1C_3 0.70 0.59 0.84 32 7102 6 0 6 0 22
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.59 0.48 0.74 20 4344 8 2 5 1 22
4ENB_A 0.70 0.58 0.85 11 1262 2 1 1 0 8
4ENC_A 0.70 0.58 0.85 11 1313 2 1 1 0 8

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.