CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

  4. Performance of RNASLOpt - scored lower in this pairwise comparison

  5. Compile and download dataset for CentroidHomfold‑LAST & RNASLOpt [.zip] - may take several seconds...


Overview

Metric CentroidHomfold‑LAST RNASLOpt
MCC 0.645 > 0.581
Average MCC ± 95% Confidence Intervals 0.683 ± 0.127 > 0.659 ± 0.117
Sensitivity 0.502 > 0.488
Positive Predictive Value 0.836 > 0.699
Total TP 296 > 288
Total TN 63740 > 63682
Total FP 73 < 141
Total FP CONTRA 6 < 16
Total FP INCONS 52 < 108
Total FP COMP 15 < 17
Total FN 294 < 302
P-value 3.56938820447e-08

^top




Performance plots


^top





Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

1. Total counts & total scores for CentroidHomfold‑LAST

Total Base Pair Counts
Total TP 296
Total TN 63740
Total FP 73
Total FP CONTRA 6
Total FP INCONS 52
Total FP COMP 15
Total FN 294
Total Scores
MCC 0.645
Average MCC ± 95% Confidence Intervals 0.683 ± 0.127
Sensitivity 0.502
Positive Predictive Value 0.836
Nr of predictions 29

^top



2. Individual counts for CentroidHomfold‑LAST [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A -0.01 0.00 0.00 0 1529 11 0 11 0 20
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.00 0.00 0.00 0 6101 4 0 4 0 39
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
3J0L_2 - 0.49 0.24 1.00 8 6208 0 0 0 0 25
3J0L_8 - 0.93 0.88 1.00 7 183 0 0 0 0 1
3J0L_h - 0.76 0.63 0.93 27 6076 4 0 2 2 16
3J0L_7 - 0.60 0.41 0.88 7 1217 1 0 1 0 10
3J0L_g - 0.00 0.00 0.00 0 465 0 0 0 0 4
3J0L_a - -0.01 0.00 0.00 0 1125 3 0 3 0 16
3J0L_1 - 0.65 0.47 0.90 9 1215 2 0 1 1 10
3J16_L 0.75 0.57 1.00 17 2758 0 0 0 0 13
3SN2_B 0.91 0.83 1.00 10 396 0 0 0 0 2
3TRZ_Z - 0.91 0.83 1.00 5 205 1 0 0 1 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.58 0.43 0.80 16 3140 4 0 4 0 21
3UZL_B 0.72 0.54 0.95 20 3549 1 0 1 0 17
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.68 0.56 0.83 30 7104 6 0 6 0 24
4A1C_2 0.16 0.15 0.18 5 11753 29 5 18 6 28
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.71 0.50 1.00 21 4350 1 0 0 1 21
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.76 0.58 1.00 11 1315 0 0 0 0 8

^top



Performance of RNASLOpt - scored lower in this pairwise comparison

1. Total counts & total scores for RNASLOpt

Total Base Pair Counts
Total TP 288
Total TN 63682
Total FP 141
Total FP CONTRA 16
Total FP INCONS 108
Total FP COMP 17
Total FN 302
Total Scores
MCC 0.581
Average MCC ± 95% Confidence Intervals 0.659 ± 0.117
Sensitivity 0.488
Positive Predictive Value 0.699
Nr of predictions 29

^top



2. Individual counts for RNASLOpt [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.47 0.35 0.64 7 1529 4 0 4 0 13
2LDL_A - 0.90 0.82 1.00 9 342 1 0 0 1 2
2LHP_A - 0.97 0.94 1.00 15 651 0 0 0 0 1
2LJJ_A - 1.00 1.00 1.00 8 343 2 0 0 2 0
2LK3_A - 0.95 0.90 1.00 9 267 0 0 0 0 1
2LKR_A - 0.68 0.62 0.75 24 6073 9 0 8 1 15
2LQZ_A - 0.85 0.82 0.90 9 341 1 1 0 0 2
2LWK_A - 0.83 0.77 0.91 10 485 1 0 1 0 3
3J0L_2 - 0.39 0.36 0.43 12 6188 18 2 14 2 21
3J0L_8 - 0.70 0.50 1.00 4 186 0 0 0 0 4
3J0L_h - 0.70 0.49 1.00 21 6084 0 0 0 0 22
3J0L_7 - -0.01 0.00 0.00 0 1212 13 0 13 0 17
3J0L_g - -0.01 0.00 0.00 0 461 4 1 3 0 4
3J0L_a - 0.26 0.19 0.38 3 1120 5 1 4 0 13
3J0L_1 - 0.65 0.47 0.90 9 1215 3 0 1 2 10
3J16_L 0.53 0.40 0.71 12 2758 5 0 5 0 18
3SN2_B 0.96 0.92 1.00 11 395 0 0 0 0 1
3TRZ_Z - 0.91 0.83 1.00 5 205 2 0 0 2 1
3TS0_U - 1.00 1.00 1.00 6 247 1 0 0 1 0
3TS2_V - 1.00 1.00 1.00 5 271 0 0 0 0 0
3U4M_B - 0.38 0.32 0.46 12 3134 14 0 14 0 25
3UZL_B 0.48 0.32 0.71 12 3553 5 0 5 0 25
3VJR_D - 0.96 0.92 1.00 12 618 0 0 0 0 1
4A1C_3 0.67 0.52 0.88 28 7108 4 0 4 0 26
4A1C_2 0.23 0.24 0.22 8 11744 35 8 21 6 25
4A4U_A - 1.00 1.00 1.00 9 222 0 0 0 0 0
4AOB_A 0.26 0.19 0.38 8 4350 13 2 11 0 34
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.65 0.47 0.90 9 1316 1 1 0 0 10

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.