CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

  4. Performance of Cylofold - scored lower in this pairwise comparison

  5. Compile and download dataset for CentroidHomfold‑LAST & Cylofold [.zip] - may take several seconds...


Overview

Metric CentroidHomfold‑LAST Cylofold
MCC 0.703 > 0.271
Average MCC ± 95% Confidence Intervals 0.702 ± 0.301 > 0.275 ± 1.303
Sensitivity 0.613 > 0.241
Positive Predictive Value 0.808 > 0.308
Total TP 84 > 33
Total TN 60484 > 60481
Total FP 25 < 78
Total FP CONTRA 3 = 3
Total FP INCONS 17 < 71
Total FP COMP 5 > 4
Total FN 53 < 104
P-value 0.0

^top




Performance plots


  1. Comparison of performance of CentroidHomfold-LAST and Cylofold. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for CentroidHomfold‑LAST and Cylofold).

  2. Comparison of average Matthews Correlation Coefficients (MCCs) for CentroidHomfold-LAST and Cylofold. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for CentroidHomfold‑LAST and Cylofold).

^top





Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

1. Total counts & total scores for CentroidHomfold‑LAST

Total Base Pair Counts
Total TP 84
Total TN 60484
Total FP 25
Total FP CONTRA 3
Total FP INCONS 17
Total FP COMP 5
Total FN 53
Total Scores
MCC 0.703
Average MCC ± 95% Confidence Intervals 0.702 ± 0.301
Sensitivity 0.613
Positive Predictive Value 0.808
Nr of predictions 2

^top



2. Individual counts for CentroidHomfold‑LAST [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
ASE_00408 - 0.73 0.66 0.80 47 32326 13 2 10 1 24
ASE_00429 - 0.68 0.56 0.82 37 28158 12 1 7 4 29

^top



Performance of Cylofold - scored lower in this pairwise comparison

1. Total counts & total scores for Cylofold

Total Base Pair Counts
Total TP 33
Total TN 60481
Total FP 78
Total FP CONTRA 3
Total FP INCONS 71
Total FP COMP 4
Total FN 104
Total Scores
MCC 0.271
Average MCC ± 95% Confidence Intervals 0.275 ± 1.303
Sensitivity 0.241
Positive Predictive Value 0.308
Nr of predictions 2

^top



2. Individual counts for Cylofold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
ASE_00408 - 0.17 0.15 0.20 11 32329 45 3 42 0 60
ASE_00429 - 0.38 0.33 0.43 22 28152 33 0 29 4 44

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.