CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

  4. Performance of CMfinder(20) - scored lower in this pairwise comparison

  5. Compile and download dataset for CentroidHomfold‑LAST & CMfinder(20) [.zip] - may take several seconds...


Overview

Metric CentroidHomfold‑LAST CMfinder(20)
MCC 0.591 > 0.546
Average MCC ± 95% Confidence Intervals 0.562 ± 0.334 > 0.560 ± 0.222
Sensitivity 0.543 > 0.366
Positive Predictive Value 0.650 < 0.822
Total TP 89 > 60
Total TN 21095 < 21159
Total FP 51 > 15
Total FP CONTRA 6 > 1
Total FP INCONS 42 > 12
Total FP COMP 3 > 2
Total FN 75 < 104
P-value 0.0

^top




Performance plots


  1. Comparison of performance of CentroidHomfold-LAST and CMfinder(20). Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for CentroidHomfold‑LAST and CMfinder(20)).

  2. Comparison of average Matthews Correlation Coefficients (MCCs) for CentroidHomfold-LAST and CMfinder(20). The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for CentroidHomfold‑LAST and CMfinder(20)).

^top





Performance of CentroidHomfold‑LAST - scored higher in this pairwise comparison

1. Total counts & total scores for CentroidHomfold‑LAST

Total Base Pair Counts
Total TP 89
Total TN 21095
Total FP 51
Total FP CONTRA 6
Total FP INCONS 42
Total FP COMP 3
Total FN 75
Total Scores
MCC 0.591
Average MCC ± 95% Confidence Intervals 0.562 ± 0.334
Sensitivity 0.543
Positive Predictive Value 0.650
Nr of predictions 4

^top



2. Individual counts for CentroidHomfold‑LAST [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
3J20_0 0.35 0.37 0.34 11 2818 22 3 18 1 19
3J2L_3 0.73 0.62 0.87 33 7837 7 0 5 2 20
3ZEX_D 0.75 0.65 0.86 32 6984 5 0 5 0 17
4FRG_B 0.41 0.41 0.43 13 3456 17 3 14 0 19

^top



Performance of CMfinder(20) - scored lower in this pairwise comparison

1. Total counts & total scores for CMfinder(20)

Total Base Pair Counts
Total TP 60
Total TN 21159
Total FP 15
Total FP CONTRA 1
Total FP INCONS 12
Total FP COMP 2
Total FN 104
Total Scores
MCC 0.546
Average MCC ± 95% Confidence Intervals 0.560 ± 0.222
Sensitivity 0.366
Positive Predictive Value 0.822
Nr of predictions 4

^top



2. Individual counts for CMfinder(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
3J20_0 0.75 0.57 1.00 17 2833 1 0 0 1 13
3J2L_3 0.45 0.32 0.63 17 7848 11 1 9 1 36
3ZEX_D 0.58 0.39 0.86 19 6999 3 0 3 0 30
4FRG_B 0.47 0.22 1.00 7 3479 0 0 0 0 25

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.