CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of PETfold_pre2.0(20) - scored higher in this pairwise comparison

  4. Performance of Carnac(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for PETfold_pre2.0(20) & Carnac(seed) [.zip] - may take several seconds...


Overview

Metric PETfold_pre2.0(20) Carnac(seed)
MCC 0.818 > 0.000
Average MCC ± 95% Confidence Intervals 0.818 ± 0.090 > 0.000 ± 0.000
Sensitivity 0.760 > 0.000
Positive Predictive Value 0.881 > 0.000
Total TP 259 > 0
Total TN 301891 < 302185
Total FP 66 > 0
Total FP CONTRA 8 > 0
Total FP INCONS 27 > 0
Total FP COMP 31 > 0
Total FN 82 < 341
P-value 0.0

^top




Performance plots


  1. Comparison of performance of PETfold_pre2.0(20) and Carnac(seed). Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for PETfold_pre2.0(20) and Carnac(seed)).

  2. Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for PETfold_pre2.0(20) and Carnac(seed)).

  3. Comparison of average Matthews Correlation Coefficients (MCCs) for PETfold_pre2.0(20) and Carnac(seed). The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for PETfold_pre2.0(20) and Carnac(seed)).

^top





Performance of PETfold_pre2.0(20) - scored higher in this pairwise comparison

1. Total counts & total scores for PETfold_pre2.0(20)

Total Base Pair Counts
Total TP 259
Total TN 301891
Total FP 66
Total FP CONTRA 8
Total FP INCONS 27
Total FP COMP 31
Total FN 82
Total Scores
MCC 0.818
Average MCC ± 95% Confidence Intervals 0.818 ± 0.090
Sensitivity 0.760
Positive Predictive Value 0.881
Nr of predictions 3

^top



2. Individual counts for PETfold_pre2.0(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
RFA_00599 0.86 0.82 0.90 91 101374 19 3 7 9 20
RFA_00601 0.80 0.74 0.88 84 99139 25 3 9 13 30
RFA_00602 0.79 0.72 0.87 84 101378 22 2 11 9 32

^top



Performance of Carnac(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for Carnac(seed)

Total Base Pair Counts
Total TP 0
Total TN 302185
Total FP 0
Total FP CONTRA 0
Total FP INCONS 0
Total FP COMP 0
Total FN 341
Total Scores
MCC 0.000
Average MCC ± 95% Confidence Intervals 0.000 ± 0.000
Sensitivity 0.000
Positive Predictive Value 0.000
Nr of predictions 3

^top



2. Individual counts for Carnac(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
RFA_00599 0.00 0.00 0.00 0 101475 0 0 0 0 111
RFA_00601 0.00 0.00 0.00 0 99235 0 0 0 0 114
RFA_00602 0.00 0.00 0.00 0 101475 0 0 0 0 116

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.