Table of contents:
- Overview
- Performance Plots
- Performance of PETfold_pre2.0(seed)
- scored higher in this pairwise comparison
- Performance of Carnac(seed)
- scored lower in this pairwise comparison
- Compile and download dataset for PETfold_pre2.0(seed) & Carnac(seed) [.zip] - may take several seconds...
Overview
| Metric |
PETfold_pre2.0(seed) |
|
Carnac(seed) |
| MCC |
0.687 |
>
|
0.467 |
| Average MCC ± 95% Confidence Intervals |
0.638
±
0.077
|
>
|
0.121
±
0.143
|
| Sensitivity |
0.577 |
>
|
0.245 |
| Positive Predictive Value |
0.820 |
<
|
0.890 |
| Total TP |
645 |
>
|
274 |
| Total TN |
1197782 |
<
|
1198261 |
| Total FP |
169 |
>
|
36 |
| Total FP CONTRA |
17 |
>
|
3 |
| Total FP INCONS |
125 |
>
|
31 |
| Total FP COMP |
27 |
>
|
2 |
| Total FN |
473 |
<
|
844 |
| P-value |
2.20167918023e-08 |
Performance plots
-
Comparison of performance of PETfold_pre2.0(seed) and Carnac(seed). Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data
(individual counts for PETfold_pre2.0(seed)
and Carnac(seed)).
-
Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data
(individual counts for PETfold_pre2.0(seed)
and Carnac(seed)).
-
Comparison of average Matthews Correlation Coefficients (MCCs) for PETfold_pre2.0(seed) and Carnac(seed). The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data
(individual counts for PETfold_pre2.0(seed)
and Carnac(seed)).
Performance of PETfold_pre2.0(seed)
- scored higher in this pairwise comparison
1. Total counts & total scores for PETfold_pre2.0(seed)
| Total Base Pair Counts |
| Total TP |
645 |
| Total TN |
1197782 |
| Total FP |
169 |
| Total FP CONTRA |
17 |
| Total FP INCONS |
125 |
| Total FP COMP |
27 |
| Total FN |
473 |
| Total Scores |
| MCC |
0.687 |
| Average MCC ± 95% Confidence Intervals |
0.638
±
0.077
|
| Sensitivity |
0.577 |
| Positive Predictive Value |
0.820 |
| Nr of predictions |
15 |
Performance of Carnac(seed)
- scored lower in this pairwise comparison
1. Total counts & total scores for Carnac(seed)
| Total Base Pair Counts |
| Total TP |
274 |
| Total TN |
1198261 |
| Total FP |
36 |
| Total FP CONTRA |
3 |
| Total FP INCONS |
31 |
| Total FP COMP |
2 |
| Total FN |
844 |
| Total Scores |
| MCC |
0.467 |
| Average MCC ± 95% Confidence Intervals |
0.121
±
0.143
|
| Sensitivity |
0.245 |
| Positive Predictive Value |
0.890 |
| Nr of predictions |
15 |
Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based
on the paper by Gardener & Giegerich, 2004.
|