CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of ContextFold - scored higher in this pairwise comparison

  4. Performance of Carnac(20) - scored lower in this pairwise comparison

  5. Compile and download dataset for ContextFold & Carnac(20) [.zip] - may take several seconds...


Overview

Metric ContextFold Carnac(20)
MCC 0.579 > 0.476
Average MCC ± 95% Confidence Intervals 0.568 ± 0.278 > 0.299 ± 0.370
Sensitivity 0.443 > 0.281
Positive Predictive Value 0.763 < 0.810
Total TP 74 > 47
Total TN 25796 < 25835
Total FP 37 > 13
Total FP CONTRA 2 > 1
Total FP INCONS 21 > 10
Total FP COMP 14 > 2
Total FN 93 < 120
P-value 0.0

^top




Performance plots


^top





Performance of ContextFold - scored higher in this pairwise comparison

1. Total counts & total scores for ContextFold

Total Base Pair Counts
Total TP 74
Total TN 25796
Total FP 37
Total FP CONTRA 2
Total FP INCONS 21
Total FP COMP 14
Total FN 93
Total Scores
MCC 0.579
Average MCC ± 95% Confidence Intervals 0.568 ± 0.278
Sensitivity 0.443
Positive Predictive Value 0.763
Nr of predictions 5

^top



2. Individual counts for ContextFold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
4A1C_2 0.20 0.15 0.28 5 11763 26 0 13 13 28
4A1C_3 0.78 0.63 0.97 34 7105 1 0 1 0 20
4AOB_A 0.52 0.40 0.68 17 4346 9 1 7 1 25
4ENB_A 0.69 0.47 1.00 9 1266 0 0 0 0 10
4ENC_A 0.65 0.47 0.90 9 1316 1 1 0 0 10

^top



Performance of Carnac(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Carnac(20)

Total Base Pair Counts
Total TP 47
Total TN 25835
Total FP 13
Total FP CONTRA 1
Total FP INCONS 10
Total FP COMP 2
Total FN 120
Total Scores
MCC 0.476
Average MCC ± 95% Confidence Intervals 0.299 ± 0.370
Sensitivity 0.281
Positive Predictive Value 0.810
Nr of predictions 5

^top



2. Individual counts for Carnac(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
4A1C_2 0.33 0.15 0.71 5 11774 3 0 2 1 28
4A1C_3 0.67 0.52 0.88 28 7108 4 0 4 0 26
4AOB_A 0.49 0.33 0.74 14 4352 6 1 4 1 28
4ENB_A 0.00 0.00 0.00 0 1275 0 0 0 0 19
4ENC_A 0.00 0.00 0.00 0 1326 0 0 0 0 19

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.