CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Cylofold - scored higher in this pairwise comparison

  4. Performance of Alterna - scored lower in this pairwise comparison

  5. Compile and download dataset for Cylofold & Alterna [.zip] - may take several seconds...


Overview

Metric Cylofold Alterna
MCC 0.690 > 0.560
Average MCC ± 95% Confidence Intervals 0.622 ± 0.285 > 0.511 ± 0.227
Sensitivity 0.657 > 0.552
Positive Predictive Value 0.739 > 0.587
Total TP 88 > 74
Total TN 5773 > 5766
Total FP 32 < 53
Total FP CONTRA 6 < 12
Total FP INCONS 25 < 40
Total FP COMP 1 = 1
Total FN 46 < 60
P-value 0.0

^top



Performance plots


  1. Comparison of performance of Cylofold and Alterna. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for Cylofold and Alterna).

  2. Comparison of average Matthews Correlation Coefficients (MCCs) for Cylofold and Alterna. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for Cylofold and Alterna).

^top




Performance of Cylofold - scored higher in this pairwise comparison

1. Total counts & total scores for Cylofold

Total Base Pair Counts
Total TP 88
Total TN 5773
Total FP 32
Total FP CONTRA 6
Total FP INCONS 25
Total FP COMP 1
Total FN 46
Total Scores
MCC 0.690
Average MCC ± 95% Confidence Intervals 0.622 ± 0.285
Sensitivity 0.657
Positive Predictive Value 0.739
Nr of predictions 6

^top


2. Individual counts for Cylofold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A

GP_knot1 links to Rfam database...

0.64 0.61 0.69 11 512 5 1 4 0 7
3ADB_C - 0.84 0.82 0.87 27 1788 4 0 4 0 6
3J0L_a - 0.17 0.18 0.20 2 401 9 3 5 1 9
3NKB_B - 0.46 0.42 0.53 8 720 7 0 7 0 11
3RKF_A

Purine links to Rfam database...

0.91 0.83 1.00 20 846 0 0 0 0 4
3SD1_A

THF links to Rfam database...

0.71 0.69 0.74 20 1506 7 2 5 0 9

^top


Performance of Alterna - scored lower in this pairwise comparison

1. Total counts & total scores for Alterna

Total Base Pair Counts
Total TP 74
Total TN 5766
Total FP 53
Total FP CONTRA 12
Total FP INCONS 40
Total FP COMP 1
Total FN 60
Total Scores
MCC 0.560
Average MCC ± 95% Confidence Intervals 0.511 ± 0.227
Sensitivity 0.552
Positive Predictive Value 0.587
Nr of predictions 6

^top


2. Individual counts for Alterna [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A

GP_knot1 links to Rfam database...

0.47 0.44 0.53 8 513 7 0 7 0 10
3ADB_C - 0.63 0.64 0.64 21 1786 12 1 11 0 12
3J0L_a - 0.18 0.18 0.22 2 402 8 3 4 1 9
3NKB_B - 0.41 0.42 0.42 8 716 11 3 8 0 11
3RKF_A

Purine links to Rfam database...

0.82 0.79 0.86 19 844 3 1 2 0 5
3SD1_A

THF links to Rfam database...

0.55 0.55 0.57 16 1505 12 4 8 0 13

^top

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.

Copyright© - Adam Mickiewicz University & IIMCB - All rights reserved