CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Multilign(20) - scored higher in this pairwise comparison

  4. Performance of Alterna - scored lower in this pairwise comparison

  5. Compile and download dataset for Multilign(20) & Alterna [.zip] - may take several seconds...


Overview

Metric Multilign(20) Alterna
MCC 0.706 > 0.654
Average MCC ± 95% Confidence Intervals 0.734 ± 0.286 > 0.692 ± 0.338
Sensitivity 0.610 > 0.569
Positive Predictive Value 0.824 > 0.761
Total TP 75 > 70
Total TN 10029 > 10028
Total FP 18 < 24
Total FP CONTRA 1 < 2
Total FP INCONS 15 < 20
Total FP COMP 2 = 2
Total FN 48 < 53
P-value 0.0

^top




Performance plots


^top





Performance of Multilign(20) - scored higher in this pairwise comparison

1. Total counts & total scores for Multilign(20)

Total Base Pair Counts
Total TP 75
Total TN 10029
Total FP 18
Total FP CONTRA 1
Total FP INCONS 15
Total FP COMP 2
Total FN 48
Total Scores
MCC 0.706
Average MCC ± 95% Confidence Intervals 0.734 ± 0.286
Sensitivity 0.610
Positive Predictive Value 0.824
Nr of predictions 4

^top



2. Individual counts for Multilign(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
3AMU_B 0.63 0.56 0.71 15 2982 8 0 6 2 12
3RKF_A 0.77 0.62 0.95 21 2189 1 0 1 0 13
3SD1_A 0.57 0.48 0.69 20 3887 9 1 8 0 22

^top



Performance of Alterna - scored lower in this pairwise comparison

1. Total counts & total scores for Alterna

Total Base Pair Counts
Total TP 70
Total TN 10028
Total FP 24
Total FP CONTRA 2
Total FP INCONS 20
Total FP COMP 2
Total FN 53
Total Scores
MCC 0.654
Average MCC ± 95% Confidence Intervals 0.692 ± 0.338
Sensitivity 0.569
Positive Predictive Value 0.761
Nr of predictions 4

^top



2. Individual counts for Alterna [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
3AMU_B 0.64 0.59 0.70 16 2980 9 0 7 2 11
3RKF_A 0.69 0.56 0.86 19 2189 3 1 2 0 15
3SD1_A 0.46 0.38 0.57 16 3888 12 1 11 0 26

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.