CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of Afold - scored higher in this pairwise comparison

  4. Performance of PPfold(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for Afold & PPfold(seed) [.zip] - may take several seconds...


Overview

Metric Afold PPfold(seed)
MCC 0.665 > 0.472
Average MCC ± 95% Confidence Intervals 0.636 ± 0.128 > 0.453 ± 0.152
Sensitivity 0.649 > 0.263
Positive Predictive Value 0.686 < 0.854
Total TP 361 > 146
Total TN 73281 < 73636
Total FP 198 > 32
Total FP CONTRA 22 > 5
Total FP INCONS 143 > 20
Total FP COMP 33 > 7
Total FN 195 < 410
P-value 5.1503931209e-08

^top




Performance plots


  1. Comparison of performance of Afold and PPfold(seed). Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for Afold and PPfold(seed)).

  2. Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for Afold and PPfold(seed)).

  3. Comparison of average Matthews Correlation Coefficients (MCCs) for Afold and PPfold(seed). The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for Afold and PPfold(seed)).

^top





Performance of Afold - scored higher in this pairwise comparison

1. Total counts & total scores for Afold

Total Base Pair Counts
Total TP 361
Total TN 73281
Total FP 198
Total FP CONTRA 22
Total FP INCONS 143
Total FP COMP 33
Total FN 195
Total Scores
MCC 0.665
Average MCC ± 95% Confidence Intervals 0.636 ± 0.128
Sensitivity 0.649
Positive Predictive Value 0.686
Nr of predictions 25

^top



2. Individual counts for Afold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
RFA_00390 1.00 1.00 1.00 15 1416 2 0 0 2 0
RFA_00416 0.93 0.93 0.93 14 1470 4 0 1 3 1
RFA_00433 1.00 1.00 1.00 15 1416 2 0 0 2 0
RFA_00654 0.27 0.28 0.28 5 2397 14 2 11 1 13
RFA_00658 0.69 0.64 0.75 9 1116 5 0 3 2 5
RFA_00664 0.07 0.07 0.09 1 979 11 0 10 1 13
RFA_00708 0.47 0.36 0.63 5 1027 3 0 3 0 9
RFA_00749 0.66 0.67 0.67 8 891 5 1 3 1 4
RFA_00764 0.66 0.67 0.67 8 891 5 1 3 1 4
RFA_00765 1.00 1.00 1.00 12 891 1 0 0 1 0
RFA_00767 0.63 0.56 0.71 10 1877 5 0 4 1 8
RFA_00768 0.48 0.44 0.53 8 1876 8 1 6 1 10
RFA_00769 0.55 0.56 0.56 10 1935 10 3 5 2 8
RFA_00770 0.68 0.56 0.83 10 2004 6 0 2 4 8
RFA_00773 0.71 0.56 0.91 10 1942 5 1 0 4 8
RFA_00808 -0.01 0.00 0.00 0 2001 16 2 13 1 16
RFA_00809 0.36 0.38 0.35 6 2128 12 1 10 1 10
SRP_00084 0.81 0.82 0.80 28 5425 7 1 6 0 6
SRP_00105 -0.01 0.00 0.00 0 5532 33 4 29 0 34
SRP_00141 0.86 0.85 0.88 35 6288 5 1 4 0 6
SRP_00231 0.46 0.47 0.46 16 5425 19 1 18 0 18
SRP_00273 0.86 0.88 0.85 35 6745 8 1 5 2 5
SRP_00274 0.91 0.92 0.90 35 6864 5 1 3 1 3
SRP_00338 0.92 0.92 0.92 33 5424 4 0 3 1 3
SRP_00357 0.93 0.92 0.94 33 5321 3 1 1 1 3

^top



Performance of PPfold(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for PPfold(seed)

Total Base Pair Counts
Total TP 146
Total TN 73636
Total FP 32
Total FP CONTRA 5
Total FP INCONS 20
Total FP COMP 7
Total FN 410
Total Scores
MCC 0.472
Average MCC ± 95% Confidence Intervals 0.453 ± 0.152
Sensitivity 0.263
Positive Predictive Value 0.854
Nr of predictions 25

^top



2. Individual counts for PPfold(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
RFA_00390 1.00 1.00 1.00 15 1416 1 0 0 1 0
RFA_00416 1.00 1.00 1.00 15 1470 1 0 0 1 0
RFA_00433 1.00 1.00 1.00 15 1416 2 0 0 2 0
RFA_00654 0.23 0.17 0.33 3 2406 6 0 6 0 15
RFA_00658 0.38 0.14 1.00 2 1126 1 0 0 1 12
RFA_00664 0.38 0.14 1.00 2 988 1 0 0 1 12
RFA_00708 0.38 0.14 1.00 2 1033 1 0 0 1 12
RFA_00749 0.78 0.75 0.82 9 892 2 0 2 0 3
RFA_00764 0.78 0.75 0.82 9 892 2 0 2 0 3
RFA_00765 0.78 0.75 0.82 9 892 2 0 2 0 3
RFA_00767 0.68 0.56 0.83 10 1879 2 1 1 0 8
RFA_00768 0.68 0.56 0.83 10 1879 2 1 1 0 8
RFA_00769 0.68 0.56 0.83 10 1941 2 1 1 0 8
RFA_00770 0.68 0.56 0.83 10 2004 2 1 1 0 8
RFA_00773 0.68 0.56 0.83 10 1941 2 1 1 0 8
RFA_00808 0.75 0.56 1.00 9 2007 0 0 0 0 7
RFA_00809 0.50 0.38 0.67 6 2136 3 0 3 0 10
SRP_00084 0.00 0.00 0.00 0 5460 0 0 0 0 34
SRP_00105 0.00 0.00 0.00 0 5565 0 0 0 0 34
SRP_00141 0.00 0.00 0.00 0 6328 0 0 0 0 41
SRP_00231 0.00 0.00 0.00 0 5460 0 0 0 0 34
SRP_00273 0.00 0.00 0.00 0 6786 0 0 0 0 40
SRP_00274 0.00 0.00 0.00 0 6903 0 0 0 0 38
SRP_00338 0.00 0.00 0.00 0 5460 0 0 0 0 36
SRP_00357 0.00 0.00 0.00 0 5356 0 0 0 0 36

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.