CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of PETfold_pre2.0(seed) - scored higher in this pairwise comparison

  4. Performance of RNAalifold(seed) - scored lower in this pairwise comparison

  5. Compile and download dataset for PETfold_pre2.0(seed) & RNAalifold(seed) [.zip] - may take several seconds...


Overview

Metric PETfold_pre2.0(seed) RNAalifold(seed)
MCC 0.575 > 0.472
Average MCC ± 95% Confidence Intervals 0.540 ± 0.149 > 0.444 ± 0.347
Sensitivity 0.459 > 0.293
Positive Predictive Value 0.726 < 0.765
Total TP 61 > 39
Total TN 20209 < 20242
Total FP 30 > 15
Total FP CONTRA 2 > 0
Total FP INCONS 21 > 12
Total FP COMP 7 > 3
Total FN 72 < 94
P-value 0.0

^top




Performance plots


  1. Comparison of performance of PETfold_pre2.0(seed) and RNAalifold(seed). Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for PETfold_pre2.0(seed) and RNAalifold(seed)).

  2. Comparison of average Matthews Correlation Coefficients (MCCs) for PETfold_pre2.0(seed) and RNAalifold(seed). The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for PETfold_pre2.0(seed) and RNAalifold(seed)).

^top





Performance of PETfold_pre2.0(seed) - scored higher in this pairwise comparison

1. Total counts & total scores for PETfold_pre2.0(seed)

Total Base Pair Counts
Total TP 61
Total TN 20209
Total FP 30
Total FP CONTRA 2
Total FP INCONS 21
Total FP COMP 7
Total FN 72
Total Scores
MCC 0.575
Average MCC ± 95% Confidence Intervals 0.540 ± 0.149
Sensitivity 0.459
Positive Predictive Value 0.726
Nr of predictions 5

^top



2. Individual counts for PETfold_pre2.0(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.40 0.30 0.55 6 1529 5 0 5 0 14
4A1C_2 0.57 0.45 0.71 15 11760 12 0 6 6 18
4AOB_A 0.72 0.57 0.92 24 4345 3 0 2 1 18
4ENB_A 0.50 0.42 0.62 8 1262 5 1 4 0 11
4ENC_A 0.50 0.42 0.62 8 1313 5 1 4 0 11

^top



Performance of RNAalifold(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for RNAalifold(seed)

Total Base Pair Counts
Total TP 39
Total TN 20242
Total FP 15
Total FP CONTRA 0
Total FP INCONS 12
Total FP COMP 3
Total FN 94
Total Scores
MCC 0.472
Average MCC ± 95% Confidence Intervals 0.444 ± 0.347
Sensitivity 0.293
Positive Predictive Value 0.765
Nr of predictions 5

^top



2. Individual counts for RNAalifold(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A -0.01 0.00 0.00 0 1528 12 0 12 0 20
4A1C_2 0.39 0.15 1.00 5 11776 2 0 0 2 28
4AOB_A 0.72 0.52 1.00 22 4349 1 0 0 1 20
4ENB_A 0.56 0.32 1.00 6 1269 0 0 0 0 13
4ENC_A 0.56 0.32 1.00 6 1320 0 0 0 0 13

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.