CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of PPfold(20) - scored higher in this pairwise comparison

  4. Performance of PknotsRG - scored lower in this pairwise comparison

  5. Compile and download dataset for PPfold(20) & PknotsRG [.zip] - may take several seconds...


Overview

Metric PPfold(20) PknotsRG
MCC 0.820 > 0.444
Average MCC ± 95% Confidence Intervals 0.822 ± 0.054 > 0.442 ± 0.136
Sensitivity 0.766 > 0.432
Positive Predictive Value 0.879 > 0.457
Total TP 1463 > 825
Total TN 4652238 > 4652097
Total FP 286 < 1045
Total FP CONTRA 39 < 133
Total FP INCONS 162 < 847
Total FP COMP 85 > 65
Total FN 448 < 1086
P-value 0.0

^top




Performance plots


  1. Comparison of performance of PPfold(20) and PknotsRG. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for PPfold(20) and PknotsRG).

  2. Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for PPfold(20) and PknotsRG).

  3. Comparison of average Matthews Correlation Coefficients (MCCs) for PPfold(20) and PknotsRG. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for PPfold(20) and PknotsRG).

^top





Performance of PPfold(20) - scored higher in this pairwise comparison

1. Total counts & total scores for PPfold(20)

Total Base Pair Counts
Total TP 1463
Total TN 4652238
Total FP 286
Total FP CONTRA 39
Total FP INCONS 162
Total FP COMP 85
Total FN 448
Total Scores
MCC 0.820
Average MCC ± 95% Confidence Intervals 0.822 ± 0.054
Sensitivity 0.766
Positive Predictive Value 0.879
Nr of predictions 4

^top



2. Individual counts for PPfold(20) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
CRW_00256 0.82 0.78 0.87 363 1192324 70 13 40 17 105
CRW_00590 0.85 0.81 0.90 367 1119348 69 4 37 28 85
CRW_00997 0.83 0.81 0.86 374 1135845 75 15 44 16 90
PDB_01120 0.78 0.68 0.88 359 1204721 72 7 41 24 168

^top



Performance of PknotsRG - scored lower in this pairwise comparison

1. Total counts & total scores for PknotsRG

Total Base Pair Counts
Total TP 825
Total TN 4652097
Total FP 1045
Total FP CONTRA 133
Total FP INCONS 847
Total FP COMP 65
Total FN 1086
Total Scores
MCC 0.444
Average MCC ± 95% Confidence Intervals 0.442 ± 0.136
Sensitivity 0.432
Positive Predictive Value 0.457
Nr of predictions 4

^top



2. Individual counts for PknotsRG [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
CRW_00256 0.45 0.44 0.46 206 1192291 257 41 202 14 262
CRW_00590 0.32 0.31 0.33 141 1119330 303 41 244 18 311
CRW_00997 0.52 0.52 0.52 239 1135819 238 24 196 18 225
PDB_01120 0.48 0.45 0.51 239 1204657 247 27 205 15 288

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.