CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of RNASampler(seed) - scored higher in this pairwise comparison

  4. Performance of Fold - scored lower in this pairwise comparison

  5. Compile and download dataset for RNASampler(seed) & Fold [.zip] - may take several seconds...


Overview

Metric RNASampler(seed) Fold
MCC 0.614 > 0.608
Average MCC ± 95% Confidence Intervals 0.633 ± 0.161 < 0.668 ± 0.204
Sensitivity 0.461 < 0.571
Positive Predictive Value 0.822 > 0.654
Total TP 189 < 234
Total TN 60297 > 60169
Total FP 59 < 160
Total FP CONTRA 3 < 15
Total FP INCONS 38 < 109
Total FP COMP 18 < 36
Total FN 221 > 176
P-value 0.00454636894862

^top




Performance plots


  1. Comparison of performance of RNASampler(seed) and Fold. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for RNASampler(seed) and Fold).

  2. Comparison of performance of RNASampler(seed) and Fold. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for RNASampler(seed) and Fold).

  3. Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for RNASampler(seed) and Fold).

  4. Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for RNASampler(seed) and Fold).

  5. Comparison of average Matthews Correlation Coefficients (MCCs) for RNASampler(seed) and Fold. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for RNASampler(seed) and Fold).

  6. Comparison of average Matthews Correlation Coefficients (MCCs) for RNASampler(seed) and Fold. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for RNASampler(seed) and Fold).

^top





Performance of RNASampler(seed) - scored higher in this pairwise comparison

1. Total counts & total scores for RNASampler(seed)

Total Base Pair Counts
Total TP 189
Total TN 60297
Total FP 59
Total FP CONTRA 3
Total FP INCONS 38
Total FP COMP 18
Total FN 221
Total Scores
MCC 0.614
Average MCC ± 95% Confidence Intervals 0.633 ± 0.161
Sensitivity 0.461
Positive Predictive Value 0.822
Nr of predictions 14

^top



2. Individual counts for RNASampler(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KUR_A 0.90 0.81 1.00 17 1111 0 0 0 0 4
2KUU_A 0.87 0.76 1.00 16 1112 1 0 0 1 5
2KUV_A 0.88 0.77 1.00 17 1111 0 0 0 0 5
2KUW_A 0.90 0.81 1.00 17 1111 0 0 0 0 4
2L1F_A 0.81 0.67 1.00 16 2064 0 0 0 0 8
2L1F_B 0.82 0.68 1.00 17 2128 0 0 0 0 8
2L94_A 0.71 0.55 0.92 11 978 1 0 1 0 9
2LC8_A -0.01 0.00 0.00 0 1530 10 0 10 0 20
3O58_3 0.45 0.34 0.60 12 12383 12 2 6 4 23
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.60 0.38 0.94 16 3899 1 0 1 0 26
3W3S_B 0.55 0.30 1.00 12 4741 1 0 0 1 28
3ZEX_C 0.32 0.19 0.53 10 14177 13 1 8 4 42
4A1C_2 0.31 0.24 0.40 8 11761 20 0 12 8 25

^top



Performance of Fold - scored lower in this pairwise comparison

1. Total counts & total scores for Fold

Total Base Pair Counts
Total TP 234
Total TN 60169
Total FP 160
Total FP CONTRA 15
Total FP INCONS 109
Total FP COMP 36
Total FN 176
Total Scores
MCC 0.608
Average MCC ± 95% Confidence Intervals 0.668 ± 0.204
Sensitivity 0.571
Positive Predictive Value 0.654
Nr of predictions 14

^top



2. Individual counts for Fold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2KUR_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2KUU_A 0.92 0.86 1.00 18 1110 1 0 0 1 3
2KUV_A 0.93 0.86 1.00 19 1109 0 0 0 0 3
2KUW_A 0.95 0.90 1.00 19 1109 0 0 0 0 2
2L1F_A 0.89 0.88 0.91 21 2057 2 0 2 0 3
2L1F_B 0.90 0.88 0.92 22 2121 2 0 2 0 3
2L94_A 0.97 0.95 1.00 19 971 0 0 0 0 1
2LC8_A -0.01 0.00 0.00 0 1525 15 2 13 0 20
3O58_3 0.29 0.31 0.28 11 12363 41 3 26 12 24
3RKF_A 0.76 0.59 1.00 20 2191 0 0 0 0 14
3SD1_A 0.57 0.48 0.69 20 3887 9 1 8 0 22
3W3S_B 0.85 0.75 0.97 30 4722 2 0 1 1 10
3ZEX_C 0.22 0.21 0.24 11 14151 45 4 30 11 41
4A1C_2 0.14 0.15 0.14 5 11744 43 5 27 11 28

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.