CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of PETfold_pre2.0(seed) - scored higher in this pairwise comparison

  4. Performance of Vsfold4 - scored lower in this pairwise comparison

  5. Compile and download dataset for PETfold_pre2.0(seed) & Vsfold4 [.zip] - may take several seconds...


Overview

Metric PETfold_pre2.0(seed) Vsfold4
MCC 0.729 > 0.452
Average MCC ± 95% Confidence Intervals 0.701 ± 0.068 > 0.473 ± 0.106
Sensitivity 0.605 > 0.371
Positive Predictive Value 0.882 > 0.559
Total TP 480 > 294
Total TN 111943 < 111961
Total FP 90 < 272
Total FP CONTRA 4 < 16
Total FP INCONS 60 < 216
Total FP COMP 26 < 40
Total FN 313 < 499
P-value 5.19332990918e-08

^top




Performance plots


  1. Comparison of performance of PETfold_pre2.0(seed) and Vsfold4. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for PETfold_pre2.0(seed) and Vsfold4).

  2. Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for PETfold_pre2.0(seed) and Vsfold4).

  3. Comparison of average Matthews Correlation Coefficients (MCCs) for PETfold_pre2.0(seed) and Vsfold4. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for PETfold_pre2.0(seed) and Vsfold4).

^top





Performance of PETfold_pre2.0(seed) - scored higher in this pairwise comparison

1. Total counts & total scores for PETfold_pre2.0(seed)

Total Base Pair Counts
Total TP 480
Total TN 111943
Total FP 90
Total FP CONTRA 4
Total FP INCONS 60
Total FP COMP 26
Total FN 313
Total Scores
MCC 0.729
Average MCC ± 95% Confidence Intervals 0.701 ± 0.068
Sensitivity 0.605
Positive Predictive Value 0.882
Nr of predictions 22

^top



2. Individual counts for PETfold_pre2.0(seed) [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A 0.40 0.30 0.55 6 1529 5 0 5 0 14
3J16_L 0.82 0.70 0.95 21 2753 1 0 1 0 9
3J20_1 0.96 0.91 1.00 21 2905 1 0 0 1 2
3J20_0 0.84 0.70 1.00 21 2829 1 0 0 1 9
3J2L_3 0.77 0.62 0.94 33 7840 4 0 2 2 20
3J3D_C 0.82 0.71 0.95 20 2754 2 0 1 1 8
3J3E_8 0.43 0.30 0.63 10 7487 8 0 6 2 23
3J3E_7 0.78 0.67 0.92 36 7101 3 0 3 0 18
3J3F_8 0.63 0.53 0.76 19 12221 10 0 6 4 17
3J3F_7 0.85 0.74 0.97 37 7222 2 0 1 1 13
3J3V_B 0.76 0.61 0.95 35 6984 3 0 2 1 22
3UZL_B 0.72 0.54 0.95 20 3549 2 1 0 1 17
3W3S_B 0.78 0.65 0.93 26 4725 4 0 2 2 14
3ZEX_D 0.82 0.73 0.92 36 6982 3 0 3 0 13
3ZND_W 0.47 0.43 0.53 10 2984 12 0 9 3 13
4A1C_2 0.57 0.45 0.71 15 11760 12 0 6 6 18
4A1C_3 0.83 0.70 0.97 38 7101 1 0 1 0 16
4AOB_A 0.72 0.57 0.92 24 4345 3 0 2 1 18
4ENB_A 0.50 0.42 0.62 8 1262 5 1 4 0 11
4ENC_A 0.50 0.42 0.62 8 1313 5 1 4 0 11
4FRG_B 0.74 0.63 0.87 20 3463 3 1 2 0 12
4JF2_A 0.72 0.52 1.00 16 2834 0 0 0 0 15

^top



Performance of Vsfold4 - scored lower in this pairwise comparison

1. Total counts & total scores for Vsfold4

Total Base Pair Counts
Total TP 294
Total TN 111961
Total FP 272
Total FP CONTRA 16
Total FP INCONS 216
Total FP COMP 40
Total FN 499
Total Scores
MCC 0.452
Average MCC ± 95% Confidence Intervals 0.473 ± 0.106
Sensitivity 0.371
Positive Predictive Value 0.559
Nr of predictions 22

^top



2. Individual counts for Vsfold4 [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
2LC8_A -0.01 0.00 0.00 0 1527 13 0 13 0 20
3J16_L 0.82 0.67 1.00 20 2755 0 0 0 0 10
3J20_1 0.71 0.70 0.73 16 2904 6 0 6 0 7
3J20_0 0.84 0.70 1.00 21 2829 1 0 0 1 9
3J2L_3 0.57 0.45 0.73 24 7842 12 1 8 3 29
3J3D_C 0.44 0.39 0.50 11 2753 11 1 10 0 17
3J3E_8 0.07 0.06 0.09 2 7481 32 2 18 12 31
3J3E_7 0.48 0.35 0.66 19 7111 10 0 10 0 35
3J3F_8 0.33 0.31 0.37 11 12216 27 4 15 8 25
3J3F_7 0.21 0.18 0.26 9 7226 25 0 25 0 41
3J3V_B 0.17 0.12 0.24 7 6992 22 1 21 0 50
3UZL_B 0.53 0.41 0.71 15 3549 6 1 5 0 22
3W3S_B 0.67 0.58 0.79 23 4724 7 0 6 1 17
3ZEX_D 0.55 0.45 0.69 22 6989 10 0 10 0 27
3ZND_W 0.41 0.39 0.43 9 2982 14 2 10 2 14
4A1C_2 0.28 0.24 0.33 8 11757 28 0 16 12 25
4A1C_3 0.26 0.22 0.32 12 7103 25 2 23 0 42
4AOB_A 0.42 0.33 0.54 14 4345 13 1 11 1 28
4ENB_A 0.76 0.58 1.00 11 1264 0 0 0 0 8
4ENC_A 0.69 0.47 1.00 9 1317 0 0 0 0 10
4FRG_B 0.56 0.47 0.68 15 3464 7 1 6 0 17
4JF2_A 0.66 0.52 0.84 16 2831 3 0 3 0 15

^top


Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.