CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of MaxExpect - scored higher in this pairwise comparison

  4. Performance of RNAwolf - scored lower in this pairwise comparison

  5. Compile and download dataset for MaxExpect & RNAwolf [.zip] - may take several seconds...


Overview

Metric MaxExpect RNAwolf
MCC 0.379 > 0.198
Average MCC ± 95% Confidence Intervals 0.407 ± 0.036 > 0.215 ± 0.029
Sensitivity 0.354 > 0.208
Positive Predictive Value 0.408 > 0.188
Total TP 6634 > 3908
Total TN 39596838 > 39592372
Total FP 13323 < 21488
Total FP CONTRA 1511 < 3257
Total FP INCONS 8123 < 13569
Total FP COMP 3689 < 4662
Total FN 12129 < 14855
P-value 3.56938820447e-08

^top



Performance plots


  1. Comparison of performance of MaxExpect and RNAwolf. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for MaxExpect and RNAwolf).

  2. Comparison of average Matthews Correlation Coefficients (MCCs) for MaxExpect and RNAwolf. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for MaxExpect and RNAwolf).

^top




Performance of MaxExpect - scored higher in this pairwise comparison

1. Total counts & total scores for MaxExpect

Total Base Pair Counts
Total TP 6634
Total TN 39596838
Total FP 13323
Total FP CONTRA 1511
Total FP INCONS 8123
Total FP COMP 3689
Total FN 12129
Total Scores
MCC 0.379
Average MCC ± 95% Confidence Intervals 0.407 ± 0.036
Sensitivity 0.354
Positive Predictive Value 0.408
Nr of predictions 77

^top


2. Individual counts for MaxExpect [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
CRW_00002 - 0.63 0.57 0.70 151 408844 107 5 60 42 113
CRW_00417 - 0.36 0.34 0.39 88 458179 146 24 112 10 174
CRW_00418 - 0.18 0.16 0.20 42 441120 176 15 153 8 218
CRW_00419 - 0.20 0.17 0.22 46 463957 168 14 149 5 219
CRW_00421 - 0.48 0.45 0.52 119 462976 126 15 93 18 147
CRW_00422 - 0.40 0.39 0.42 102 455291 162 21 121 20 161
CRW_00424 - 0.42 0.39 0.44 142 789075 201 18 161 22 221
CRW_00426 - 0.32 0.31 0.34 83 457199 173 24 140 9 182
CRW_00427 - 0.26 0.24 0.28 62 454361 174 27 131 16 199
CRW_00428 - 0.37 0.35 0.39 91 465860 158 24 120 14 169
CRW_00430 - 0.37 0.30 0.46 79 456317 101 12 82 7 187
CRW_00433 - 0.29 0.24 0.35 64 467846 124 10 108 6 199
CRW_00434 - 0.46 0.42 0.51 111 457227 117 19 89 9 152
CRW_00435 - 0.41 0.37 0.46 97 451515 119 8 105 6 168
CRW_00437 - 0.33 0.27 0.40 70 456316 108 16 88 4 190
CRW_00438 - 0.45 0.41 0.49 111 454354 125 17 99 9 157
CRW_00441 - 0.26 0.21 0.31 56 454399 130 14 112 4 206
CRW_00442 - 0.38 0.35 0.41 92 453401 144 32 103 9 169
CRW_00443 - 0.29 0.25 0.34 65 456299 140 18 108 14 195
CRW_00444 - 0.30 0.29 0.33 75 459131 162 23 132 7 188
CRW_00445 - 0.32 0.29 0.34 78 458175 161 28 122 11 187
CRW_00446 - 0.30 0.28 0.32 74 468762 173 19 141 13 191
CRW_00447 - 0.35 0.33 0.38 86 452448 159 15 127 17 174
CRW_00448 - 0.36 0.31 0.40 82 457243 134 16 105 13 179
CRW_00449 - 0.38 0.35 0.40 91 444871 140 22 112 6 169
CRW_00450 - 0.36 0.31 0.43 80 458217 118 6 100 12 182
CRW_00451 - 0.26 0.25 0.28 65 457212 182 22 147 13 199
CRW_00452 - 0.29 0.26 0.32 67 453421 158 17 123 18 195
CRW_00453 - 0.32 0.30 0.35 78 452450 155 25 123 7 183
CRW_00456 - 0.37 0.32 0.44 84 470743 119 21 87 11 181
CRW_00457 - 0.42 0.39 0.46 103 467805 134 17 103 14 161
CRW_00458 - 0.49 0.46 0.52 122 464894 129 22 92 15 142
CRW_00459 - 0.37 0.34 0.40 90 462015 154 22 114 18 173
CRW_00462 - 0.39 0.33 0.46 86 458215 114 9 93 12 175
CRW_00463 - 0.36 0.35 0.38 88 445809 151 25 118 8 166
CRW_00464 - 0.27 0.24 0.32 63 462041 145 14 123 8 201
CRW_00530 - 0.33 0.34 0.32 90 534810 205 54 141 10 178
CRW_00538 - 0.34 0.30 0.38 91 811934 171 43 107 21 209
CRW_00604 - 0.90 0.88 0.93 71 411702 185 1 4 180 10
CRW_00606 - 0.87 0.84 0.90 77 559067 237 0 9 228 15
CRW_00607 - 0.66 0.65 0.67 50 536055 254 9 16 229 27
CRW_00615 - 0.70 0.72 0.68 59 553791 259 11 17 231 23
CRW_00617 - 0.48 0.48 0.48 31 426362 233 10 23 200 33
CRW_00678 - 0.45 0.45 0.44 55 666309 273 12 59 202 66
CRW_00680 - 0.60 0.61 0.60 74 516512 219 10 40 169 48
CRW_00683 - 0.30 0.33 0.27 44 460156 239 29 91 119 91
CRW_00684 - 0.45 0.45 0.46 61 612037 256 19 54 183 74
CRW_00702 - 0.70 0.76 0.64 57 357346 172 24 8 140 18
CRW_00704 - 0.87 0.86 0.87 81 386667 187 2 10 175 13
CRW_00706 - 0.55 0.59 0.51 35 695541 326 15 19 292 24
CRW_00713 - 0.81 0.74 0.88 75 731360 279 2 8 269 26
CRW_00765 - 0.40 0.37 0.43 95 452456 133 23 102 8 162
CRW_00766 - 0.35 0.30 0.40 72 440211 123 11 97 15 168
CRW_00768 - 0.43 0.40 0.46 103 471680 146 13 110 23 156
CRW_00769 - 0.56 0.54 0.59 135 451495 113 22 73 18 117
CRW_00773 - 0.52 0.48 0.55 125 451499 119 17 84 18 134
CRW_00774 - 0.35 0.32 0.38 84 488343 157 18 121 18 179
CRW_00777 - 0.38 0.38 0.39 116 719100 221 34 150 37 188
CRW_00780 - 0.27 0.24 0.30 61 475598 155 14 127 14 194
CRW_00783 - 0.29 0.26 0.32 68 453413 156 11 136 9 191
CRW_00784 - 0.27 0.25 0.30 65 456271 172 27 127 18 197
CRW_00785 - 0.26 0.23 0.30 58 452481 145 20 117 8 195
CRW_00787 - 0.44 0.40 0.47 123 646693 160 13 124 23 183
CRW_00794 - 0.29 0.28 0.31 68 434558 174 10 142 22 178
CRW_00796 - 0.29 0.27 0.32 64 384801 159 15 123 21 171
CRW_00797 - 0.39 0.38 0.41 130 692935 213 23 165 25 212
CRW_00801 - 0.39 0.36 0.42 90 438301 137 25 100 12 159
CRW_00802 - 0.20 0.18 0.22 45 460113 173 20 142 11 208
CRW_00813 - 0.28 0.31 0.26 41 530808 255 40 76 139 92
CRW_01186 - 0.29 0.28 0.30 108 836211 262 31 221 10 278
CRW_01250 - 0.34 0.31 0.38 118 781561 210 24 172 14 260
CRW_01266 - 0.26 0.27 0.26 101 818174 296 45 240 11 280
CRW_01271 - 0.36 0.36 0.36 137 827165 249 36 203 10 244
CRW_01344 - 0.31 0.29 0.33 106 791590 228 33 182 13 260
PDB_00409 - 0.32 0.37 0.27 91 688216 320 75 169 76 154
PDB_00805 - 0.62 0.59 0.65 178 467755 124 14 81 29 124
PDB_01261 - 0.74 0.65 0.85 218 467773 41 0 37 4 118

^top


Performance of RNAwolf - scored lower in this pairwise comparison

1. Total counts & total scores for RNAwolf

Total Base Pair Counts
Total TP 3908
Total TN 39592372
Total FP 21488
Total FP CONTRA 3257
Total FP INCONS 13569
Total FP COMP 4662
Total FN 14855
Total Scores
MCC 0.198
Average MCC ± 95% Confidence Intervals 0.215 ± 0.029
Sensitivity 0.208
Positive Predictive Value 0.188
Nr of predictions 77

^top


2. Individual counts for RNAwolf [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
CRW_00002 - 0.28 0.29 0.27 76 408775 248 40 169 39 188
CRW_00417 - 0.16 0.16 0.15 43 458123 262 39 198 25 219
CRW_00418 - 0.14 0.15 0.14 38 441051 257 48 193 16 222
CRW_00419 - 0.13 0.14 0.12 36 463875 271 46 209 16 229
CRW_00421 - 0.17 0.18 0.16 48 462897 276 52 206 18 218
CRW_00422 - 0.15 0.16 0.14 41 455242 274 39 213 22 222
CRW_00424 - 0.20 0.21 0.19 75 789009 339 43 269 27 288
CRW_00426 - 0.22 0.23 0.22 60 457173 236 41 172 23 205
CRW_00427 - 0.26 0.26 0.26 69 454312 242 35 165 42 192
CRW_00428 - 0.17 0.18 0.16 48 465797 277 52 198 27 212
CRW_00430 - 0.10 0.11 0.10 29 456197 279 45 219 15 237
CRW_00433 - 0.20 0.20 0.19 53 467752 243 36 187 20 210
CRW_00434 - 0.14 0.15 0.14 39 457167 272 43 197 32 224
CRW_00435 - 0.17 0.17 0.17 45 451453 253 34 193 26 220
CRW_00437 - 0.26 0.27 0.26 69 456226 230 32 163 35 191
CRW_00438 - 0.16 0.16 0.15 44 454297 253 44 196 13 224
CRW_00441 - 0.14 0.15 0.14 38 454303 253 49 191 13 224
CRW_00442 - 0.15 0.15 0.14 39 453356 254 41 192 21 222
CRW_00443 - 0.20 0.20 0.20 52 456224 251 42 172 37 208
CRW_00444 - 0.23 0.24 0.23 62 459095 240 39 165 36 201
CRW_00445 - 0.23 0.25 0.22 65 458114 258 46 178 34 200
CRW_00446 - 0.11 0.11 0.10 30 468710 276 47 209 20 235
CRW_00447 - 0.14 0.15 0.13 38 452387 274 38 213 23 222
CRW_00448 - 0.08 0.08 0.08 22 457185 260 47 192 21 239
CRW_00449 - 0.09 0.10 0.09 25 444821 265 45 205 15 235
CRW_00450 - 0.17 0.18 0.16 46 458120 263 37 200 26 216
CRW_00451 - 0.18 0.19 0.18 51 457155 266 47 193 26 213
CRW_00452 - 0.14 0.15 0.13 39 453337 275 42 210 23 223
CRW_00453 - 0.25 0.25 0.25 64 452419 227 33 160 34 197
CRW_00456 - 0.19 0.19 0.19 50 470672 235 38 175 22 215
CRW_00457 - 0.27 0.28 0.27 75 467746 248 26 181 41 189
CRW_00458 - 0.27 0.27 0.27 71 464866 208 41 152 15 193
CRW_00459 - 0.22 0.23 0.22 60 461968 248 35 178 35 203
CRW_00462 - 0.19 0.20 0.18 51 458126 254 29 197 28 210
CRW_00463 - 0.21 0.22 0.20 56 445761 243 47 176 20 198
CRW_00464 - 0.17 0.17 0.17 44 461979 238 40 178 20 220
CRW_00530 - 0.24 0.27 0.22 72 534761 278 73 189 16 196
CRW_00538 - 0.21 0.24 0.18 72 811777 358 86 240 32 228
CRW_00604 - 0.81 0.81 0.80 66 411696 242 2 14 226 15
CRW_00606 - 0.72 0.73 0.72 67 559060 311 5 21 285 25
CRW_00607 - 0.45 0.45 0.44 35 536050 325 12 33 280 42
CRW_00615 - 0.44 0.55 0.36 45 553753 334 38 42 254 37
CRW_00617 - 0.07 0.09 0.05 6 426305 316 43 72 201 58
CRW_00678 - 0.16 0.18 0.14 22 666279 384 32 102 250 99
CRW_00680 - 0.25 0.28 0.23 34 516487 293 22 93 178 88
CRW_00683 - 0.10 0.13 0.09 17 460126 313 48 129 136 118
CRW_00684 - 0.10 0.13 0.09 17 611976 357 48 130 179 118
CRW_00702 - 0.30 0.35 0.25 26 357333 263 32 44 187 49
CRW_00704 - 0.33 0.36 0.31 34 386650 255 25 51 179 60
CRW_00706 - 0.43 0.46 0.40 27 695542 380 10 31 339 32
CRW_00713 - 0.38 0.41 0.35 41 731327 351 24 53 274 60
CRW_00765 - 0.13 0.14 0.12 37 452376 272 55 208 9 220
CRW_00766 - 0.14 0.15 0.13 35 440129 259 41 186 32 205
CRW_00768 - 0.30 0.32 0.29 83 471617 239 48 158 33 176
CRW_00769 - 0.21 0.23 0.20 58 451429 261 51 187 23 194
CRW_00773 - 0.32 0.33 0.31 85 451453 218 45 142 31 174
CRW_00774 - 0.15 0.16 0.14 42 488276 276 32 216 28 221
CRW_00777 - 0.09 0.10 0.08 31 719031 376 64 274 38 273
CRW_00780 - 0.19 0.20 0.18 50 475527 242 42 181 19 205
CRW_00783 - 0.13 0.14 0.12 35 453340 266 49 204 13 224
CRW_00784 - 0.17 0.18 0.16 48 456191 277 37 214 26 214
CRW_00785 - 0.21 0.22 0.21 55 452412 242 43 166 33 198
CRW_00787 - 0.18 0.19 0.18 59 646617 305 35 242 28 247
CRW_00794 - 0.13 0.15 0.12 36 434484 283 53 205 25 210
CRW_00796 - 0.05 0.06 0.05 14 384732 272 52 205 15 221
CRW_00797 - 0.13 0.14 0.12 47 692868 356 57 281 18 295
CRW_00801 - 0.18 0.19 0.17 48 438233 249 59 176 14 201
CRW_00802 - 0.12 0.13 0.11 33 460031 275 47 209 19 220
CRW_00813 - 0.11 0.15 0.08 20 530728 326 95 122 109 113
CRW_01186 - 0.19 0.19 0.18 75 836163 348 55 278 15 311
CRW_01250 - 0.22 0.22 0.22 85 781486 328 41 263 24 293
CRW_01266 - 0.19 0.20 0.18 76 818139 366 54 291 21 305
CRW_01271 - 0.17 0.17 0.17 65 827149 364 36 291 37 316
CRW_01344 - 0.16 0.16 0.16 59 791531 333 54 267 12 307
PDB_00409 - 0.29 0.34 0.24 84 688207 347 81 179 87 161
PDB_00805 - 0.34 0.36 0.33 108 467696 243 40 184 19 194
PDB_01261 - 0.52 0.50 0.54 168 467715 157 13 132 12 168

^top

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.

Copyright© - Adam Mickiewicz University & IIMCB - All rights reserved