CompaRNA - on-line benchmarks of RNA structure prediction methods
Home

Methods
Datasets
Rankings
RNA 2D Atlas

Help
FAQ

Contact us
RSS feeds
Twitter

Table of contents:

  1. Overview

  2. Performance Plots

  3. Performance of UNAFold - scored higher in this pairwise comparison

  4. Performance of RNAwolf - scored lower in this pairwise comparison

  5. Compile and download dataset for UNAFold & RNAwolf [.zip] - may take several seconds...


Overview

Metric UNAFold RNAwolf
MCC 0.341 > 0.198
Average MCC ± 95% Confidence Intervals 0.365 ± 0.033 > 0.215 ± 0.029
Sensitivity 0.332 > 0.208
Positive Predictive Value 0.351 > 0.188
Total TP 6236 > 3908
Total TN 39595326 > 39592372
Total FP 15213 < 21488
Total FP CONTRA 1942 < 3257
Total FP INCONS 9602 < 13569
Total FP COMP 3669 < 4662
Total FN 12527 < 14855
P-value 3.56938820447e-08

^top



Performance plots


  1. Comparison of performance of UNAFold and RNAwolf. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for UNAFold and RNAwolf).

  2. Comparison of average Matthews Correlation Coefficients (MCCs) for UNAFold and RNAwolf. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for UNAFold and RNAwolf).

^top




Performance of UNAFold - scored higher in this pairwise comparison

1. Total counts & total scores for UNAFold

Total Base Pair Counts
Total TP 6236
Total TN 39595326
Total FP 15213
Total FP CONTRA 1942
Total FP INCONS 9602
Total FP COMP 3669
Total FN 12527
Total Scores
MCC 0.341
Average MCC ± 95% Confidence Intervals 0.365 ± 0.033
Sensitivity 0.332
Positive Predictive Value 0.351
Nr of predictions 77

^top


2. Individual counts for UNAFold [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
CRW_00002 - 0.55 0.54 0.56 143 408803 127 31 83 13 121
CRW_00417 - 0.39 0.38 0.40 99 458154 161 21 129 11 163
CRW_00418 - 0.22 0.20 0.24 52 441115 174 21 142 11 208
CRW_00419 - 0.20 0.18 0.21 49 463930 194 17 170 7 216
CRW_00421 - 0.31 0.30 0.33 79 462964 173 28 132 13 187
CRW_00422 - 0.37 0.36 0.38 95 455287 170 24 129 17 168
CRW_00424 - 0.38 0.39 0.38 140 789031 251 22 203 26 223
CRW_00426 - 0.34 0.33 0.35 88 457193 175 23 142 10 177
CRW_00427 - 0.21 0.21 0.22 54 454337 205 33 157 15 207
CRW_00428 - 0.38 0.38 0.38 98 465840 170 32 125 13 162
CRW_00430 - 0.45 0.42 0.49 112 456262 128 20 96 12 154
CRW_00433 - 0.29 0.26 0.32 68 467817 148 21 122 5 195
CRW_00434 - 0.31 0.29 0.33 75 457220 157 19 132 6 188
CRW_00435 - 0.45 0.42 0.49 110 451500 126 9 106 11 155
CRW_00437 - 0.21 0.21 0.22 54 456247 191 23 166 2 206
CRW_00438 - 0.34 0.32 0.37 87 454343 161 16 135 10 181
CRW_00441 - 0.17 0.16 0.18 42 454353 190 32 154 4 220
CRW_00442 - 0.38 0.36 0.40 94 453393 149 25 116 8 167
CRW_00443 - 0.38 0.36 0.41 93 456264 154 19 114 21 167
CRW_00444 - 0.30 0.29 0.32 76 459122 172 24 139 9 187
CRW_00445 - 0.30 0.28 0.33 75 458173 164 23 132 9 190
CRW_00446 - 0.36 0.33 0.38 88 468765 157 17 126 14 177
CRW_00447 - 0.33 0.32 0.35 82 452443 167 16 135 16 178
CRW_00448 - 0.34 0.33 0.36 85 457211 168 28 122 18 176
CRW_00449 - 0.15 0.15 0.16 38 444860 198 34 164 0 222
CRW_00450 - 0.34 0.32 0.36 83 458172 162 19 129 14 179
CRW_00451 - 0.24 0.22 0.26 59 457222 181 21 144 16 205
CRW_00452 - 0.29 0.26 0.31 69 453407 169 26 126 17 193
CRW_00453 - 0.23 0.21 0.24 56 452447 180 35 138 7 205
CRW_00456 - 0.44 0.41 0.47 108 470706 137 19 102 16 157
CRW_00457 - 0.38 0.36 0.40 95 467788 159 28 117 14 169
CRW_00458 - 0.46 0.44 0.48 115 464891 141 21 103 17 149
CRW_00459 - 0.55 0.51 0.58 135 462008 117 16 82 19 128
CRW_00462 - 0.18 0.16 0.19 43 458180 198 21 159 18 218
CRW_00463 - 0.39 0.38 0.40 97 445799 154 21 123 10 157
CRW_00464 - 0.38 0.35 0.42 92 462021 139 14 114 11 172
CRW_00530 - 0.26 0.28 0.25 74 534802 233 55 164 14 194
CRW_00538 - 0.19 0.20 0.18 59 811850 285 65 201 19 241
CRW_00604 - 0.82 0.86 0.79 70 411689 188 10 9 169 11
CRW_00606 - 0.87 0.84 0.91 77 559068 251 0 8 243 15
CRW_00607 - 0.54 0.53 0.55 41 536056 268 10 23 235 36
CRW_00615 - 0.50 0.56 0.45 46 553776 279 21 35 223 36
CRW_00617 - 0.41 0.45 0.38 29 426349 237 15 33 189 35
CRW_00678 - 0.41 0.45 0.37 55 666287 299 23 70 206 66
CRW_00680 - 0.32 0.36 0.28 44 516477 258 32 83 143 78
CRW_00683 - 0.50 0.50 0.49 68 460182 221 18 52 151 67
CRW_00684 - 0.35 0.37 0.32 50 612016 279 36 69 174 85
CRW_00702 - 0.57 0.64 0.51 48 357341 200 16 30 154 27
CRW_00704 - 0.80 0.79 0.82 74 386670 190 4 12 174 20
CRW_00706 - 0.37 0.41 0.34 24 695539 343 11 36 296 35
CRW_00713 - 0.67 0.65 0.69 66 731349 298 5 25 268 35
CRW_00765 - 0.24 0.24 0.24 62 452416 208 36 162 10 195
CRW_00766 - 0.23 0.22 0.23 53 440165 188 28 145 15 187
CRW_00768 - 0.56 0.54 0.58 141 471663 124 14 88 22 118
CRW_00769 - 0.37 0.35 0.39 88 451499 151 24 114 13 164
CRW_00773 - 0.47 0.47 0.48 121 451471 151 28 105 18 138
CRW_00774 - 0.34 0.32 0.37 85 488335 171 20 126 25 178
CRW_00777 - 0.29 0.29 0.29 88 719096 251 36 180 35 216
CRW_00780 - 0.36 0.35 0.37 89 475561 163 24 126 13 166
CRW_00783 - 0.35 0.34 0.36 87 453385 167 15 141 11 172
CRW_00784 - 0.34 0.33 0.36 86 456249 169 29 126 14 176
CRW_00785 - 0.30 0.29 0.32 73 452445 165 31 127 7 180
CRW_00787 - 0.23 0.24 0.23 72 646633 257 40 208 9 234
CRW_00794 - 0.23 0.23 0.23 56 434530 209 20 172 17 190
CRW_00796 - 0.25 0.23 0.26 55 384793 177 24 131 22 180
CRW_00797 - 0.29 0.29 0.29 98 692914 265 38 203 24 244
CRW_00801 - 0.46 0.45 0.46 113 438272 150 28 103 19 136
CRW_00802 - 0.25 0.24 0.25 61 460079 192 36 144 12 192
CRW_00813 - 0.17 0.20 0.14 27 530778 295 47 113 135 106
CRW_01186 - 0.23 0.23 0.23 89 836190 303 44 248 11 297
CRW_01250 - 0.24 0.23 0.24 87 781517 284 38 233 13 291
CRW_01266 - 0.24 0.24 0.24 91 818175 306 39 255 12 290
CRW_01271 - 0.30 0.30 0.29 113 827157 283 32 239 12 268
CRW_01344 - 0.34 0.33 0.34 122 791557 238 42 190 6 244
PDB_00409 - 0.32 0.37 0.27 90 688221 309 74 166 69 155
PDB_00805 - 0.64 0.61 0.68 184 467756 111 11 77 23 118
PDB_01261 - 0.50 0.45 0.55 152 467750 130 4 122 4 184

^top


Performance of RNAwolf - scored lower in this pairwise comparison

1. Total counts & total scores for RNAwolf

Total Base Pair Counts
Total TP 3908
Total TN 39592372
Total FP 21488
Total FP CONTRA 3257
Total FP INCONS 13569
Total FP COMP 4662
Total FN 14855
Total Scores
MCC 0.198
Average MCC ± 95% Confidence Intervals 0.215 ± 0.029
Sensitivity 0.208
Positive Predictive Value 0.188
Nr of predictions 77

^top


2. Individual counts for RNAwolf [ download as .csv ]

RNA Chain Rfam family MCC SENS PPV TP TN FP FP CONTRA FP INCONS FP COMP FN
CRW_00002 - 0.28 0.29 0.27 76 408775 248 40 169 39 188
CRW_00417 - 0.16 0.16 0.15 43 458123 262 39 198 25 219
CRW_00418 - 0.14 0.15 0.14 38 441051 257 48 193 16 222
CRW_00419 - 0.13 0.14 0.12 36 463875 271 46 209 16 229
CRW_00421 - 0.17 0.18 0.16 48 462897 276 52 206 18 218
CRW_00422 - 0.15 0.16 0.14 41 455242 274 39 213 22 222
CRW_00424 - 0.20 0.21 0.19 75 789009 339 43 269 27 288
CRW_00426 - 0.22 0.23 0.22 60 457173 236 41 172 23 205
CRW_00427 - 0.26 0.26 0.26 69 454312 242 35 165 42 192
CRW_00428 - 0.17 0.18 0.16 48 465797 277 52 198 27 212
CRW_00430 - 0.10 0.11 0.10 29 456197 279 45 219 15 237
CRW_00433 - 0.20 0.20 0.19 53 467752 243 36 187 20 210
CRW_00434 - 0.14 0.15 0.14 39 457167 272 43 197 32 224
CRW_00435 - 0.17 0.17 0.17 45 451453 253 34 193 26 220
CRW_00437 - 0.26 0.27 0.26 69 456226 230 32 163 35 191
CRW_00438 - 0.16 0.16 0.15 44 454297 253 44 196 13 224
CRW_00441 - 0.14 0.15 0.14 38 454303 253 49 191 13 224
CRW_00442 - 0.15 0.15 0.14 39 453356 254 41 192 21 222
CRW_00443 - 0.20 0.20 0.20 52 456224 251 42 172 37 208
CRW_00444 - 0.23 0.24 0.23 62 459095 240 39 165 36 201
CRW_00445 - 0.23 0.25 0.22 65 458114 258 46 178 34 200
CRW_00446 - 0.11 0.11 0.10 30 468710 276 47 209 20 235
CRW_00447 - 0.14 0.15 0.13 38 452387 274 38 213 23 222
CRW_00448 - 0.08 0.08 0.08 22 457185 260 47 192 21 239
CRW_00449 - 0.09 0.10 0.09 25 444821 265 45 205 15 235
CRW_00450 - 0.17 0.18 0.16 46 458120 263 37 200 26 216
CRW_00451 - 0.18 0.19 0.18 51 457155 266 47 193 26 213
CRW_00452 - 0.14 0.15 0.13 39 453337 275 42 210 23 223
CRW_00453 - 0.25 0.25 0.25 64 452419 227 33 160 34 197
CRW_00456 - 0.19 0.19 0.19 50 470672 235 38 175 22 215
CRW_00457 - 0.27 0.28 0.27 75 467746 248 26 181 41 189
CRW_00458 - 0.27 0.27 0.27 71 464866 208 41 152 15 193
CRW_00459 - 0.22 0.23 0.22 60 461968 248 35 178 35 203
CRW_00462 - 0.19 0.20 0.18 51 458126 254 29 197 28 210
CRW_00463 - 0.21 0.22 0.20 56 445761 243 47 176 20 198
CRW_00464 - 0.17 0.17 0.17 44 461979 238 40 178 20 220
CRW_00530 - 0.24 0.27 0.22 72 534761 278 73 189 16 196
CRW_00538 - 0.21 0.24 0.18 72 811777 358 86 240 32 228
CRW_00604 - 0.81 0.81 0.80 66 411696 242 2 14 226 15
CRW_00606 - 0.72 0.73 0.72 67 559060 311 5 21 285 25
CRW_00607 - 0.45 0.45 0.44 35 536050 325 12 33 280 42
CRW_00615 - 0.44 0.55 0.36 45 553753 334 38 42 254 37
CRW_00617 - 0.07 0.09 0.05 6 426305 316 43 72 201 58
CRW_00678 - 0.16 0.18 0.14 22 666279 384 32 102 250 99
CRW_00680 - 0.25 0.28 0.23 34 516487 293 22 93 178 88
CRW_00683 - 0.10 0.13 0.09 17 460126 313 48 129 136 118
CRW_00684 - 0.10 0.13 0.09 17 611976 357 48 130 179 118
CRW_00702 - 0.30 0.35 0.25 26 357333 263 32 44 187 49
CRW_00704 - 0.33 0.36 0.31 34 386650 255 25 51 179 60
CRW_00706 - 0.43 0.46 0.40 27 695542 380 10 31 339 32
CRW_00713 - 0.38 0.41 0.35 41 731327 351 24 53 274 60
CRW_00765 - 0.13 0.14 0.12 37 452376 272 55 208 9 220
CRW_00766 - 0.14 0.15 0.13 35 440129 259 41 186 32 205
CRW_00768 - 0.30 0.32 0.29 83 471617 239 48 158 33 176
CRW_00769 - 0.21 0.23 0.20 58 451429 261 51 187 23 194
CRW_00773 - 0.32 0.33 0.31 85 451453 218 45 142 31 174
CRW_00774 - 0.15 0.16 0.14 42 488276 276 32 216 28 221
CRW_00777 - 0.09 0.10 0.08 31 719031 376 64 274 38 273
CRW_00780 - 0.19 0.20 0.18 50 475527 242 42 181 19 205
CRW_00783 - 0.13 0.14 0.12 35 453340 266 49 204 13 224
CRW_00784 - 0.17 0.18 0.16 48 456191 277 37 214 26 214
CRW_00785 - 0.21 0.22 0.21 55 452412 242 43 166 33 198
CRW_00787 - 0.18 0.19 0.18 59 646617 305 35 242 28 247
CRW_00794 - 0.13 0.15 0.12 36 434484 283 53 205 25 210
CRW_00796 - 0.05 0.06 0.05 14 384732 272 52 205 15 221
CRW_00797 - 0.13 0.14 0.12 47 692868 356 57 281 18 295
CRW_00801 - 0.18 0.19 0.17 48 438233 249 59 176 14 201
CRW_00802 - 0.12 0.13 0.11 33 460031 275 47 209 19 220
CRW_00813 - 0.11 0.15 0.08 20 530728 326 95 122 109 113
CRW_01186 - 0.19 0.19 0.18 75 836163 348 55 278 15 311
CRW_01250 - 0.22 0.22 0.22 85 781486 328 41 263 24 293
CRW_01266 - 0.19 0.20 0.18 76 818139 366 54 291 21 305
CRW_01271 - 0.17 0.17 0.17 65 827149 364 36 291 37 316
CRW_01344 - 0.16 0.16 0.16 59 791531 333 54 267 12 307
PDB_00409 - 0.29 0.34 0.24 84 688207 347 81 179 87 161
PDB_00805 - 0.34 0.36 0.33 108 467696 243 40 184 19 194
PDB_01261 - 0.52 0.50 0.54 168 467715 157 13 132 12 168

^top

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.

Copyright© - Adam Mickiewicz University & IIMCB - All rights reserved