CompaRNA - on-line benchmarks of RNA structure prediction methods

Laboratory of Structural Bioinformatics @ Adam Mickiewicz University in Poznan

Home

Methods

Datasets

Rankings

RNA 2D Atlas

Help

FAQ

Contact us

RSS feeds

Twitter

Overview

Metric	UNAFold		Mastr(20)
MCC	0.293	>	0.000
Average MCC ± 95% Confidence Intervals	0.292 ± 0.023	>	0.000 ± 0.000
Sensitivity	0.299	>	0.000
Positive Predictive Value	0.288	>	0.000
Total TP	3994	>	0
Total TN	44594843	<	44608726
Total FP	11196	>	0
Total FP CONTRA	1905	>	0
Total FP INCONS	7984	>	0
Total FP COMP	1307	>	0
Total FN	9366	<	13360
P-value	5.23657817852e-08

^top

Performance plots

Comparison of performance of UNAFold and Mastr(20). Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for UNAFold and Mastr(20)).
Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for UNAFold and Mastr(20)).
Comparison of average Matthews Correlation Coefficients (MCCs) for UNAFold and Mastr(20). The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for UNAFold and Mastr(20)).

^top

Performance of UNAFold - scored higher in this pairwise comparison

1. Total counts & total scores for UNAFold

Total Base Pair Counts
Total TP	3994
Total TN	44594843
Total FP	11196
Total FP CONTRA	1905
Total FP INCONS	7984
Total FP COMP	1307
Total FN	9366

Total Scores
MCC	0.293
Average MCC ± 95% Confidence Intervals	0.292 ± 0.023
Sensitivity	0.299
Positive Predictive Value	0.288
Nr of predictions	27

^top

2. Individual counts for UNAFold [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00298	SSU_rRNA_eukarya links to Rfam database...	0.22	0.23	0.22	114	1620379	443	82	325	36	380
CRW_00301	SSU_rRNA_eukarya links to Rfam database...	0.31	0.31	0.30	163	1761959	431	87	294	50	356
CRW_00306	SSU_rRNA_eukarya links to Rfam database...	0.16	0.16	0.16	76	1445368	444	67	339	38	386
CRW_00310	SSU_rRNA_eukarya links to Rfam database...	0.26	0.27	0.26	141	1805406	466	81	322	63	380
CRW_00326	SSU_rRNA_eukarya links to Rfam database...	0.35	0.35	0.35	176	1627600	377	65	269	43	326
CRW_00330	SSU_rRNA_eukarya links to Rfam database...	0.29	0.31	0.28	158	1988457	459	73	327	59	359
CRW_00332	SSU_rRNA_eukarya links to Rfam database...	0.21	0.22	0.20	104	1769488	470	103	326	41	373
CRW_00333	SSU_rRNA_eukarya links to Rfam database...	0.33	0.33	0.32	169	1891961	426	77	278	71	345
CRW_00345	SSU_rRNA_eukarya links to Rfam database...	0.27	0.28	0.27	138	1586355	422	75	303	44	360
CRW_00346	SSU_rRNA_eukarya links to Rfam database...	0.30	0.31	0.29	155	1584555	401	76	304	21	346
CRW_00348	SSU_rRNA_eukarya links to Rfam database...	0.26	0.26	0.26	131	1615002	412	57	313	42	372
CRW_00358	SSU_rRNA_eukarya links to Rfam database...	0.39	0.39	0.39	200	1674848	370	67	250	53	307
CRW_00366	SSU_rRNA_eukarya links to Rfam database...	0.33	0.35	0.32	167	1579237	391	83	266	42	315
CRW_00370	SSU_rRNA_eukarya links to Rfam database...	0.25	0.26	0.25	130	1640246	437	74	316	47	376
CRW_00371	SSU_rRNA_eukarya links to Rfam database...	0.31	0.32	0.30	159	1611384	399	75	292	32	337
CRW_00372	SSU_rRNA_eukarya links to Rfam database...	0.36	0.36	0.36	180	1625800	366	59	267	40	318
CRW_00379	SSU_rRNA_eukarya links to Rfam database...	0.40	0.40	0.39	215	2126404	429	56	278	95	319
CRW_00403	SSU_rRNA_eukarya links to Rfam database...	0.31	0.31	0.30	146	1606048	418	64	270	84	318
CRW_00411	SSU_rRNA_eukarya links to Rfam database...	0.27	0.28	0.27	138	1614990	413	60	315	38	358
CRW_00598	SSU_rRNA_eukarya links to Rfam database...	0.36	0.37	0.35	183	1665703	391	62	277	52	308
CRW_00758	SSU_rRNA_eukarya links to Rfam database...	0.28	0.29	0.27	138	1640264	418	60	304	54	345
CRW_00759	SSU_rRNA_eukarya links to Rfam database...	0.23	0.24	0.22	117	1636617	466	66	345	55	364
CRW_00760	SSU_rRNA_eukarya links to Rfam database...	0.31	0.31	0.32	151	1638482	393	57	265	71	335
CRW_00772	SSU_rRNA_bacteria links to Rfam database...	0.25	0.25	0.26	101	945612	317	39	248	30	303
CRW_01153	SSU_rRNA_eukarya links to Rfam database...	0.25	0.25	0.25	128	1606016	421	65	319	37	375
CRW_01171	SSU_rRNA_eukarya links to Rfam database...	0.24	0.24	0.24	123	1593484	433	84	314	35	383
CRW_01300	SSU_rRNA_eukarya links to Rfam database...	0.37	0.37	0.36	193	1693178	383	91	258	34	322

^top

Performance of Mastr(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Mastr(20)

Total Base Pair Counts
Total TP	0
Total TN	44608726
Total FP	0
Total FP CONTRA	0
Total FP INCONS	0
Total FP COMP	0
Total FN	13360

Total Scores
MCC	0.000
Average MCC ± 95% Confidence Intervals	0.000 ± 0.000
Sensitivity	0.000
Positive Predictive Value	0.000
Nr of predictions	27

^top

2. Individual counts for Mastr(20) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00298	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1620900	0	0	0	0	494
CRW_00301	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1762503	0	0	0	0	519
CRW_00306	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1445850	0	0	0	0	462
CRW_00310	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1805950	0	0	0	0	521
CRW_00326	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1628110	0	0	0	0	502
CRW_00330	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1989015	0	0	0	0	517
CRW_00332	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1770021	0	0	0	0	477
CRW_00333	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1892485	0	0	0	0	514
CRW_00345	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1586871	0	0	0	0	498
CRW_00346	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1585090	0	0	0	0	501
CRW_00348	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1615503	0	0	0	0	503
CRW_00358	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1675365	0	0	0	0	507
CRW_00366	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1579753	0	0	0	0	482
CRW_00370	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1640766	0	0	0	0	506
CRW_00371	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1611910	0	0	0	0	496
CRW_00372	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1626306	0	0	0	0	498
CRW_00379	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	2126953	0	0	0	0	534
CRW_00403	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1606528	0	0	0	0	464
CRW_00411	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1615503	0	0	0	0	496
CRW_00598	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1666225	0	0	0	0	491
CRW_00758	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1640766	0	0	0	0	483
CRW_00759	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1637145	0	0	0	0	481
CRW_00760	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1638955	0	0	0	0	486
CRW_00772	SSU_rRNA_bacteria links to Rfam database...	0.00	0.00	0.00	0	946000	0	0	0	0	404
CRW_01153	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1606528	0	0	0	0	503
CRW_01171	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1594005	0	0	0	0	506
CRW_01300	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1693720	0	0	0	0	515

^top

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.

Table of contents:

Overview

Performance plots

Performance of UNAFold - scored higher in this pairwise comparison

1. Total counts & total scores for UNAFold

2. Individual counts for UNAFold [ download as .csv ]

Performance of Mastr(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Mastr(20)

2. Individual counts for Mastr(20) [ download as .csv ]