CompaRNA - on-line benchmarks of RNA structure prediction methods

Laboratory of Structural Bioinformatics @ Adam Mickiewicz University in Poznan

Home

Methods

Datasets

Rankings

RNA 2D Atlas

Help

FAQ

Contact us

RSS feeds

Twitter

Overview

Metric	RNAalifold(20)		Mastr(20)
MCC	0.440	>	0.000
Average MCC ± 95% Confidence Intervals	0.442 ± 0.031	>	0.000 ± 0.000
Sensitivity	0.389	>	0.000
Positive Predictive Value	0.498	>	0.000
Total TP	5203	>	0
Total TN	44598277	<	44608726
Total FP	5927	>	0
Total FP CONTRA	920	>	0
Total FP INCONS	4326	>	0
Total FP COMP	681	>	0
Total FN	8157	<	13360
P-value	3.56938820447e-08

^top

Performance plots

Comparison of performance of RNAalifold(20) and Mastr(20). Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for RNAalifold(20) and Mastr(20)).
Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for RNAalifold(20) and Mastr(20)).
Comparison of average Matthews Correlation Coefficients (MCCs) for RNAalifold(20) and Mastr(20). The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for RNAalifold(20) and Mastr(20)).

^top

Performance of RNAalifold(20) - scored higher in this pairwise comparison

1. Total counts & total scores for RNAalifold(20)

Total Base Pair Counts
Total TP	5203
Total TN	44598277
Total FP	5927
Total FP CONTRA	920
Total FP INCONS	4326
Total FP COMP	681
Total FN	8157

Total Scores
MCC	0.440
Average MCC ± 95% Confidence Intervals	0.442 ± 0.031
Sensitivity	0.389
Positive Predictive Value	0.498
Nr of predictions	27

^top

2. Individual counts for RNAalifold(20) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00298	SSU_rRNA_eukarya links to Rfam database...	0.43	0.38	0.49	187	1620517	224	43	153	28	307
CRW_00301	SSU_rRNA_eukarya links to Rfam database...	0.42	0.37	0.48	192	1762101	229	37	173	19	327
CRW_00306	SSU_rRNA_eukarya links to Rfam database...	0.42	0.38	0.46	176	1445467	237	39	168	30	286
CRW_00310	SSU_rRNA_eukarya links to Rfam database...	0.46	0.39	0.55	204	1805579	190	29	138	23	317
CRW_00326	SSU_rRNA_eukarya links to Rfam database...	0.41	0.35	0.47	178	1627730	219	36	166	17	324
CRW_00330	SSU_rRNA_eukarya links to Rfam database...	0.40	0.35	0.47	182	1988624	243	35	174	34	335
CRW_00332	SSU_rRNA_eukarya links to Rfam database...	0.39	0.34	0.43	164	1769642	239	35	180	24	313
CRW_00333	SSU_rRNA_eukarya links to Rfam database...	0.34	0.29	0.40	150	1892114	241	34	187	20	364
CRW_00345	SSU_rRNA_eukarya links to Rfam database...	0.43	0.38	0.48	189	1586477	222	39	166	17	309
CRW_00346	SSU_rRNA_eukarya links to Rfam database...	0.45	0.40	0.50	202	1584688	230	32	168	30	299
CRW_00348	SSU_rRNA_eukarya links to Rfam database...	0.43	0.38	0.48	190	1615106	228	41	166	21	313
CRW_00358	SSU_rRNA_eukarya links to Rfam database...	0.43	0.38	0.49	192	1674972	227	34	167	26	315
CRW_00366	SSU_rRNA_eukarya links to Rfam database...	0.39	0.34	0.45	166	1579381	248	30	176	42	316
CRW_00370	SSU_rRNA_eukarya links to Rfam database...	0.52	0.47	0.57	240	1640342	204	34	150	20	266
CRW_00371	SSU_rRNA_eukarya links to Rfam database...	0.43	0.38	0.49	187	1611527	222	27	169	26	309
CRW_00372	SSU_rRNA_eukarya links to Rfam database...	0.40	0.35	0.46	174	1625925	228	37	170	21	324
CRW_00379	SSU_rRNA_eukarya links to Rfam database...	0.40	0.34	0.47	179	2126574	228	31	169	28	355
CRW_00403	SSU_rRNA_eukarya links to Rfam database...	0.39	0.37	0.42	170	1606127	272	38	193	41	294
CRW_00411	SSU_rRNA_eukarya links to Rfam database...	0.43	0.39	0.48	191	1615105	227	43	164	20	305
CRW_00598	SSU_rRNA_eukarya links to Rfam database...	0.42	0.38	0.47	187	1665825	229	39	174	16	304
CRW_00758	SSU_rRNA_eukarya links to Rfam database...	0.48	0.43	0.53	210	1640373	205	34	149	22	273
CRW_00759	SSU_rRNA_eukarya links to Rfam database...	0.42	0.38	0.48	182	1636762	232	39	162	31	299
CRW_00760	SSU_rRNA_eukarya links to Rfam database...	0.43	0.37	0.50	179	1638594	209	38	144	27	307
CRW_00772	SSU_rRNA_bacteria links to Rfam database...	0.78	0.74	0.83	298	945642	94	6	54	34	106
CRW_01153	SSU_rRNA_eukarya links to Rfam database...	0.47	0.42	0.53	210	1606133	216	27	158	31	293
CRW_01171	SSU_rRNA_eukarya links to Rfam database...	0.44	0.38	0.50	193	1593619	210	32	161	17	313
CRW_01300	SSU_rRNA_eukarya links to Rfam database...	0.52	0.45	0.59	231	1693331	174	31	127	16	284

^top

Performance of Mastr(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Mastr(20)

Total Base Pair Counts
Total TP	0
Total TN	44608726
Total FP	0
Total FP CONTRA	0
Total FP INCONS	0
Total FP COMP	0
Total FN	13360

Total Scores
MCC	0.000
Average MCC ± 95% Confidence Intervals	0.000 ± 0.000
Sensitivity	0.000
Positive Predictive Value	0.000
Nr of predictions	27

^top

2. Individual counts for Mastr(20) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00298	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1620900	0	0	0	0	494
CRW_00301	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1762503	0	0	0	0	519
CRW_00306	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1445850	0	0	0	0	462
CRW_00310	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1805950	0	0	0	0	521
CRW_00326	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1628110	0	0	0	0	502
CRW_00330	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1989015	0	0	0	0	517
CRW_00332	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1770021	0	0	0	0	477
CRW_00333	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1892485	0	0	0	0	514
CRW_00345	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1586871	0	0	0	0	498
CRW_00346	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1585090	0	0	0	0	501
CRW_00348	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1615503	0	0	0	0	503
CRW_00358	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1675365	0	0	0	0	507
CRW_00366	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1579753	0	0	0	0	482
CRW_00370	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1640766	0	0	0	0	506
CRW_00371	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1611910	0	0	0	0	496
CRW_00372	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1626306	0	0	0	0	498
CRW_00379	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	2126953	0	0	0	0	534
CRW_00403	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1606528	0	0	0	0	464
CRW_00411	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1615503	0	0	0	0	496
CRW_00598	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1666225	0	0	0	0	491
CRW_00758	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1640766	0	0	0	0	483
CRW_00759	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1637145	0	0	0	0	481
CRW_00760	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1638955	0	0	0	0	486
CRW_00772	SSU_rRNA_bacteria links to Rfam database...	0.00	0.00	0.00	0	946000	0	0	0	0	404
CRW_01153	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1606528	0	0	0	0	503
CRW_01171	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1594005	0	0	0	0	506
CRW_01300	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1693720	0	0	0	0	515

^top

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.

Table of contents:

Overview

Performance plots

Performance of RNAalifold(20) - scored higher in this pairwise comparison

1. Total counts & total scores for RNAalifold(20)

2. Individual counts for RNAalifold(20) [ download as .csv ]

Performance of Mastr(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Mastr(20)

2. Individual counts for Mastr(20) [ download as .csv ]