CompaRNA - on-line benchmarks of RNA structure prediction methods

FAQ

Metric	CentroidAlifold(seed)		Mastr(20)
MCC	0.543	>	0.000
Average MCC ± 95% Confidence Intervals	0.543 ± 0.078	>	0.000 ± 0.000
Sensitivity	0.386	>	0.000
Positive Predictive Value	0.765	>	0.000
Total TP	1683	>	0
Total TN	14161447	<	14163647
Total FP	712	>	0
Total FP CONTRA	35	>	0
Total FP INCONS	482	>	0
Total FP COMP	195	>	0
Total FN	2681	<	4364
P-value	0.0

Comparison of performance of CentroidAlifold(seed) and Mastr(20). Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for CentroidAlifold(seed) and Mastr(20)).
Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for CentroidAlifold(seed) and Mastr(20)).
Comparison of average Matthews Correlation Coefficients (MCCs) for CentroidAlifold(seed) and Mastr(20). The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for CentroidAlifold(seed) and Mastr(20)).

Total Scores
MCC	0.543
Average MCC ± 95% Confidence Intervals	0.543 ± 0.078
Sensitivity	0.386
Positive Predictive Value	0.765
Nr of predictions	9

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00306	SSU_rRNA_eukarya links to Rfam database...	0.53	0.37	0.77	170	1445629	73	4	47	22	292
CRW_00366	SSU_rRNA_eukarya links to Rfam database...	0.53	0.37	0.77	177	1579523	74	4	49	21	305
CRW_00371	SSU_rRNA_eukarya links to Rfam database...	0.54	0.37	0.78	185	1611673	73	4	48	21	311
CRW_00379	SSU_rRNA_eukarya links to Rfam database...	0.45	0.30	0.69	158	2126723	93	6	66	21	376
CRW_00411	SSU_rRNA_eukarya links to Rfam database...	0.53	0.37	0.76	182	1615264	78	4	53	21	314
CRW_00759	SSU_rRNA_eukarya links to Rfam database...	0.50	0.35	0.72	168	1636913	92	3	61	28	313
CRW_00772	SSU_rRNA_bacteria links to Rfam database...	0.80	0.74	0.87	297	945660	69	2	41	26	107
CRW_01153	SSU_rRNA_eukarya links to Rfam database...	0.48	0.33	0.70	167	1606289	89	4	68	17	336
CRW_01171	SSU_rRNA_eukarya links to Rfam database...	0.52	0.35	0.77	179	1593773	71	4	49	18	327

Total Scores
MCC	0.000
Average MCC ± 95% Confidence Intervals	0.000 ± 0.000
Sensitivity	0.000
Positive Predictive Value	0.000
Nr of predictions	9

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00306	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1445850	0	0	0	0	462
CRW_00366	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1579753	0	0	0	0	482
CRW_00371	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1611910	0	0	0	0	496
CRW_00379	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	2126953	0	0	0	0	534
CRW_00411	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1615503	0	0	0	0	496
CRW_00759	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1637145	0	0	0	0	481
CRW_00772	SSU_rRNA_bacteria links to Rfam database...	0.00	0.00	0.00	0	946000	0	0	0	0	404
CRW_01153	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1606528	0	0	0	0	503
CRW_01171	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1594005	0	0	0	0	506

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.