CompaRNA - on-line benchmarks of RNA structure prediction methods

FAQ

Metric	PPfold(20)		CRWrnafold
MCC	0.844	>	0.653
Average MCC ± 95% Confidence Intervals	0.844 ± 0.129	>	0.652 ± 0.484
Sensitivity	0.809	>	0.640
Positive Predictive Value	0.881	>	0.666
Total TP	741	>	586
Total TN	2255193	>	2255154
Total FP	144	<	351
Total FP CONTRA	19	<	48
Total FP INCONS	81	<	246
Total FP COMP	44	<	57
Total FN	175	<	330
P-value	0.0

Comparison of performance of PPfold(20) and CRWrnafold. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for PPfold(20) and CRWrnafold).
Comparison of average Matthews Correlation Coefficients (MCCs) for PPfold(20) and CRWrnafold. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for PPfold(20) and CRWrnafold).

Total Scores
MCC	0.844
Average MCC ± 95% Confidence Intervals	0.844 ± 0.129
Sensitivity	0.809
Positive Predictive Value	0.881
Nr of predictions	2

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00590	SSU_rRNA_bacteria links to Rfam database...	0.85	0.81	0.90	367	1119348	69	4	37	28	85
CRW_00997	SSU_rRNA_bacteria links to Rfam database...	0.83	0.81	0.86	374	1135845	75	15	44	16	90

Total Scores
MCC	0.653
Average MCC ± 95% Confidence Intervals	0.652 ± 0.484
Sensitivity	0.640
Positive Predictive Value	0.666
Nr of predictions	2

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00590	SSU_rRNA_bacteria links to Rfam database...	0.61	0.59	0.64	268	1119334	184	21	133	30	184
CRW_00997	SSU_rRNA_bacteria links to Rfam database...	0.69	0.69	0.69	318	1135820	167	27	113	27	146

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.