CompaRNA - on-line benchmarks of RNA structure prediction methods

FAQ

Metric	CMfinder(20)		Afold
MCC	0.850	>	0.569
Average MCC ± 95% Confidence Intervals	0.850 ± 0.048	>	0.564 ± 1.229
Sensitivity	0.737	>	0.500
Positive Predictive Value	0.982	>	0.655
Total TP	56	>	38
Total TN	8027	>	8026
Total FP	1	<	21
Total FP CONTRA	0	<	5
Total FP INCONS	1	<	15
Total FP COMP	0	<	1
Total FN	20	<	38
P-value	0.0

Comparison of performance of CMfinder(20) and Afold. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for CMfinder(20) and Afold).
Comparison of average Matthews Correlation Coefficients (MCCs) for CMfinder(20) and Afold. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for CMfinder(20) and Afold).

Total Scores
MCC	0.850
Average MCC ± 95% Confidence Intervals	0.850 ± 0.048
Sensitivity	0.737
Positive Predictive Value	0.982
Nr of predictions	3

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
PDB_00571	tRNA links to Rfam database...	0.87	0.80	0.95	20	3300	1	0	1	0	5
PDB_00828	Purine links to Rfam database...	0.84	0.70	1.00	19	2466	0	0	0	0	8
PDB_00829	Purine links to Rfam database...	0.84	0.71	1.00	17	2261	0	0	0	0	7

Total Scores
MCC	0.569
Average MCC ± 95% Confidence Intervals	0.564 ± 1.229
Sensitivity	0.500
Positive Predictive Value	0.655
Nr of predictions	3

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
PDB_00571	tRNA links to Rfam database...	-0.01	0.00	0.00	0	3302	20	5	14	1	25
PDB_00828	Purine links to Rfam database...	0.88	0.78	1.00	21	2464	0	0	0	0	6
PDB_00829	Purine links to Rfam database...	0.82	0.71	0.94	17	2260	1	0	1	0	7

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.