CompaRNA - on-line benchmarks of RNA structure prediction methods

FAQ

Metric	Mastr(20)		Afold
MCC	0.574	>	0.569
Average MCC ± 95% Confidence Intervals	0.572 ± 1.245	>	0.564 ± 1.229
Sensitivity	0.500	=	0.500
Positive Predictive Value	0.667	>	0.655
Total TP	38	=	38
Total TN	8027	>	8026
Total FP	20	<	21
Total FP CONTRA	3	<	5
Total FP INCONS	16	>	15
Total FP COMP	1	=	1
Total FN	38	=	38
P-value	0.0

Comparison of performance of Mastr(20) and Afold. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for Mastr(20) and Afold).
Comparison of average Matthews Correlation Coefficients (MCCs) for Mastr(20) and Afold. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for Mastr(20) and Afold).

Total Scores
MCC	0.574
Average MCC ± 95% Confidence Intervals	0.572 ± 1.245
Sensitivity	0.500
Positive Predictive Value	0.667
Nr of predictions	3

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
PDB_00571	tRNA links to Rfam database...	-0.01	0.00	0.00	0	3302	20	3	16	1	25
PDB_00828	Purine links to Rfam database...	0.88	0.78	1.00	21	2464	0	0	0	0	6
PDB_00829	Purine links to Rfam database...	0.84	0.71	1.00	17	2261	0	0	0	0	7

Total Scores
MCC	0.569
Average MCC ± 95% Confidence Intervals	0.564 ± 1.229
Sensitivity	0.500
Positive Predictive Value	0.655
Nr of predictions	3

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
PDB_00571	tRNA links to Rfam database...	-0.01	0.00	0.00	0	3302	20	5	14	1	25
PDB_00828	Purine links to Rfam database...	0.88	0.78	1.00	21	2464	0	0	0	0	6
PDB_00829	Purine links to Rfam database...	0.82	0.71	0.94	17	2260	1	0	1	0	7

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.