CompaRNA - on-line benchmarks of RNA structure prediction methods

FAQ

Metric	RNASampler(20)		Afold
MCC	0.865	>	0.569
Average MCC ± 95% Confidence Intervals	0.865 ± 0.016	>	0.564 ± 1.229
Sensitivity	0.763	>	0.500
Positive Predictive Value	0.983	>	0.655
Total TP	58	>	38
Total TN	8025	<	8026
Total FP	1	<	21
Total FP CONTRA	1	<	5
Total FP INCONS	0	<	15
Total FP COMP	0	<	1
Total FN	18	<	38
P-value	0.0

Comparison of performance of RNASampler(20) and Afold. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for RNASampler(20) and Afold).
Comparison of average Matthews Correlation Coefficients (MCCs) for RNASampler(20) and Afold. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for RNASampler(20) and Afold).

Total Scores
MCC	0.865
Average MCC ± 95% Confidence Intervals	0.865 ± 0.016
Sensitivity	0.763
Positive Predictive Value	0.983
Nr of predictions	3

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
PDB_00571	tRNA links to Rfam database...	0.87	0.80	0.95	20	3300	1	1	0	0	5
PDB_00828	Purine links to Rfam database...	0.86	0.74	1.00	20	2465	0	0	0	0	7
PDB_00829	Purine links to Rfam database...	0.86	0.75	1.00	18	2260	0	0	0	0	6

Total Scores
MCC	0.569
Average MCC ± 95% Confidence Intervals	0.564 ± 1.229
Sensitivity	0.500
Positive Predictive Value	0.655
Nr of predictions	3

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
PDB_00571	tRNA links to Rfam database...	-0.01	0.00	0.00	0	3302	20	5	14	1	25
PDB_00828	Purine links to Rfam database...	0.88	0.78	1.00	21	2464	0	0	0	0	6
PDB_00829	Purine links to Rfam database...	0.82	0.71	0.94	17	2260	1	0	1	0	7

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.