CompaRNA - on-line benchmarks of RNA structure prediction methods

FAQ

Metric	PETfold_pre2.0(20)		Contrafold
MCC	0.622	>	0.492
Average MCC ± 95% Confidence Intervals	0.620 ± 0.196	>	0.523 ± 0.188
Sensitivity	0.597	>	0.519
Positive Predictive Value	0.654	>	0.476
Total TP	123	>	107
Total TN	22999	>	22962
Total FP	94	<	173
Total FP CONTRA	14	<	43
Total FP INCONS	51	<	75
Total FP COMP	29	<	55
Total FN	83	<	99
P-value	9.74569091494e-09

Comparison of performance of PETfold_pre2.0(20) and Contrafold. Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for PETfold_pre2.0(20) and Contrafold).
Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for PETfold_pre2.0(20) and Contrafold).
Comparison of average Matthews Correlation Coefficients (MCCs) for PETfold_pre2.0(20) and Contrafold. The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for PETfold_pre2.0(20) and Contrafold).

Total Scores
MCC	0.622
Average MCC ± 95% Confidence Intervals	0.620 ± 0.196
Sensitivity	0.597
Positive Predictive Value	0.654
Nr of predictions	10

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
3J20_0	tRNA links to Rfam database...	0.95	0.95	0.95	20	1198	1	1	0	0	1
3J3D_C	tRNA links to Rfam database...	0.87	0.89	0.85	17	948	3	3	0	0	2
3J3E_8	5_8S_rRNA links to Rfam database...	0.48	0.47	0.50	7	2728	11	2	5	4	8
3J3F_8	5_8S_rRNA links to Rfam database...	0.34	0.37	0.32	7	4739	24	5	10	9	12
3ZEX_C	5_8S_rRNA links to Rfam database...	0.26	0.24	0.29	7	5350	20	1	16	3	22
4A1C_2	5_8S_rRNA links to Rfam database...	0.25	0.25	0.25	5	4496	25	2	13	10	15
4AOB_A	SAM links to Rfam database...	0.87	0.83	0.92	24	1411	4	0	2	2	5
4ENB_A	crcB links to Rfam database...	0.68	0.53	0.89	8	463	1	0	1	0	7
4ENC_A	crcB links to Rfam database...	0.61	0.53	0.73	8	485	3	0	3	0	7
4FRG_B	AdoCbl-variant links to Rfam database...	0.89	0.83	0.95	20	1181	2	0	1	1	4

Total Scores
MCC	0.492
Average MCC ± 95% Confidence Intervals	0.523 ± 0.188
Sensitivity	0.519
Positive Predictive Value	0.476
Nr of predictions	10

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
3J20_0	tRNA links to Rfam database...	0.53	0.57	0.50	12	1195	13	3	9	1	9
3J3D_C	tRNA links to Rfam database...	0.71	0.79	0.65	15	945	8	3	5	0	4
3J3E_8	5_8S_rRNA links to Rfam database...	0.12	0.13	0.11	2	2724	32	5	11	16	13
3J3F_8	5_8S_rRNA links to Rfam database...	0.35	0.47	0.26	9	4726	44	13	13	18	10
3ZEX_C	5_8S_rRNA links to Rfam database...	0.35	0.34	0.37	10	5347	23	4	13	6	19
4A1C_2	5_8S_rRNA links to Rfam database...	0.21	0.25	0.19	5	4489	33	9	13	11	15
4AOB_A	SAM links to Rfam database...	0.53	0.52	0.56	15	1410	13	3	9	1	14
4ENB_A	crcB links to Rfam database...	0.85	0.73	1.00	11	461	1	0	0	1	4
4ENC_A	crcB links to Rfam database...	0.85	0.73	1.00	11	485	1	0	0	1	4
4FRG_B	AdoCbl-variant links to Rfam database...	0.73	0.71	0.77	17	1180	5	3	2	0	7

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.