CompaRNA - on-line benchmarks of RNA structure prediction methods

FAQ

Metric	ContextFold		RNASLOpt
MCC	0.705	>	0.591
Average MCC ± 95% Confidence Intervals	0.739 ± 0.100	>	0.668 ± 0.115
Sensitivity	0.594	>	0.498
Positive Predictive Value	0.843	>	0.709
Total TP	360	>	302
Total TN	64163	<	64164
Total FP	90	<	141
Total FP CONTRA	6	<	16
Total FP INCONS	61	<	108
Total FP COMP	23	>	17
Total FN	246	<	304
P-value	3.56938820447e-08

Total Scores
MCC	0.705
Average MCC ± 95% Confidence Intervals	0.739 ± 0.100
Sensitivity	0.594
Positive Predictive Value	0.843
Nr of predictions	30

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2LC8_A	GP_knot1 links to Rfam database...	0.55	0.50	0.63	10	1524	6	0	6	0	10
2LDL_A	-	0.90	0.82	1.00	9	342	0	0	0	0	2
2LHP_A	-	0.97	0.94	1.00	15	651	0	0	0	0	1
2LI4_A	-	0.93	0.88	1.00	14	482	0	0	0	0	2
2LJJ_A	-	0.93	0.88	1.00	7	344	2	0	0	2	1
2LK3_A	-	0.89	0.80	1.00	8	268	0	0	0	0	2
2LKR_A	-	0.65	0.56	0.76	22	6076	9	0	7	2	17
2LQZ_A	-	0.80	0.73	0.89	8	342	1	1	0	0	3
2LWK_A	-	0.88	0.85	0.92	11	484	1	0	1	0	2
3J0L_8	-	0.93	0.88	1.00	7	183	0	0	0	0	1
3J0L_a	-	0.71	0.56	0.90	9	1118	1	0	1	0	7
3J0L_1	-	0.70	0.58	0.85	11	1212	3	0	2	1	8
3J0L_h	-	0.82	0.67	1.00	29	6076	2	0	0	2	14
3J0L_7	-	-0.01	0.00	0.00	0	1212	13	0	13	0	17
3J0L_g	-	-0.01	0.00	0.00	0	462	3	1	2	0	4
3J0L_2	-	0.64	0.61	0.69	20	6187	11	2	7	2	13
3J16_L	tRNA links to Rfam database...	0.75	0.57	1.00	17	2758	0	0	0	0	13
3SN2_B	IRE_II links to Rfam database...	0.96	0.92	1.00	11	395	0	0	0	0	1
3TRZ_Z	-	0.91	0.83	1.00	5	205	0	0	0	0	1
3TS0_U	-	1.00	1.00	1.00	6	247	0	0	0	0	0
3TS2_V	-	1.00	1.00	1.00	5	271	0	0	0	0	0
3U4M_B	-	0.75	0.57	1.00	21	3139	0	0	0	0	16
3UZL_B	tRNA links to Rfam database...	0.72	0.54	0.95	20	3549	1	0	1	0	17
3VJR_D	-	0.96	0.92	1.00	12	618	0	0	0	0	1
4A1C_3	5S_rRNA links to Rfam database...	0.78	0.63	0.97	34	7105	1	0	1	0	20
4A1C_2	5_8S_rRNA links to Rfam database...	0.20	0.15	0.28	5	11763	26	0	13	13	28
4A4U_A	-	1.00	1.00	1.00	9	222	0	0	0	0	0
4AOB_A	SAM links to Rfam database...	0.52	0.40	0.68	17	4346	9	1	7	1	25
4ENB_A	crcB links to Rfam database...	0.69	0.47	1.00	9	1266	0	0	0	0	10
4ENC_A	crcB links to Rfam database...	0.65	0.47	0.90	9	1316	1	1	0	0	10

Total Scores
MCC	0.591
Average MCC ± 95% Confidence Intervals	0.668 ± 0.115
Sensitivity	0.498
Positive Predictive Value	0.709
Nr of predictions	30

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2LC8_A	GP_knot1 links to Rfam database...	0.47	0.35	0.64	7	1529	4	0	4	0	13
2LDL_A	-	0.90	0.82	1.00	9	342	1	0	0	1	2
2LHP_A	-	0.97	0.94	1.00	15	651	0	0	0	0	1
2LI4_A	-	0.93	0.88	1.00	14	482	0	0	0	0	2
2LJJ_A	-	1.00	1.00	1.00	8	343	2	0	0	2	0
2LK3_A	-	0.95	0.90	1.00	9	267	0	0	0	0	1
2LKR_A	-	0.68	0.62	0.75	24	6073	9	0	8	1	15
2LQZ_A	-	0.85	0.82	0.90	9	341	1	1	0	0	2
2LWK_A	-	0.83	0.77	0.91	10	485	1	0	1	0	3
3J0L_8	-	0.70	0.50	1.00	4	186	0	0	0	0	4
3J0L_a	-	0.26	0.19	0.38	3	1120	5	1	4	0	13
3J0L_1	-	0.65	0.47	0.90	9	1215	3	0	1	2	10
3J0L_h	-	0.70	0.49	1.00	21	6084	0	0	0	0	22
3J0L_7	-	-0.01	0.00	0.00	0	1212	13	0	13	0	17
3J0L_g	-	-0.01	0.00	0.00	0	461	4	1	3	0	4
3J0L_2	-	0.39	0.36	0.43	12	6188	18	2	14	2	21
3J16_L	tRNA links to Rfam database...	0.53	0.40	0.71	12	2758	5	0	5	0	18
3SN2_B	IRE_II links to Rfam database...	0.96	0.92	1.00	11	395	0	0	0	0	1
3TRZ_Z	-	0.91	0.83	1.00	5	205	2	0	0	2	1
3TS0_U	-	1.00	1.00	1.00	6	247	1	0	0	1	0
3TS2_V	-	1.00	1.00	1.00	5	271	0	0	0	0	0
3U4M_B	-	0.38	0.32	0.46	12	3134	14	0	14	0	25
3UZL_B	tRNA links to Rfam database...	0.48	0.32	0.71	12	3553	5	0	5	0	25
3VJR_D	-	0.96	0.92	1.00	12	618	0	0	0	0	1
4A1C_3	5S_rRNA links to Rfam database...	0.67	0.52	0.88	28	7108	4	0	4	0	26
4A1C_2	5_8S_rRNA links to Rfam database...	0.23	0.24	0.22	8	11744	35	8	21	6	25
4A4U_A	-	1.00	1.00	1.00	9	222	0	0	0	0	0
4AOB_A	SAM links to Rfam database...	0.26	0.19	0.38	8	4350	13	2	11	0	34
4ENB_A	crcB links to Rfam database...	0.76	0.58	1.00	11	1264	0	0	0	0	8
4ENC_A	crcB links to Rfam database...	0.65	0.47	0.90	9	1316	1	1	0	0	10

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.