CompaRNA - on-line benchmarks of RNA structure prediction methods

CompaRNA - on-line benchmarks of RNA structure prediction methods

Laboratory of Structural Bioinformatics @ Adam Mickiewicz University in Poznan

Home

RNA 2D Atlas

Help

FAQ

Table of contents:

Overview

Performance Plots

Performance of Alterna - scored higher in this pairwise comparison

Total counts & total scores
Individual counts

Performance of RNASampler(seed) - scored lower in this pairwise comparison

Total counts & total scores
Individual counts

Compile and download dataset for Alterna & RNASampler(seed) [.zip] - may take several seconds...

Overview

Metric	Alterna		RNASampler(seed)
MCC	0.807	>	0.753
Average MCC ± 95% Confidence Intervals	0.828 ± 0.103	>	0.756 ± 0.139
Sensitivity	0.727	>	0.603
Positive Predictive Value	0.900	<	0.946
Total TP	253	>	210
Total TN	24648	<	24707
Total FP	30	>	14
Total FP CONTRA	3	>	0
Total FP INCONS	25	>	12
Total FP COMP	2	=	2
Total FN	95	<	138
P-value	1.50834591464e-08

Performance plots

Performance of Alterna - scored higher in this pairwise comparison

1. Total counts & total scores for Alterna

Total Base Pair Counts
Total TP	253
Total TN	24648
Total FP	30
Total FP CONTRA	3
Total FP INCONS	25
Total FP COMP	2
Total FN	95

Total Scores
MCC	0.807
Average MCC ± 95% Confidence Intervals	0.828 ± 0.103
Sensitivity	0.727
Positive Predictive Value	0.900
Nr of predictions	14

2. Individual counts for Alterna [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2KDQ_B	mir-TAR links to Rfam database...	0.95	0.91	1.00	10	396	0	0	0	0	1
2KE6_A	K10_TLS links to Rfam database...	0.92	0.89	0.94	17	1110	2	0	1	1	2
2KUR_A	K10_TLS links to Rfam database...	0.90	0.86	0.95	18	1109	1	0	1	0	3
2KUU_A	K10_TLS links to Rfam database...	0.87	0.81	0.94	17	1110	2	0	1	1	4
2KUV_A	K10_TLS links to Rfam database...	0.88	0.82	0.95	18	1109	1	0	1	0	4
2KUW_A	K10_TLS links to Rfam database...	0.95	0.90	1.00	19	1109	0	0	0	0	2
2L1F_B	Gammaretro_CES links to Rfam database...	0.98	0.96	1.00	24	2121	0	0	0	0	1
2L1F_A	Gammaretro_CES links to Rfam database...	0.98	0.96	1.00	23	2057	0	0	0	0	1
2L94_A	HIV_FE links to Rfam database...	0.97	0.95	1.00	19	971	0	0	0	0	1
2LC8_A	GP_knot1 links to Rfam database...	0.46	0.40	0.53	8	1525	7	0	7	0	12
3A3A_A	tRNA-Sec links to Rfam database...	0.84	0.70	1.00	26	3629	0	0	0	0	11
3IVN_B	Purine links to Rfam database...	0.74	0.61	0.90	19	2325	2	1	1	0	12
3RKF_A	Purine links to Rfam database...	0.69	0.56	0.86	19	2189	3	1	2	0	15
3SD1_A	THF links to Rfam database...	0.46	0.38	0.57	16	3888	12	1	11	0	26

Performance of RNASampler(seed) - scored lower in this pairwise comparison

1. Total counts & total scores for RNASampler(seed)

Total Base Pair Counts
Total TP	210
Total TN	24707
Total FP	14
Total FP CONTRA	0
Total FP INCONS	12
Total FP COMP	2
Total FN	138

Total Scores
MCC	0.753
Average MCC ± 95% Confidence Intervals	0.756 ± 0.139
Sensitivity	0.603
Positive Predictive Value	0.946
Nr of predictions	14

2. Individual counts for RNASampler(seed) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2KDQ_B	mir-TAR links to Rfam database...	0.95	0.91	1.00	10	396	0	0	0	0	1
2KE6_A	K10_TLS links to Rfam database...	0.92	0.84	1.00	16	1112	1	0	0	1	3
2KUR_A	K10_TLS links to Rfam database...	0.90	0.81	1.00	17	1111	0	0	0	0	4
2KUU_A	K10_TLS links to Rfam database...	0.87	0.76	1.00	16	1112	1	0	0	1	5
2KUV_A	K10_TLS links to Rfam database...	0.88	0.77	1.00	17	1111	0	0	0	0	5
2KUW_A	K10_TLS links to Rfam database...	0.90	0.81	1.00	17	1111	0	0	0	0	4
2L1F_B	Gammaretro_CES links to Rfam database...	0.82	0.68	1.00	17	2128	0	0	0	0	8
2L1F_A	Gammaretro_CES links to Rfam database...	0.81	0.67	1.00	16	2064	0	0	0	0	8
2L94_A	HIV_FE links to Rfam database...	0.71	0.55	0.92	11	978	1	0	1	0	9
2LC8_A	GP_knot1 links to Rfam database...	-0.01	0.00	0.00	0	1530	10	0	10	0	20
3A3A_A	tRNA-Sec links to Rfam database...	0.70	0.49	1.00	18	3637	0	0	0	0	19
3IVN_B	Purine links to Rfam database...	0.78	0.61	1.00	19	2327	0	0	0	0	12
3RKF_A	Purine links to Rfam database...	0.76	0.59	1.00	20	2191	0	0	0	0	14
3SD1_A	THF links to Rfam database...	0.60	0.38	0.94	16	3899	1	0	1	0	26

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.