CompaRNA - on-line benchmarks of RNA structure prediction methods

CompaRNA - on-line benchmarks of RNA structure prediction methods

Laboratory of Structural Bioinformatics @ Adam Mickiewicz University in Poznan

Home

RNA 2D Atlas

Help

FAQ

Table of contents:

Overview

Performance Plots

Performance of ContextFold - scored higher in this pairwise comparison

Total counts & total scores
Individual counts

Performance of RDfolder - scored lower in this pairwise comparison

Total counts & total scores
Individual counts

Compile and download dataset for ContextFold & RDfolder [.zip] - may take several seconds...

Overview

Metric	ContextFold		RDfolder
MCC	0.669	>	0.481
Average MCC ± 95% Confidence Intervals	0.714 ± 0.161	>	0.561 ± 0.209
Sensitivity	0.561	>	0.379
Positive Predictive Value	0.807	>	0.623
Total TP	142	>	96
Total TN	17347	<	17369
Total FP	36	<	60
Total FP CONTRA	3	<	5
Total FP INCONS	31	<	53
Total FP COMP	2	=	2
Total FN	111	<	157
P-value	3.18846395401e-08

Performance plots

Performance of ContextFold - scored higher in this pairwise comparison

1. Total counts & total scores for ContextFold

Total Base Pair Counts
Total TP	142
Total TN	17347
Total FP	36
Total FP CONTRA	3
Total FP INCONS	31
Total FP COMP	2
Total FN	111

Total Scores
MCC	0.669
Average MCC ± 95% Confidence Intervals	0.714 ± 0.161
Sensitivity	0.561
Positive Predictive Value	0.807
Nr of predictions	17

2. Individual counts for ContextFold [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2LC8_A	GP_knot1 links to Rfam database...	0.55	0.50	0.63	10	1524	6	0	6	0	10
2LDL_A	-	0.90	0.82	1.00	9	342	0	0	0	0	2
2LK3_A	-	0.89	0.80	1.00	8	268	0	0	0	0	2
3J0L_7	-	-0.01	0.00	0.00	0	1212	13	0	13	0	17
3J0L_g	-	-0.01	0.00	0.00	0	462	3	1	2	0	4
3J0L_8	-	0.93	0.88	1.00	7	183	0	0	0	0	1
3J0L_a	-	0.71	0.56	0.90	9	1118	1	0	1	0	7
3J0L_1	-	0.70	0.58	0.85	11	1212	3	0	2	1	8
3J16_L	tRNA links to Rfam database...	0.75	0.57	1.00	17	2758	0	0	0	0	13
3SN2_B	IRE_II links to Rfam database...	0.96	0.92	1.00	11	395	0	0	0	0	1
3TRZ_Z	-	0.91	0.83	1.00	5	205	0	0	0	0	1
3TS0_U	-	1.00	1.00	1.00	6	247	0	0	0	0	0
3TS2_V	-	1.00	1.00	1.00	5	271	0	0	0	0	0
4A4U_A	-	1.00	1.00	1.00	9	222	0	0	0	0	0
4AOB_A	SAM links to Rfam database...	0.52	0.40	0.68	17	4346	9	1	7	1	25
4ENB_A	crcB links to Rfam database...	0.69	0.47	1.00	9	1266	0	0	0	0	10
4ENC_A	crcB links to Rfam database...	0.65	0.47	0.90	9	1316	1	1	0	0	10

Performance of RDfolder - scored lower in this pairwise comparison

1. Total counts & total scores for RDfolder

Total Base Pair Counts
Total TP	96
Total TN	17369
Total FP	60
Total FP CONTRA	5
Total FP INCONS	53
Total FP COMP	2
Total FN	157

Total Scores
MCC	0.481
Average MCC ± 95% Confidence Intervals	0.561 ± 0.209
Sensitivity	0.379
Positive Predictive Value	0.623
Nr of predictions	17

2. Individual counts for RDfolder [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2LC8_A	GP_knot1 links to Rfam database...	-0.01	0.00	0.00	0	1526	14	2	12	0	20
2LDL_A	-	0.90	0.82	1.00	9	342	0	0	0	0	2
2LK3_A	-	0.95	0.90	1.00	9	267	0	0	0	0	1
3J0L_7	-	-0.01	0.00	0.00	0	1220	5	0	5	0	17
3J0L_g	-	-0.01	0.00	0.00	0	462	3	1	2	0	4
3J0L_8	-	0.86	0.75	1.00	6	184	0	0	0	0	2
3J0L_a	-	-0.01	0.00	0.00	0	1124	4	1	3	0	16
3J0L_1	-	0.65	0.47	0.90	9	1215	2	0	1	1	10
3J16_L	tRNA links to Rfam database...	0.22	0.17	0.31	5	2759	11	0	11	0	25
3SN2_B	IRE_II links to Rfam database...	0.96	0.92	1.00	11	395	0	0	0	0	1
3TRZ_Z	-	0.91	0.83	1.00	5	205	0	0	0	0	1
3TS0_U	-	0.91	0.83	1.00	5	248	0	0	0	0	1
3TS2_V	-	1.00	1.00	1.00	5	271	0	0	0	0	0
4A4U_A	-	1.00	1.00	1.00	9	222	0	0	0	0	0
4AOB_A	SAM links to Rfam database...	0.35	0.26	0.48	11	4348	13	1	11	1	31
4ENB_A	crcB links to Rfam database...	0.43	0.32	0.60	6	1265	4	0	4	0	13
4ENC_A	crcB links to Rfam database...	0.43	0.32	0.60	6	1316	4	0	4	0	13

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.