CompaRNA - on-line benchmarks of RNA structure prediction methods

CompaRNA - on-line benchmarks of RNA structure prediction methods

Laboratory of Structural Bioinformatics @ Adam Mickiewicz University in Poznan

Home

RNA 2D Atlas

Help

FAQ

Table of contents:

Overview

Performance Plots

Performance of Multilign(seed) - scored higher in this pairwise comparison

Total counts & total scores
Individual counts

Performance of Carnac(20) - scored lower in this pairwise comparison

Total counts & total scores
Individual counts

Compile and download dataset for Multilign(seed) & Carnac(20) [.zip] - may take several seconds...

Overview

Metric	Multilign(seed)		Carnac(20)
MCC	0.678	>	0.566
Average MCC ± 95% Confidence Intervals	0.711 ± 0.265	>	0.463 ± 0.523
Sensitivity	0.543	>	0.362
Positive Predictive Value	0.852	<	0.893
Total TP	75	>	50
Total TN	11400	<	11432
Total FP	14	>	7
Total FP CONTRA	1	=	1
Total FP INCONS	12	>	5
Total FP COMP	1	=	1
Total FN	63	<	88
P-value	0.0

Performance plots

Performance of Multilign(seed) - scored higher in this pairwise comparison

1. Total counts & total scores for Multilign(seed)

Total Base Pair Counts
Total TP	75
Total TN	11400
Total FP	14
Total FP CONTRA	1
Total FP INCONS	12
Total FP COMP	1
Total FN	63

Total Scores
MCC	0.678
Average MCC ± 95% Confidence Intervals	0.711 ± 0.265
Sensitivity	0.543
Positive Predictive Value	0.852
Nr of predictions	4

2. Individual counts for Multilign(seed) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2L94_A	HIV_FE links to Rfam database...	0.92	0.85	1.00	17	973	0	0	0	0	3
3RKF_A	Purine links to Rfam database...	0.76	0.59	1.00	20	2191	0	0	0	0	14
3SD1_A	THF links to Rfam database...	0.55	0.45	0.68	19	3888	9	1	8	0	23
4AOB_A	SAM links to Rfam database...	0.61	0.45	0.83	19	4348	5	0	4	1	23

Performance of Carnac(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Carnac(20)

Total Base Pair Counts
Total TP	50
Total TN	11432
Total FP	7
Total FP CONTRA	1
Total FP INCONS	5
Total FP COMP	1
Total FN	88

Total Scores
MCC	0.566
Average MCC ± 95% Confidence Intervals	0.463 ± 0.523
Sensitivity	0.362
Positive Predictive Value	0.893
Nr of predictions	4

2. Individual counts for Carnac(20) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2L94_A	HIV_FE links to Rfam database...	0.00	0.00	0.00	0	990	0	0	0	0	20
3RKF_A	Purine links to Rfam database...	0.76	0.59	1.00	20	2191	0	0	0	0	14
3SD1_A	THF links to Rfam database...	0.60	0.38	0.94	16	3899	1	0	1	0	26
4AOB_A	SAM links to Rfam database...	0.49	0.33	0.74	14	4352	6	1	4	1	28

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.