CompaRNA - on-line benchmarks of RNA structure prediction methods

CompaRNA - on-line benchmarks of RNA structure prediction methods

Laboratory of Structural Bioinformatics @ Adam Mickiewicz University in Poznan

Home

RNA 2D Atlas

Help

FAQ

Table of contents:

Overview

Performance Plots

Performance of Multilign(seed) - scored higher in this pairwise comparison

Total counts & total scores
Individual counts

Performance of MXScarna(20) - scored lower in this pairwise comparison

Total counts & total scores
Individual counts

Compile and download dataset for Multilign(seed) & MXScarna(20) [.zip] - may take several seconds...

Overview

Metric	Multilign(seed)		MXScarna(20)
MCC	0.678	>	0.664
Average MCC ± 95% Confidence Intervals	0.711 ± 0.265	>	0.679 ± 0.092
Sensitivity	0.543	<	0.565
Positive Predictive Value	0.852	>	0.788
Total TP	75	<	78
Total TN	11400	>	11389
Total FP	14	<	22
Total FP CONTRA	1	<	2
Total FP INCONS	12	<	19
Total FP COMP	1	=	1
Total FN	63	>	60
P-value	0.0

Performance plots

Performance of Multilign(seed) - scored higher in this pairwise comparison

1. Total counts & total scores for Multilign(seed)

Total Base Pair Counts
Total TP	75
Total TN	11400
Total FP	14
Total FP CONTRA	1
Total FP INCONS	12
Total FP COMP	1
Total FN	63

Total Scores
MCC	0.678
Average MCC ± 95% Confidence Intervals	0.711 ± 0.265
Sensitivity	0.543
Positive Predictive Value	0.852
Nr of predictions	4

2. Individual counts for Multilign(seed) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2L94_A	HIV_FE links to Rfam database...	0.92	0.85	1.00	17	973	0	0	0	0	3
3RKF_A	Purine links to Rfam database...	0.76	0.59	1.00	20	2191	0	0	0	0	14
3SD1_A	THF links to Rfam database...	0.55	0.45	0.68	19	3888	9	1	8	0	23
4AOB_A	SAM links to Rfam database...	0.61	0.45	0.83	19	4348	5	0	4	1	23

Performance of MXScarna(20) - scored lower in this pairwise comparison

1. Total counts & total scores for MXScarna(20)

Total Base Pair Counts
Total TP	78
Total TN	11389
Total FP	22
Total FP CONTRA	2
Total FP INCONS	19
Total FP COMP	1
Total FN	60

Total Scores
MCC	0.664
Average MCC ± 95% Confidence Intervals	0.679 ± 0.092
Sensitivity	0.565
Positive Predictive Value	0.788
Nr of predictions	4

2. Individual counts for MXScarna(20) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
2L94_A	HIV_FE links to Rfam database...	0.73	0.70	0.78	14	972	4	0	4	0	6
3RKF_A	Purine links to Rfam database...	0.72	0.53	1.00	18	2193	0	0	0	0	16
3SD1_A	THF links to Rfam database...	0.63	0.55	0.74	23	3885	8	2	6	0	19
4AOB_A	SAM links to Rfam database...	0.62	0.55	0.72	23	4339	10	0	9	1	19

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.