CompaRNA - on-line benchmarks of RNA structure prediction methods

Laboratory of Structural Bioinformatics @ Adam Mickiewicz University in Poznan

Home

Methods

Datasets

Rankings

RNA 2D Atlas

Help

FAQ

Contact us

RSS feeds

Twitter

Overview

Metric	CentroidAlifold(20)		Mastr(20)
MCC	0.523	>	0.000
Average MCC ± 95% Confidence Intervals	0.523 ± 0.024	>	0.000 ± 0.000
Sensitivity	0.381	>	0.000
Positive Predictive Value	0.718	>	0.000
Total TP	5090	>	0
Total TN	44601636	<	44608726
Total FP	2835	>	0
Total FP CONTRA	223	>	0
Total FP INCONS	1777	>	0
Total FP COMP	835	>	0
Total FN	8270	<	13360
P-value	5.19332990918e-08

^top

Performance plots

Comparison of performance of CentroidAlifold(20) and Mastr(20). Positive Predictive Value (PPV) is plotted against sensitivity. Each dot represents a single test of each method. See tables below for raw data (individual counts for CentroidAlifold(20) and Mastr(20)).
Average Matthews Correlation Coefficients (MCC) with 95% confidence intervals (CIs) were plotted for different RNA families, for which at least 3 members were present in the benchmarking dataset. 'n' denotes the number of MCCs used to calculate the average and CI. See tables below for raw data (individual counts for CentroidAlifold(20) and Mastr(20)).
Comparison of average Matthews Correlation Coefficients (MCCs) for CentroidAlifold(20) and Mastr(20). The whiskers correspond to 95% confidence intervals (CIs). 'n' denotes the number of MCCs used to calculate average MCCs and CIs. See tables below for raw data (individual counts for CentroidAlifold(20) and Mastr(20)).

^top

Performance of CentroidAlifold(20) - scored higher in this pairwise comparison

1. Total counts & total scores for CentroidAlifold(20)

Total Base Pair Counts
Total TP	5090
Total TN	44601636
Total FP	2835
Total FP CONTRA	223
Total FP INCONS	1777
Total FP COMP	835
Total FN	8270

Total Scores
MCC	0.523
Average MCC ± 95% Confidence Intervals	0.523 ± 0.024
Sensitivity	0.381
Positive Predictive Value	0.718
Nr of predictions	27

^top

2. Individual counts for CentroidAlifold(20) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00298	SSU_rRNA_eukarya links to Rfam database...	0.52	0.37	0.72	183	1620647	90	6	64	20	311
CRW_00301	SSU_rRNA_eukarya links to Rfam database...	0.47	0.34	0.64	178	1762223	133	11	91	31	341
CRW_00306	SSU_rRNA_eukarya links to Rfam database...	0.52	0.37	0.73	171	1445616	97	6	57	34	291
CRW_00310	SSU_rRNA_eukarya links to Rfam database...	0.49	0.37	0.66	192	1805657	126	13	88	25	329
CRW_00326	SSU_rRNA_eukarya links to Rfam database...	0.57	0.40	0.80	201	1627859	78	6	44	28	301
CRW_00330	SSU_rRNA_eukarya links to Rfam database...	0.51	0.37	0.71	190	1988747	113	10	68	35	327
CRW_00332	SSU_rRNA_eukarya links to Rfam database...	0.48	0.34	0.67	161	1769781	123	8	71	44	316
CRW_00333	SSU_rRNA_eukarya links to Rfam database...	0.43	0.30	0.61	155	1892229	131	20	81	30	359
CRW_00345	SSU_rRNA_eukarya links to Rfam database...	0.51	0.36	0.72	181	1586621	96	8	61	27	317
CRW_00346	SSU_rRNA_eukarya links to Rfam database...	0.53	0.38	0.74	192	1584829	102	6	63	33	309
CRW_00348	SSU_rRNA_eukarya links to Rfam database...	0.54	0.40	0.72	200	1615226	107	10	67	30	303
CRW_00358	SSU_rRNA_eukarya links to Rfam database...	0.53	0.39	0.73	196	1675098	99	8	63	28	311
CRW_00366	SSU_rRNA_eukarya links to Rfam database...	0.52	0.37	0.71	180	1579501	100	8	64	28	302
CRW_00370	SSU_rRNA_eukarya links to Rfam database...	0.58	0.41	0.83	208	1640515	64	4	39	21	298
CRW_00371	SSU_rRNA_eukarya links to Rfam database...	0.55	0.40	0.75	199	1611646	93	8	57	28	297
CRW_00372	SSU_rRNA_eukarya links to Rfam database...	0.50	0.37	0.69	182	1626042	112	11	71	30	316
CRW_00379	SSU_rRNA_eukarya links to Rfam database...	0.49	0.33	0.72	176	2126710	109	5	62	42	358
CRW_00403	SSU_rRNA_eukarya links to Rfam database...	0.52	0.39	0.70	180	1606270	126	11	67	48	284
CRW_00411	SSU_rRNA_eukarya links to Rfam database...	0.51	0.38	0.68	189	1615224	117	8	82	27	307
CRW_00598	SSU_rRNA_eukarya links to Rfam database...	0.49	0.34	0.70	169	1665982	103	5	69	29	322
CRW_00758	SSU_rRNA_eukarya links to Rfam database...	0.52	0.38	0.72	184	1640510	108	6	66	36	299
CRW_00759	SSU_rRNA_eukarya links to Rfam database...	0.51	0.38	0.69	181	1636884	113	8	72	33	300
CRW_00760	SSU_rRNA_eukarya links to Rfam database...	0.52	0.37	0.74	180	1638713	102	7	55	40	306
CRW_00772	SSU_rRNA_bacteria links to Rfam database...	0.79	0.73	0.85	295	945652	81	5	48	28	109
CRW_01153	SSU_rRNA_eukarya links to Rfam database...	0.50	0.36	0.69	179	1606270	108	8	71	29	324
CRW_01171	SSU_rRNA_eukarya links to Rfam database...	0.49	0.36	0.67	183	1593733	116	11	78	27	323
CRW_01300	SSU_rRNA_eukarya links to Rfam database...	0.55	0.40	0.76	205	1693451	88	6	58	24	310

^top

Performance of Mastr(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Mastr(20)

Total Base Pair Counts
Total TP	0
Total TN	44608726
Total FP	0
Total FP CONTRA	0
Total FP INCONS	0
Total FP COMP	0
Total FN	13360

Total Scores
MCC	0.000
Average MCC ± 95% Confidence Intervals	0.000 ± 0.000
Sensitivity	0.000
Positive Predictive Value	0.000
Nr of predictions	27

^top

2. Individual counts for Mastr(20) [ download as .csv ]

RNA Chain	Rfam family	MCC	SENS	PPV	TP	TN	FP	FP CONTRA	FP INCONS	FP COMP	FN
CRW_00298	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1620900	0	0	0	0	494
CRW_00301	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1762503	0	0	0	0	519
CRW_00306	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1445850	0	0	0	0	462
CRW_00310	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1805950	0	0	0	0	521
CRW_00326	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1628110	0	0	0	0	502
CRW_00330	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1989015	0	0	0	0	517
CRW_00332	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1770021	0	0	0	0	477
CRW_00333	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1892485	0	0	0	0	514
CRW_00345	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1586871	0	0	0	0	498
CRW_00346	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1585090	0	0	0	0	501
CRW_00348	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1615503	0	0	0	0	503
CRW_00358	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1675365	0	0	0	0	507
CRW_00366	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1579753	0	0	0	0	482
CRW_00370	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1640766	0	0	0	0	506
CRW_00371	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1611910	0	0	0	0	496
CRW_00372	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1626306	0	0	0	0	498
CRW_00379	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	2126953	0	0	0	0	534
CRW_00403	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1606528	0	0	0	0	464
CRW_00411	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1615503	0	0	0	0	496
CRW_00598	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1666225	0	0	0	0	491
CRW_00758	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1640766	0	0	0	0	483
CRW_00759	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1637145	0	0	0	0	481
CRW_00760	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1638955	0	0	0	0	486
CRW_00772	SSU_rRNA_bacteria links to Rfam database...	0.00	0.00	0.00	0	946000	0	0	0	0	404
CRW_01153	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1606528	0	0	0	0	503
CRW_01171	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1594005	0	0	0	0	506
CRW_01300	SSU_rRNA_eukarya links to Rfam database...	0.00	0.00	0.00	0	1693720	0	0	0	0	515

^top

Matthews Correlation Coeffient, Sensitivity and Positive Predictive Value have been calculated based on the paper by Gardener & Giegerich, 2004.

Table of contents:

Overview

Performance plots

Performance of CentroidAlifold(20) - scored higher in this pairwise comparison

1. Total counts & total scores for CentroidAlifold(20)

2. Individual counts for CentroidAlifold(20) [ download as .csv ]

Performance of Mastr(20) - scored lower in this pairwise comparison

1. Total counts & total scores for Mastr(20)

2. Individual counts for Mastr(20) [ download as .csv ]