RESULTS.txt 1.36 KB
Newer Older
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56


AFP documents only (total 255 documents, 75% train, 10% dev, 15% test)

- BIO, with media list and secondary sources

Summary
	TP	FP	FN	Precision	Recall	F1
SOURCE-PRIM	167	15	68	0,9176	0,7106	0,8010
SOURCE-SEC	16	2	17	0,8889	0,4848	0,6275
Overall	183	17	85	0,9150	0,6828	0,7821

- BIO without media list and secondary sources

Summary
	TP	FP	FN	Precision	Recall	F1
SOURCE-PRIM	167	14	67	0,9227	0,7137	0,8048
SOURCE-SEC	0	0	33	0,0000	0,0000	0,0000
Overall	167	14	100	0,9227	0,6255	0,7455

- IO, with media list and secondary sources

Summary
	TP	FP	FN	Precision	Recall	F1
SOURCE-PRIM	174	16	60	0,9158	0,7436	0,8208
SOURCE-SEC	13	0	20	1,0000	0,3939	0,5652
Overall	187	16	80	0,9212	0,7004	0,7957


- IO, without media list and secondary sources

Summary
	TP	FP	FN	Precision	Recall	F1
SOURCE-PRIM	172	16	62	0,9149	0,7350	0,8152
SOURCE-SEC	0	0	33	0,0000	0,0000	0,0000
Overall	172	16	95	0,9149	0,6442	0,7560


AFP+Web documents (total 363 documents, 75% train, 10% dev, 15% test)

- BIO, with media list and secondary sources

Summary
	TP	FP	FN	Precision	Recall	F1
SOURCE-PRIM	256	28	68	0,9014	0,7901	0,8421
SOURCE-SEC	28	2	22	0,9333	0,5600	0,7000
Overall	284	30	90	0,9045	0,7594	0,8256


- BIO, without media list and secondary sources

Summary
	TP	FP	FN	Precision	Recall	F1
SOURCE-PRIM	256	28	68	0,9014	0,7901	0,8421
SOURCE-SEC	0	0	50	0,0000	0,0000	0,0000
Overall	256	28	118	0,9014	0,6845	0,7781