Ingredients Analysis Quality Evaluation - March 2020 - May 2020

In early March 2020, we made an evaluation of the quality of Ingredients Extraction and Analysis so that we could measure the improvements made as part of the Ingredients analysis and search features extraction task of the Project:Personalized_Search. The metrics have also been recorded in mid May 2020 in order to measure the impact of the improvements we made.

Ingredients parsing and recognition

For each product, the ingredients list is parsed to separate each ingredient. Ingredients that we can match to our multilingual ingredients taxonomy as marked as "known", others as "unknown".

There are different reasons an ingredient can be marked as unknown:

The input ingredient list is incorrect (misspellings etc.)
The ingredients list contains other things than ingredients and we have not been able to split it at the right place.
We have not been able to parse a particular sentence structure or formatting (e.g. "a drop of delicious honey with a shower of powder sugar")
The ingredient is not yet present in our taxonomy (or not with the right synonym or in the right language)

In the table below,

the first column of numbers corresponds to the number of unique ingredients across all products.
And the second column of number corresponds to the number of occurrences of those ingredients. e.g. if a specific ingredient appears in 5 products, it is counted 5 times.

EN - English - UK

2020-03-05

2020-05-14

2020-10-31

All products:

Type	Unique tags	Occurrences
known	1702 (8.77%)	104818 (79.85%)
unknown	17706 (91.23%)	26448 (20.15%)
all	19409 (100.00%)	131266 (100.00%)

Type	Unique tags	Occurrences
known	1787 (8.17%)	124626 (80.82%)
unknown	20099 (91.83%)	29578 (19.18%)
all	21886 (100.00%)	154204 (100.00%)

Type 	Unique tags 	Occurrences
known	2262 (14.84%)	197422 (92.27%)
unknown	12977 (85.16%)	16548 (7.73%)
all	15239 (100.00%)	213970 (100.00%)

Top 10k most scanned products:

known	1012 (20.67%)	19061 (79.38%)
unknown	3884 (79.31%)	4952 (20.62%)
all	4897 (100.00%)	24013 (100.00%)

known	1055 (22.09%)	21216 (81.93%)
unknown	3720 (77.91%)	4678 (18.07%)
all	4775 (100.00%)	25894 (100.00%)

known	1347 (44.87%)	28948 (93.92%)
unknown	1655 (55.13%)	1874 (6.08%)
all	3002 (100.00%)	30822 (100.00%)

EN - English - US

Note: ~300K US products were imported from the USDA in April, so results may not be very comparable.

2020-03-21

2020-05-14

2020-10-31

All products:

Type	Unique tags	Occurrences
known	2061 (2.12%)	2677857 (82.12%)
unknown	95216 (97.88%)	583085 (17.88%)
all	97278 (100.00%)	3260942 (100.00%)

Type	Unique tags	Occurrences
known	2218 (1.79%)	6457065 (84.67%)
unknown	122007 (98.21%)	1168962 (15.33%)
all	124225 (100.00%) 7626027 (100.00%)

Type 	Unique tags 	Occurrences
known	2787 (2.11%)	7435946 (90.52%)
unknown	129044 (97.89%)	778751 (9.48%)
all	131831 (100.00%) 8214697 (100.00%)

Top 10k most scanned products:

known	983 (18.16%)	25484 (77.58%)
unknown	4430 (81.82%)	7364 (22.42%)
all	5414 (100.00%)	32848 (100.00%)

known	1055 (20.52%)	38068 (82.02%)
unknown	4086 (79.48%)	8347 (17.98%)
all	5141 (100.00%)	46415 (100.00%)

known	1275 (24.46%)	43918 (87.18%)
unknown	3938 (75.54%)	6456 (12.82%)
all	5213 (100.00%)	50374 (100.00%)

DE - German - Germany

2020-03-05

2020-05-14

2020-10-31

All products:

Type	Unique tags	Occurrences
known	2139 (5.36%)	363967 (84.75%)
unknown	37790 (94.64%)	65503 (15.25%)
all	39930 (100.00%)	429470 (100.00%)

Type	Unique tags	Occurrences
known	2233 (5.62%)	417604 (86.72%)
unknown	37522 (94.38%)	63935 (13.28%)
all	39755 (100.00%)	481539 (100.00%)

Type 	Unique tags 	Occurrences
known	2491 (5.97%)	518324 (89.03%)
unknown	39239 (94.03%)	63880 (10.97%)
all	41730 (100.00%)	582204 (100.00%)

Top 10k most scanned products:

known	1435 (14.73%)	69066 (85.53%)
unknown	8309 (85.26%)	11689 (14.47%)
all	9745 (100.00%)	80755 (100.00%)

known	1511 (16.88%)	75653 (88.13%)
unknown	7439 (83.12%)	10187 (11.87%)
all	8950 (100.00%)	85840 (100.00%)

known	1624 (19.65%)	85314 (90.61%)
unknown	6640 (80.35%)	8845 (9.39%)
all	8264 (100.00%)	94159 (100.00%)

ES - Spanish - Spain

2020-03-05

2020-05-14

2020-10-31

All products:

Type	Unique tags	Occurrences
known	1970 (4.25%)	176101 (71.95%)
unknown	44352 (95.75%)	68659 (28.05%)
all	46323 (100.00%)	244760 (100.00%)

Type	Unique tags	Occurrences
known	2059 (4.29%)	230207 (76.47%)
unknown	45977 (95.71%)	70846 (23.53%)
all	48036 (100.00%)	301053 (100.00%)

Type 	Unique tags 	Occurrences
known	2494 (9.14%)	314030 (90.21%)
unknown	24786 (90.86%)	34086 (9.79%)
all	27280 (100.00%)	348116 (100.00%)

Top 10k most scanned products:

known	1262 (10.47%)	48797 (75.99%)
unknown	10793 (89.52%)	15417 (24.01%)
all	12056 (100.00%)	64214 (100.00%)

known	1354 (12.19%)	55402 (80.84%)
unknown	9751 (87.81%)	13134 (19.16%)
all	11105 (100.00%)	68536 (100.00%)

known	1609 (25.94%)	72353 (92.96%)
unknown	4593 (74.06%)	5478 (7.04%)
all	6202 (100.00%)	77831 (100.00%)

FI - Finnish - FI

2020-03-05

2020-05-14

2020-10-31

All products:

Type	Unique tags	Occurrences
known	829 (43.96%)	11069 (89.15%)
unknown	1056 (55.99%)	1347 (10.85%)
all	1886 (100.00%)	12416 (100.00%)

Type	Unique tags	Occurrences
known	910 (45.09%)	15650 (91.43%)
unknown	1108 (54.91%)	1466 (8.57%)
all	2018 (100.00%)	17116 (100.00%)

Type 	Unique tags 	Occurrences
known	1285 (56.56%)	25597 (95.22%)
unknown	987 (43.44%)	1284 (4.78%)
all	2272 (100.00%)	26881 (100.00%)

Top 10k most scanned products:

known	566 (61.66%)	3465 (89.07%)
unknown	351 (38.24%)	425 (10.93%)
all	918 (100.00%)	3890 (100.00%)

known	581 (67.40%)	3694 (91.96%)
unknown	281 (32.60%)	323 (8.04%)
all	862 (100.00%)	4017 (100.00%)

known	704 (85.02%)	4276 (96.79%)
unknown	124 (14.98%)	142 (3.21%)
all	828 (100.00%)	4418 (100.00%)

FR - French - France

2020-03-05

2020-05-14

2020-10-31

All products:

Type	Unique tags	Occurrences
known	3825 (0.85%)	3708820 (83.40%)
unknown	446838 (99.15%)	738291 (16.60%)
all	450664 (100.00%) 4447111 (100.00%)

Type	Unique tags	Occurrences
known	3793 (0.92%)	3832574 (85.55%)
unknown	406901 (99.08%)	647239 (14.45%)
all	410694 (100.00%) 4479813 (100.00%)

Type 	Unique tags 	Occurrences
known	4149 (1.08%)	4134163 (87.27%)
unknown	380115 (98.92%)	603291 (12.73%)
all	384264 (100.00%) 4737454 (100.00%)

Top 10k most scanned products:

known	2208 (22.34%)	184218 (94.52%)
unknown	7673 (77.65%)	10686 (5.48%)
all	9882 (100.00%)	194904 (100.00%)

known	2260 (24.29%)	186642 (95.08%)
unknown	7044 (75.71%)	9655 (4.92%)
all	9304 (100.00%)	196297 (100.00%)

known	2360 (26.98%)	193659 (95.71%)
unknown	6387 (73.02%)	8684 (4.29%)
all	8747 (100.00%)	202343 (100.00%)

IT - Italian - Italy

2020-03-05

2020-05-14

2020-10-31

All products:

Type	Unique tags	Occurrences
known	1319 (9.43%)	53345 (74.58%)
unknown	12669 (90.56%)	18186 (25.42%)
all	13989 (100.00%)	71531 (100.00%)

Type	Unique tags	Occurrences
known	1418 (9.21%)	67900 (78.54%)
unknown	13976 (90.79%)	18557 (21.46%)
all	15394 (100.00%)	86457 (100.00%)

Type 	Unique tags 	Occurrences
known	1568 (8.56%)	86863 (78.75%)
unknown	16751 (91.44%)	23446 (21.25%)
all	18319 (100.00%)	110309 (100.00%)

Top 10k most scanned products:

known	911 (13.11%)	20838 (72.21%)
unknown	6039 (86.88%)	8018 (27.79%)
all	6951 (100.00%)	28856 (100.00%)

known	964 (14.90%)	24072 (78.11%)
unknown	5507 (85.10%)	6747 (21.89%)
all	6471 (100.00%)	30819 (100.00%)

known	1024 (15.27%)	27083 (78.92%)
unknown	5683 (84.73%)	7233 (21.08%)
all	6707 (100.00%)	34316 (100.00%)

NL - Dutch - The Netherlands

2020-03-05

2020-05-14

2020-10-31

All products:

Type	Unique tags	Occurrences
known	1304 (17.03%)	31491 (78.84%)
unknown	6353 (82.96%)	8453 (21.16%)
all	7658 (100.00%)	39944 (100.00%)

Type	Unique tags	Occurrences
known	1391 (17.72%)	36019 (80.81%)
unknown	6461 (82.28%)	8555 (19.19%)
all	7852 (100.00%)	44574 (100.00%)

Type 	Unique tags 	Occurrences
known	1543 (20.16%)	48344 (87.35%)
unknown	6112 (79.84%)	7004 (12.65%)
all	7655 (100.00%)	55348 (100.00%)

Top 10k most scanned products:

known	755 (24.25%)	8069 (73.71%)
unknown	2358 (75.72%)	2878 (26.29%)
all	3114 (100.00%)	10947 (100.00%)

known	797 (29.00%)	9104 (79.28%)
unknown	1951 (71.00%)	2379 (20.72%)
all	2748 (100.00%)	11483 (100.00%)

known	883 (39.42%)	11319 (88.77%)
unknown	1357 (60.58%)	1432 (11.23%)
all	2240 (100.00%)	12751 (100.00%)

PT - Portuguese - Portugal

2020-03-05

2020-05-14

2020-10-31

All products:

Type	Unique tags	Occurrences
known	918 (16.05%)	15816 (70.50%)
unknown	4800 (83.93%)	6617 (29.50%)
all	5719 (100.00%)	22433 (100.00%)

Type	Unique tags	Occurrences
known	948 (16.10%)	17005 (71.53%)
unknown	4940 (83.90%)	6769 (28.47%)
all	5888 (100.00%)	23774 (100.00%)

Type 	Unique tags 	Occurrences
known	1081 (16.84%)	21149 (75.32%)
unknown	5337 (83.16%)	6931 (24.68%)
all	6418 (100.00%)	28080 (100.00%)

Top 10k most scanned products:

known	578 (19.37%)	6261 (68.40%)
unknown	2405 (80.60%)	2892 (31.60%)
all	2984 (100.00%)	9153 (100.00%)

known	602 (20.40%)	6608 (70.43%)
unknown	2349 (79.60%)	2775 (29.57%)
all	2951 (100.00%)	9383 (100.00%)

known	652 (23.15%)	7858 (76.02%)
unknown	2164 (76.85%)	2479 (23.98%)
all	2816 (100.00%)	10337 (100.00%)

RU - Russian - Russia

	2021-03-01
All products:	Type Unique tags Occurrences known 643 (11.92%) 8975 (50.23%) unknown 4751 (88.08%) 8893 (49.77%) all 5394 (100.00%) 17868 (100.00%)

Ingredients analysis

For each product, once we have parsed the ingredients list to separate each ingredient and match them to our taxonomy, we can analyze if the products are vegan, vegetarian, without palm oil etc.

To mark a product as non-vegan etc. we only need to find one non-vegan ingredient. But to mark a product as vegan, we need to be sure that we have been able to correctly recognize all ingredients so that we can verify that all of them are vegan.

EN - English - UK

2020-03-05

2020-05-14

2020-10-31

All products:

Vegetarian status unknown	4814	
Palm oil content unknown	4138	
Vegan status unknown	3281	
Non-vegan	2525	
Palm oil free	1286	
Vegetarian	903	
Palm oil	875	
Vegan	725	
Non-vegetarian	719	
May contain palm oil	314	
Maybe vegetarian	177	
Maybe vegan	82

Vegetarian status unknown	4533	
Palm oil content unknown	4513	
Vegan status unknown	3251	
Non-vegan	2919	
Vegetarian	2785	
Vegan	2043	
Palm oil free	1587	
Palm oil	1049	
Non-vegetarian	853	
May contain palm oil	380	
Maybe vegetarian	214	
Maybe vegan	102

Vegetarian status unknown 	4325	
Vegetarian 	4185	
Palm oil content unknown 	4169	
Non-vegan 	4101	
Palm oil free 	3381	
Vegan status unknown 	2980	
Vegan 	2932	
Palm oil 	1528	
Non-vegetarian 	1356	
Maybe vegetarian 	610	
May contain palm oil 	506	
Maybe vegan 	373

Top 10k most scanned products:

Vegetarian status unknown	1016	
Palm oil content unknown	817	
Vegan status unknown	711	
Non-vegan	439	
Palm oil free	222	
Palm oil	192	
Vegetarian	171	
Vegan	139	
Non-vegetarian	81	
May contain palm oil	73	
Maybe vegetarian	36	
Maybe vegan	15

Vegetarian status unknown	835	
Palm oil content unknown	816	
Vegan status unknown	616	
Non-vegan	485	
Vegetarian	470	
Vegan	314	
Palm oil free	264	
Palm oil	219	
Non-vegetarian	92	
May contain palm oil	80	
Maybe vegetarian	45	
Maybe vegan	18

Vegetarian 	710	
Vegetarian status unknown 	659	
Palm oil content unknown 	604	
Non-vegan 	588	
Palm oil free 	555	
Vegan status unknown 	475	
Vegan 	467	
Palm oil 	295	
Non-vegetarian 	119	
Maybe vegetarian 	110	
May contain palm oil 	80	
Maybe vegan 	56

EN - English - US

2020-03-05

2020-05-14

2020-10-31

All products:

not recorded

Vegetarian status unknown 	209636	
Palm oil content unknown 	185965	
Non-vegan 	141735	
Vegan status unknown 	123259	
Palm oil free 	75096	
Vegetarian 	46799	
Non-vegetarian 	43169	
Vegan 	41570	
Palm oil 	37077	
May contain palm oil 	21246	
Maybe vegetarian 	19977	
Maybe vegan 	13015

Top 10k most scanned products:

not recorded

Vegetarian status unknown 	1467	
Palm oil content unknown 	1285	
Vegan status unknown 	973	
Non-vegan 	746	
Palm oil free 	511	
Vegetarian 	424	
Vegan 	366	
Palm oil 	218	
Non-vegetarian 	154	
May contain palm oil 	130	
Maybe vegetarian 	109	
Maybe vegan 	69

DE - German - Germany

2020-03-05

2020-05-14

2020-10-31

All products:

Vegetarian status unknown	15605	
Palm oil content unknown	14599	
Vegan status unknown	10377	
Non-vegan	10151	
Palm oil free	6199	
Vegetarian	4394	
Vegan	3367	
Non-vegetarian	2805	
Palm oil	2357	
Maybe vegetarian	1486	
May contain palm oil	1135	
Maybe vegan	395

Palm oil content unknown	15370	
Vegetarian status unknown	14019	
Non-vegan	11373	
Vegetarian	9087	
Vegan status unknown	8791	
Palm oil free	7765	
Vegan	7377	
Non-vegetarian	3225	
Palm oil	2592	
Maybe vegetarian	1731	
May contain palm oil	1365	
Maybe vegan	462

Palm oil content unknown 	16918	
Vegetarian status unknown 	15208	
Non-vegan 	13551	
Vegetarian 	11130	
Palm oil free 	10254	
Vegan status unknown 	9270	
Vegan 	8894	
Non-vegetarian 	3990	
Palm oil 	2527	
Maybe vegetarian 	2238	
May contain palm oil 	1796	
Maybe vegan 	767

Top 10k most scanned products:

Vegetarian status unknown	2925	
Palm oil content unknown	2449	
Non-vegan	1903	
Vegan status unknown	1874	
Palm oil free	1255	
Vegetarian	849	
Vegan	634	
Palm oil	567	
Maybe vegetarian	381	
Non-vegetarian	362	
May contain palm oil	246	
Maybe vegan	106

Palm oil content unknown	2386	
Vegetarian status unknown	2384	
Non-vegan	2030	
Vegetarian	1626	
Palm oil free	1471	
Vegan status unknown	1419	
Vegan	1249	
Palm oil	600	
Maybe vegetarian	420	
Non-vegetarian	397	
May contain palm oil	279	
Maybe vegan	118

Palm oil content unknown 	2376	
Vegetarian status unknown 	2307	
Non-vegan 	2207	
Vegetarian 	1844	
Palm oil free 	1753	
Vegan 	1384	
Vegan status unknown 	1316	
Palm oil 	535	
Maybe vegetarian 	498	
Non-vegetarian 	441	
May contain palm oil 	343	
Maybe vegan 	172

ES - Spanish - Spain

2020-03-05

2020-05-14

2020-10-31

All products:

Vegetarian status unknown	12076	
Palm oil content unknown	11192	
Vegan status unknown	9812	
Non-vegan	3877	
Palm oil free	2707	
Vegetarian	1906	
Vegan	1689	
Non-vegetarian	1145	
May contain palm oil	978	
Palm oil	809	
Maybe vegetarian	559	
Maybe vegan	308

Palm oil content unknown	12221	
Vegetarian status unknown	10298	
Vegetarian	8136	
Vegan	7605	
Vegan status unknown	7515	
Non-vegan	5481	
Palm oil free	4988	
Non-vegetarian	1805	
May contain palm oil	1171	
Palm oil	1022	
Maybe vegetarian	664	
Maybe vegan	286

Vegetarian 	9956	
Palm oil content unknown 	9683	
Vegan 	8995	
Vegetarian status unknown 	8902	
Palm oil free 	8777	
Non-vegan 	7191	
Vegan status unknown 	5816	
Non-vegetarian 	2356	
Maybe vegetarian 	1584	
May contain palm oil 	1446	
Palm oil 	1353	
Maybe vegan 	765

Top 10k most scanned products:

Vegetarian status unknown	2733	
Palm oil content unknown	2387	
Vegan status unknown	2081	
Non-vegan	1105	
Palm oil free	733	
Vegetarian	484	
Vegan	394	
May contain palm oil	308	
Non-vegetarian	272	
Palm oil	267	
Maybe vegetarian	206	
Maybe vegan	115

Palm oil content unknown	2235	
Vegetarian status unknown	2216	
Vegan status unknown	1540	
Non-vegan	1316	
Vegetarian	1096	
Palm oil free	997	
Vegan	925	
Non-vegetarian	362	
May contain palm oil	328	
Palm oil	286	
Maybe vegetarian	209	
Maybe vegan	100

Vegetarian status unknown 	1776	
Palm oil free 	1704	
Palm oil content unknown 	1661	
Non-vegan 	1658	
Vegetarian 	1460	
Vegan 	1186	
Vegan status unknown 	1071	
Maybe vegetarian 	454	
Non-vegetarian 	453	
May contain palm oil 	378	
Palm oil 	365	
Maybe vegan 	225

FI - Finnish - FI

2020-03-05

2020-05-14

2020-10-31

All products:

Vegetarian status unknown	375	
Palm oil content unknown	312	
Non-vegan	278	
Vegan status unknown	245	
Palm oil free	191	
Maybe vegetarian	94	
Non-vegetarian	91	
Palm oil	85	
Vegetarian	83	
Vegan	76	
May contain palm oil	55	
Maybe vegan	44

Vegetarian status unknown	433	
Palm oil content unknown	396	
Non-vegan	364	
Vegan status unknown	283	
Palm oil free	256	
Vegetarian	178	
Vegan	153	
Non-vegetarian	128	
Maybe vegetarian	115	
Palm oil	112	
May contain palm oil	78	
Maybe vegan	52

Non-vegan 	559	
Vegetarian status unknown 	481	
Palm oil free 	450	
Palm oil content unknown 	431	
Vegan status unknown 	293	
Vegetarian 	287	
Vegan 	236	
Non-vegetarian 	212	
Maybe vegetarian 	202	
Palm oil 	161	
May contain palm oil 	123	
Maybe vegan 	92

Top 10k most scanned products:

Vegetarian status unknown	101	
Palm oil content unknown	93	
Non-vegan	77	
Vegan status unknown	70	
Palm oil free	59	
Non-vegetarian	31	
Vegetarian	27	
Maybe vegetarian	25	
Vegan	24	
Palm oil	19	
Maybe vegan	13	
May contain palm oil	13

Vegetarian status unknown	88	
Palm oil content unknown	86	
Non-vegan	79	
Palm oil free	72	
Vegan status unknown	58	
Vegetarian	46	
Vegan	41	
Non-vegetarian	31	
Maybe vegetarian	28	
Palm oil	22	
Maybe vegan	15	
May contain palm oil	13

Palm oil free 	92	
Non-vegan 	89	
Vegetarian status unknown 	68	
Palm oil content unknown 	66	
Vegetarian 	52	
Vegan 	46	
Vegan status unknown 	39	
Maybe vegetarian 	38	
Non-vegetarian 	38	
Palm oil 	24	
Maybe vegan 	22	
May contain palm oil 	14

FR - French - France

2020-03-05

2020-05-14

2020-10-31

All products:

Palm oil content unknown	128788	
Vegetarian status unknown	127223	
Non-vegan	105765	
Vegan status unknown	82754	
Palm oil free	66322	
Non-vegetarian	42135	
Vegetarian	36283	
Vegan	27356	
Maybe vegetarian	16327	
Palm oil	14315	
May contain palm oil	12543	
Maybe vegan	6093

Palm oil content unknown	120790	
Vegetarian status unknown	118197	
Non-vegan	107363	
Palm oil free	77233	
Vegan status unknown	75502	
Vegetarian	50863	
Non-vegetarian	42829	
Vegan	39716	
Maybe vegetarian	17543	
Palm oil	14895	
May contain palm oil	12870	
Maybe vegan	6712

Palm oil content unknown 	119907	
Vegetarian status unknown 	116121	
Non-vegan 	111887	
Palm oil free 	84303	
Vegan status unknown 	73777	
Vegetarian 	56159	
Non-vegetarian 	44779	
Vegan 	42890	
Maybe vegetarian 	20006	
Palm oil 	15542	
May contain palm oil 	13680	
Maybe vegan 	8310

Top 10k most scanned products:

Non-vegan	4629	
Vegetarian status unknown	4489	
Palm oil free	4277	
Palm oil content unknown	3643	
Vegan status unknown	2542	
Vegetarian	2420	
Vegan	1723	
Maybe vegetarian	1460	
Non-vegetarian	1089	
Palm oil	897	
May contain palm oil	641	
Maybe vegan	564

Palm oil free	4895	
Non-vegan	4607	
Vegetarian status unknown	4029	
Palm oil content unknown	3089	
Vegetarian	2827	
Vegan status unknown	2302	
Vegan	1944	
Maybe vegetarian	1523	
Non-vegetarian	1082	
Palm oil	889	
Maybe vegan	605	
May contain palm oil	594

Palm oil free 	5116	
Non-vegan 	4656	
Vegetarian status unknown 	3743	
Vegetarian 	3105	
Palm oil content unknown 	2928	
Vegan 	2107	
Vegan status unknown 	2090	
Maybe vegetarian 	1571	
Non-vegetarian 	1090	
Palm oil 	885	
Maybe vegan 	653	
May contain palm oil 	585

IT - Italian - Italy

2020-03-05

2020-05-14

2020-10-31

All products:

Vegetarian status unknown	3226	
Palm oil content unknown	2965	
Vegan status unknown	2229	
Non-vegan	1492	
Palm oil free	748	
Vegetarian	507	
Vegan	412	
Non-vegetarian	295	
Palm oil	279	
May contain palm oil	208	
Maybe vegetarian	172	
Maybe vegan	67

Vegetarian status unknown	3357	
Palm oil content unknown	3055	
Vegan status unknown	2267	
Non-vegan	1820	
Palm oil free	1498	
Vegetarian	951	
Vegan	770	
Non-vegetarian	382	
Palm oil	316	
Maybe vegetarian	272	
May contain palm oil	252	
Maybe vegan	102

Vegetarian status unknown 	4057	
Palm oil content unknown 	3739	
Vegan status unknown 	2740	
Non-vegan 	2262	
Palm oil free 	1832	
Vegetarian 	1181	
Vegan 	944	
Non-vegetarian 	514	
Palm oil 	364	
Maybe vegetarian 	343	
May contain palm oil 	321	
Maybe vegan 	147

Top 10k most scanned products:

Vegetarian status unknown	1320	
Palm oil content unknown	1206	
Vegan status unknown	932	
Non-vegan	578	
Palm oil free	290	
Vegetarian	205	
Vegan	159	
Palm oil	118	
Non-vegetarian	107	
May contain palm oil	81	
Maybe vegetarian	63	
Maybe vegan	26

Vegetarian status unknown	1230	
Palm oil content unknown	1063	
Vegan status unknown	839	
Non-vegan	637	
Palm oil free	572	
Vegetarian	343	
Vegan	268	
Palm oil	123	
Non-vegetarian	120	
Maybe vegetarian	91	
May contain palm oil	89	
Maybe vegan	37

Vegetarian status unknown 	1288	
Palm oil content unknown 	1127	
Vegan status unknown 	875	
Non-vegan 	702	
Palm oil free 	646	
Vegetarian 	389	
Vegan 	302	
Non-vegetarian 	141	
Palm oil 	133	
Maybe vegetarian 	115	
May contain palm oil 	95	
Maybe vegan 	52

NL - Dutch - The Netherlands

2020-03-05

2020-05-14

2020-10-31

All products:

Vegetarian status unknown	1663	
Palm oil content unknown	1442	
Vegan status unknown	1202	
Non-vegan	729	
Palm oil free	504	
Vegetarian	382	
Vegan	322	
Palm oil	229	
Non-vegetarian	161	
May contain palm oil	119	
Maybe vegetarian	88	
Maybe vegan	41

Palm oil content unknown	1506	
Vegetarian status unknown	1477	
Vegetarian	1066	
Vegan status unknown	1027	
Vegan	921	
Non-vegan	826	
Palm oil free	634	
Palm oil	251	
Non-vegetarian	187	
May contain palm oil	129	
Maybe vegetarian	91	
Maybe vegan	44

Palm oil content unknown 	1540	
Vegetarian status unknown 	1527	
Vegetarian 	1290	
Vegan 	1090	
Vegan status unknown 	1068	
Non-vegan 	1022	
Palm oil free 	906	
Palm oil 	321	
Non-vegetarian 	248	
Maybe vegetarian 	194	
May contain palm oil 	193	
Maybe vegan 	76

Top 10k most scanned products:

Vegetarian status unknown	447	
Palm oil content unknown	364	
Vegan status unknown	319	
Non-vegan	189	
Palm oil free	113	
Vegetarian	79	
Vegan	67	
Palm oil	66	
May contain palm oil	42	
Non-vegetarian	36	
Maybe vegetarian	23	
Maybe vegan	10

Vegetarian status unknown	402	
Palm oil content unknown	366	
Vegan status unknown	274	
Non-vegan	209	
Vegetarian	160	
Palm oil free	139	
Vegan	133	
Palm oil	70	
Non-vegetarian	41	
May contain palm oil	39	
Maybe vegetarian	26	
Maybe vegan	11

Vegetarian status unknown 	338	
Palm oil content unknown 	304	
Non-vegan 	237	
Vegetarian 	230	
Vegan status unknown 	227	
Palm oil free 	219	
Vegan 	192	
Palm oil 	88	
Maybe vegetarian 	68	
May contain palm oil 	53	
Non-vegetarian 	43	
Maybe vegan 	21

PT - Portuguese - Portugal

2020-03-05

2020-05-14

2020-10-31

All products:

Vegetarian status unknown	1072	
Palm oil content unknown	914	
Vegan status unknown	768	
Non-vegan	454	
Palm oil free	187	
May contain palm oil	140	
Vegetarian	126	
Palm oil	105	
Vegan	104	
Non-vegetarian	97	
Maybe vegetarian	51	
Maybe vegan	20

Vegetarian status unknown	1000	
Palm oil content unknown	909	
Vegan status unknown	700	
Non-vegan	478	
Vegetarian	265	
Palm oil free	245	
Vegan	228	
May contain palm oil	138	
Palm oil	112	
Non-vegetarian	108	
Maybe vegetarian	56	
Maybe vegan	23

Vegetarian status unknown 	1036	
Palm oil content unknown 	922	
Vegan status unknown 	726	
Non-vegan 	549	
Vegetarian 	347	
Palm oil free 	333	
Vegan 	287	
May contain palm oil 	159	
Palm oil 	151	
Non-vegetarian 	128	
Maybe vegetarian 	90	
Maybe vegan 	39

Top 10k most scanned products:

Vegetarian status unknown	453	
Palm oil content unknown	375	
Vegan status unknown	328	
Non-vegan	171	
Palm oil free	70	
May contain palm oil	53	
Vegetarian	48	
Palm oil	45	
Vegan	36	
Non-vegetarian	22	
Maybe vegetarian	20	
Maybe vegan	8

Vegetarian status unknown	411	
Palm oil content unknown	357	
Vegan status unknown	288	
Non-vegan	177	
Vegetarian	104	
Palm oil free	95	
Vegan	85	
May contain palm oil	49	
Palm oil	48	
Maybe vegetarian	24	
Non-vegetarian	22	
Maybe vegan	11

Vegetarian status unknown 	393	
Palm oil content unknown 	333	
Vegan status unknown 	272	
Non-vegan 	190	
Vegetarian 	135	
Palm oil free 	125	
Vegan 	107	
Palm oil 	63	
May contain palm oil 	53	
Maybe vegetarian 	35	
Non-vegetarian 	23	
Maybe vegan 	17

RU - Russian - Russia

2021-03-01

All products:

Ingredients analysis	Products	*
Vegetarian status unknown	1164	
Palm oil content unknown	1087	
Vegan status unknown	952	
Non-vegan	304	
Palm oil free	103	
May contain palm oil	94	
Vegetarian	90	
Vegan	82	
Non-vegetarian	78	
Palm oil	53	
Maybe vegetarian	11	
Maybe vegan	5

Evolution of the metrics between early March 2020 and mid May 2020

Comparison of key metrics

The comparison table contains the metrics for all products of a country.

Metrics:

Ingredients parsing and recognition: % of known ingredients for all ingredients occurrences.
Ingredients analysis: known vegetarian status
- = 1 - "Vegetarian status unknown" / ("Vegetarian status unknown" + "Vegetarian" + "Non vegetarian" + "Maybe vegetarian")

	% known ingredients			% known vegetarian status
Country	March 2020	May 2020	Oct 2020	March 2020	May 2020	Oct 2020
UK	79.75%	80.82%	92.27%	27.20%	45.94%	58.72%
US	82.12%	84.67%	90.52%	not recorded	not recorded	34.40%
DE	84.75%	86.72%	89.03%	35.76%	50.04%	53.30%
ES	71.95%	76.47%	90.21%	23.01%	50.73%	60.95%
FI	89.15%	91.43%	95.22%	41.68%	49.30%	59.31%
FR	83.40%	85.55%	87.27%	42.68%	48.47%	51.02%
IT	74.58%	78.54%	78.75%	23.19%	32.35%	33.44%
NL	78.84%	80.81%	87.35%	27.51%	47.64%	53.15%
PT	70.50%	71.53%	75.32%	20.36%	26.74%	35.29%

Observations

Significant progress has been made on all tested countries.

For ingredients parsing and recognition, it becomes harder and harder to get big increases in the % of known ingredients. It is expected as we have focused first on the improvements that had the biggest impact. But even a "small" increase from 83.40% to 85.55% for known ingredients in France corresponds to a drop of the unknown ingredients from 16.60% to 14.65% which is a 11.7% relative drop.

It is very interesting to see that the improvements in ingredients parsing and recognition translate in much more significant ingredients analysis (knowing the vegetarian status of a product) improvements. All countries had a 5% to 25% absolute increase of products with known vegetarian status.