We use cookies to ensure you have the best possible experience. If you click accept, you agree to this use. For more information, please see our privacy policy.
/

Le Décodeur

Decoding consumer product packaging just got easier with a new app from Protégez-Vous
Woman in a grocery store using Le Décodeur app on a product label.

The context

With no regulatory body in Canada to review the safety of personal care product ingredients and a troubling-yet-persistent trend of “greenwashing” which misleads well-meaning shoppers into thinking that what they’re purchasing is sustainable, it’s no wonder consumers are looking for ways to get back in the driver’s seat. They’re becoming increasingly concerned with what they put on and in their bodies, as well as trying to better understand the social and ecological impacts of their buying choices. With this in mind, Osedea is proud to say that we’ve taken our partnership with Protégez-Vous, one of the country’s longest-standing advocates of consumer safety, to the next level, to help shoppers cut through the noise.

Since 1973, Protégez-Vous (French for “Protect Yourself”) has operated as a non-profit organization that performs rigorous tests, studies, and surveys on the tens of thousands of new products that are put on Quebec shelves annually. In 2020, we worked closely with them to create an AI-powered app that their team could use internally to help them maintain their database of cosmetic products. For the second half of the project, we were tasked with creating a consumer-facing app (called Le décodeur—in English, “The Decoder”) which would help people make more informed purchase decisions, just by snapping a few photos of a product’s packaging (ingredient label plus ecological logos). Read on to find out how we did it.

Project details

Industry
Health
Technologies
Azure
Computer Vision
React Native
Node.js
Python
SQL Server
Services
Development
Design

The challenge

Firstly, Le décodeur required in-app camera functionality to allow consumers to photograph ingredient labels. The words would be extracted from the image and compared against Protégez-Vous’ extensive database in order to display a summary of the product’s toxicity risk level. This information would be organized based on the type of exposure to the product (for example, if it were to be absorbed through the skin or swallowed) for different groups of people (for example, babies vs. pregnant people vs. adults). Beneath the summary, relevant articles would display to further assist the consumer.

Secondly, Le décodeur needed to bridge the gap between Protégez-Vous’ database of ecological logos that are commonly found on personal care products, and the consumers who want to understand if the trustworthiness implied by the logo is actually valid. For example, certain logos indicate that a brand is meeting rigorous standards, whereas others are merely greenwashing tactics. To convey this information to consumers, Le décodeur’s in-app camera captures an image of the ecological logo and, if a match is found, the consumer is then shown a summary displaying the logo’s meaning, scope, and reliability, and how it ranks in terms of trustability using a score of 1 to 5.

Woman washing her face with a washcloth.

Man reading a product label in a grocery store.

The task at hand

We leveraged our skills in computer vision technology and machine learning techniques to have Le décodeur identify text and logos and match them against the Protégez-Vous’ database with a high degree of accuracy. Behind the scenes, a lot goes into extracting information from a photo. Whereas text-recognition is relatively straightforward, logo recognition is trickier because factors such as the angle a photo is taken at, under which lighting conditions, the texture or curvature of the product packaging’s surface all must be considered. In order to train Le décodeur’s algorithm to recognize subtle nuances in an ecological logo with a high level of accuracy, approximately 100 photos of the same loo are required.

However, the biggest technical hurdle we overcame wasn’t image capture itself, but configuring the context. We worked to configure Le décodeur to recognize a good result, a false positive, or a bad result (requiring a new photo to be taken by the user). During the testing period, Le décodeur was achieving an accuracy rate of 55%. At launch, that had improved to a rate of 88% accuracy, demonstrating that the way we configured the app was done with precision. But results don’t stop there.

For any ecological logo that comes up as “no match,” the user will have an option to submit their photo to Le décodeur to further train the algorithm. In a similar vein, users may submit any ingredient that isn’t in the database to Protégez-Vous so that their lab techs may add it to their testing queue.

Woman in a grocery store using Le Décodeur app on a product label.
Description of the Canadian Organic Regime COR on a mobile phone.
Different screen shots on a mobile phone of Le Décodeur application.

The end result

Thanks to this great team effort that involved cross-functional collaboration with internal and external agencies, Le décodeur is now available to download for iOS and Android.  Protégez-Vous has big plans to empower consumers to be better informed when it comes to decoding consumer product packaging—something that will benefit the health of Quebec families and communities as a whole—through ingredient risk factor education and providing a sense of transparency around the ecological logos that brands employ.

What’s next

Protégez-Vous is very excited about the future uptake of Le décodeur built in collaboration with Osedea, especially because they’ve seen similar apps in Europe have huge success. Since completing our mandate, Le décodeur’s database of ecological logos has already grown beyond cosmetics and personal care products to include housekeeping products (with plans to expand very soon into food products, electronics, and household appliances). Also coming soon for Protégez-Vous is a marketing campaign, which will boost awareness about the app and how it can help Canadians make more informed buying decisions.

Le décodeur is an excellent testament to Protégez-Vous’ ability to innovate. They started over 50 years ago as a magazine, then were one of the first to move to a website, and then to a website subscription model. With over 100K subscribers today, the non-profit continues to think outside the box in order to reach new consumer demographics. It’s yet another cause that we at Osedea are proud to be involved in championing.

Woman in a grocery store using Le Décodeur app on a product label.

Insights

It starts with an idea
Culture

Osedea portraits: AI, adventure and culture with Isabelle Bouchard

Marie-Pier Houle
Marie-Pier Houle
read time
Development

A minimalist approach to DataOps and MLOps with DVC and CML

Nicholas Nadeau
Nicholas Nadeau
read time
Culture

How we run the show at OSEDEA (without any bosses)

Ivana Markovic
Ivana Markovic
read time
Development

Capitalizing on your organization’s data with vector databases

Carl Lapierre
Carl Lapierre
read time
Culture

Elevating engagement in hybrid workspaces

Ivana Markovic
Ivana Markovic
read time
News/Press

Introducing Osedea's equitable and inclusive parental program

Ivana Markovic
Ivana Markovic
read time

We’re on a constant quest to broaden our horizons and spread wisdom. It’s all about pushing boundaries and elevating our game.

Read more insights
Button Arrow