Results of Automatic Panelist Detection Project with GfK (Video and Report, Winter 2021/22)

Symbolic picture for the article. The link opens the image in a large view.

This project is one of seven Scrum projects that were part of the winter 2021/22 AMOS Projects. Below please find the video (you may also like the other videos) and the project summary which details the final result of the project. We run these projects every semester, so please be in touch if you would like to motivate one of your own!

Project summary

Project teamAutomatic Panelist Detection
Project missionThe goal of this project is to create a cheap yet efficient device to optimize television audience measurement. This will be achieved by automatically detecting and recognizing panelists using pre-trained computer vision models and an RGB and infrared camera. All household panelists can be registered in a local database to facilitate the recognition process. Alongside gender and age, attentiveness and emotions will also be assessed. To account for user privacy, the gathered data is anonymized and sent to a GfK server. The device is not only non-intrusive but also time and power-efficient. It should also work under difficult lighting conditions.
Industry partnerGfK, Growth from Knowledge
Team logo
Project summary The outcome of this project is a software that can be uploaded on a (cheap) single-board computer to perform automatic television audience measurement efficiently.
Installed next to a TV, the device captures frames and can detect and recognize faces along with their respective gender, age, emotion, and attentiveness.
Using these components means that our software can recognize which panelists belong to the household and log their tv watching behavior for further analysis. The panelists can interact with the device through a graphical user interface to update their information. Furthermore, the device is non-intrusive, preserves privacy, and only sends the necessary data to the server (no photos or other personal information).
Project illustration
Team photo
Project repository