The project ADVANCe is coming to an end after 2 years of development with CM-Profiling and the IDIAP research institute.

Over the course of those 2 years, an innovative solution was developed to assists interviewers during job interviews. Based on machine learning algorithms, a complex data analysis platform has been developed from scratch to detect various visual and auditive cues during an interview. The goal is to assist the interviewer, for example to make the interview less stressful for the person being interviewed. The team at iCoSys was tasked to perform various parts of the project, from a dataset generation to the integration and optimisation of existing algorithms in a microservice based pipeline, as well as the development of new methods to analyse the video and audio of recorded interviews.

The final product is being launched by CM-Profiling under the name cryfe and will be presented at the CES 2021. A preview of the presented solution can be found in the following video: