Multimodal Platform for Pain Monitoring in Physiotherapy

BMBF Funded Project PainMonit

Our Approach

The core objective of the pain monitoring tool is to support therapists in selecting therapeutic exercises at an appropriate intensity level to ensure optimal treatment progress. Pain perception plays a critical role in a wide range of medical applications. In physiotherapy, for example, pain – particularly the individual pain threshold – not only influences the outcome of treatment but also fundamentally determines the structure and progression of therapeutic exercises from the outset.

Traditionally, pain is assessed through self-report questionnaires. While effective in many cases, this method is unsuitable for patients who are unable to communicate their pain reliably or at all. To address this limitation, alternative approaches are being explored that enable the evaluation of pain through physiological and audiovisual indicators. These include parameters such as facial expressions, vocal signals, and biosignals (e.g., heart rate variability or skin conductance), offering a more objective and continuous assessment of the patient’s pain experience.

Experimental setup: Exmanier’s point of view

About the Project

PainMonit aims to develop a sensor-based tool for the comprehensive and objective monitoring of pain. Pain-related data are captured through two central modules and processed via an integrated analysis platform.

The first module focuses on behavioral pain measurement by developing a system that records and analyzes movement behavior using wearable sensors. This module enables the specification of pain-related motor patterns during physiotherapeutic activities.

The second module centers on video-based pain assessment and involves the creation of an automated camera system for real-time pain recognition. It captures facial micro-expressions and head movement indicators to detect signs of discomfort or pain during the performance of therapeutic exercises.

By integrating data from both modules, PainMonit aims to provide a multimodal, non-invasive monitoring solution that supports personalized therapy planning and enhances treatment precision – particularly for patients who have difficulty verbalizing their pain experience.

Overview Heat Stimuli – Exemplary Temperature Curve with Alternating Stimuli and Pauses

Work Packages, Insights and Outcomes

Within the PainMonit project, IXP is responsible for developing a software module that monitors pain based on facial expression– and head movement–related indicators. To support the training of machine learning and deep learning models, a dedicated video database with annotated pain states will be created as a foundational resource.

In addition to the technical development, IXP oversees the assessment of both user and system requirements for the software module. It also ensures the integration of ELSI (Ethical, Legal, and Social Implications) design principles throughout the development process.

Furthermore, IXP leads the final system evaluation of the multimodal PainMonit demonstrator. This includes verifying the system’s reliability, usability, user acceptance, and classification accuracy in real-world therapeutic settings, with the overarching goal of delivering a robust, ethically grounded, and user-centered pain monitoring solution.

Exemplary course of facial expressions during the different pain states

Face and Facial Landmarks Detection. Regions of Interest: Eye Detection (Eye Closing), Mouth Points (Distances) and Nasolabial Folds

Successful Projects