Graph Neural Networks for Modelling Emotion Regulation Pathways from Multimodal Wearable Signals ()
1. Introduction
Emotion regulation (ER), the capacity to monitor, evaluate, and modify emotional responses in order to achieve adaptive goals, is a fundamental mechanism supporting psychological well-being [1]-[6]. Disruptions in ER are implicated in a wide range of psychiatric and neurological conditions, including major depressive disorder, anxiety disorders, post-traumatic stress disorder, and bipolar spectrum disorders [7]-[16]. From a physiological perspective, ER does not arise from a single biological process; rather, it reflects the coordinated activity of multiple interacting subsystems encompassing autonomic, cardiovascular, electrodermal, thermoregulatory, and motor control processes [17]-[22].
Recent advances in wearable sensing technology now allow these subsystems to be observed continuously and non-invasively. Signals such as electrocardiography (ECG), electrodermal activity (EDA), photoplethysmography (PPG), body accelerometer (ACC), and peripheral skin temperature (TEMP) provide complementary information about autonomic balance, cardiovascular function, sympathetic arousal, behavioural activation, and metabolic regulation [23]-[33]. Together, these signals offer an unprecedented opportunity to characterize emotion regulation as a distributed physiological process unfolding in real time. However, despite the multimodal richness of wearable data, most existing computational models treat each modality either independently or as part of a flat concatenated feature vector. Such representations fail to explicitly encode the structured interdependencies among physiological systems that are central to effective emotion regulation.
In contrast, emotion regulation is inherently network-based: successful regulation is marked by patterns such as parasympathetic rebound in cardiac dynamics, concurrent suppression of electrodermal arousal, stabilization of motor activity, and gradual normalization of thermal responses [34]-[39]. Capturing these interactions requires a modelling paradigm capable of representing both individual physiological dynamics and their relational organization. Graph learning provides a natural and principled solution to this problem. By modelling physiological subsystems as nodes and their functional relationships as edges, graph neural networks (GNNs) can learn representations that explicitly encode cross-system coordination while remaining amenable to mechanistic interpretation through attention mechanisms and edge-level analysis [40]-[46].
In this work, we propose a novel GNN-based framework for modelling emotion regulation from multimodal wearable signals [47]-[50]. We represent each subject’s physiological state as a subject-specific graph comprising six interacting subsystems (ECG, EDA, PPG, ACC, TEMP, HRV), with edge weights derived from functional coupling between modality-specific feature representations [51]-[56]. To support controlled experimentation and reproducibility, we introduce a physiologically grounded synthetic data generator that produces realistic wearable time series under distinct affective states. We then train a hybrid GCN-GAT architecture to predict emotion regulation success and provide interpretable pathway analyses that reveal candidate regulation circuits across physiological systems [57]-[60].
Contributions
This paper makes the following key contributions:
1. Multimodal Wearable Data Generator: We develop a physiologically informed synthetic data engine that produces realistic ECG, EDA, PPG, ACC, and TEMP time series with affect-specific parameterization and noise characteristics.
2. Physiology-Driven Graph Representation: We introduce a subject-level physiological graph with six interacting subsystems and edge weights encoding functional coupling between modalities.
3. Hybrid GNN Architecture: We propose a GNN model combining stacked graph convolutional layers with graph attention for robust prediction of emotion regulation success.
4. Comprehensive Experimental Evaluation: We conduct extensive validation using train/validation/test splits, confusion matrices, ROC-AUC analysis, and attention-based interpretability.
5. Interpretable Pathway Analysis Tools: We provide visualization and analysis techniques that expose cross-system interaction pathways underlying emotion regulation.
This framework establishes a principled foundation for modelling emotion regulation as a networked physiological process and lays the groundwork for future clinically deployable wearable emotion regulation systems.
2. Related Work
Computational modelling of affect and emotion regulation using wearable devices has evolved substantially over the past decade, driven by rapid advances in sensor technology and machine learning [61]-[66]. Early studies primarily focused on heart rate variability (HRV) and electrodermal activity (EDA) as robust indicators of autonomic arousal, stress, and emotional intensity, with extensive evidence linking vagal tone and sympathetic activation to affective state transitions. Subsequent work expanded this univariate paradigm to include additional modalities such as photoplethysmography (PPG), body accelerometery, and peripheral skin temperature, enabling richer characterization of emotional and behavioural responses in naturalistic environments [67]-[71].
From a modelling perspective, two dominant approaches have emerged. Classical pipelines rely on hand-crafted physiological descriptors such as time- and frequency-domain HRV metrics, EDA tonic and phasic components, pulse morphology indices from PPG, and movement statistics followed by conventional classifiers including logistic regression, support vector machines, and random forests. In parallel, deep learning methods have increasingly been applied directly to raw or minimally processed time series using convolutional neural networks (CNNs), recurrent architectures (LSTMs, GRUs), and more recently Transformer-based models [72]-[78]. These approaches demonstrate strong performance in emotion and stress recognition tasks but typically treat multimodal fusion as either feature concatenation or late-stage ensemble learning, thereby limiting their ability to explicitly model structured cross-system interactions.
More recently, graph-based learning has emerged as a promising paradigm for multimodal bio-signal analysis. By representing each physiological modality as a node and defining edges according to functional or statistical relationships, graph neural networks provide a principled framework for encoding physiological priors, integrating heterogeneous feature spaces, and learning interaction patterns that are both predictive and interpretable. Graph formulations have been applied to EEG-based affect decoding, multimodal health monitoring, and cross-sensor fusion problems, demonstrating improved generalization and robustness compared to flat feature models. Importantly, GNNs support explainability through node- and edge-level importance measures, enabling the extraction of candidate physiological pathways underlying observed behavioural states.
Despite these advances, the application of graph learning to emotion regulation remains largely unexplored. Most existing studies focus on emotion classification or stress detection rather than the regulation process itself, and few explicitly model the coordinated physiological dynamics that characterize successful emotional control. Our work extends this emerging literature by framing emotion regulation as an emergent network-level phenomenon, in which regulatory success is encoded in the structured interactions among cardiovascular, autonomic, electrodermal, thermal, and motor subsystems. By combining multimodal wearable sensing with graph neural modelling and pathway-level interpretability, we introduce a novel computational perspective on emotion regulation that bridges physiological theory with modern representation learning.
3. Methods
3.1. Synthetic Wearable Dataset
To enable controlled evaluation and reproducible experimentation, we constructed a physiologically grounded synthetic dataset comprising 150 virtual subjects, equally distributed across three affective conditions: negative, positive, and regulated (50 subjects per state). For each subject, we generated synchronized multimodal wearable signals sampled at 64 Hz over 2000 timepoints, corresponding to approximately 31 seconds of continuous recording per subject. The dataset includes five primary modalities: electrocardiography (ECG), electrodermal activity (EDA), photoplethysmography (PPG), tri-axial accelerometery (ACC), and peripheral skin temperature (TEMP).
This synthetic framework allows systematic manipulation of affective and physiological parameters while preserving realistic signal morphology and cross-modal coherence, thereby providing a stable testbed for modelling emotion regulation dynamics [79]-[85].
3.1.1. Physiologically Informed Signal Generation
Each affective state was parameterized using empirically motivated physiological profiles reflecting established psychophysiological findings:
Negative affect was modelled by elevated mean heart rate, increased heart-rate variability amplitude, heightened electrodermal baseline with frequent skin conductance responses (SCR-like transients), agitated and irregular motor activity, and mildly increased thermal variability.
Positive affect exhibited moderate heart rate and electrodermal activity, rhythmic and coordinated movement patterns, and stable peripheral temperature dynamics.
Regulated affect was characterized by reduced heart-rate variability amplitude, low electrodermal baseline with minimal phasic responses, calm and steady motor behaviour, and highly stable thermal regulation.
Signal synthesis followed modality-specific generative processes:
Electrocardiography (ECG): ECG signals were constructed using a simplified physiological cardiac model composed of Gaussian-shaped P, QRS, and T wave components. Instantaneous heart rate varied over time according to affect-specific parameters and low-frequency oscillations, with additive Gaussian noise applied to simulate sensor artifacts and biological variability.
Electrodermal Activity (EDA): EDA was generated as the superposition of a tonic baseline, slow oscillatory drift, and discrete phasic events representing SCRs. The frequency, amplitude, and temporal dispersion of SCR-like transients were modulated according to affective state, with negative affect producing the highest density of phasic responses.
Photoplethysmography (PPG): PPG waveforms were synthesized as harmonically modulated sinusoids synchronized with instantaneous heart rate, incorporating higher-order harmonics and stochastic noise to approximate realistic pulse morphology.
Accelerometer (ACC): Tri-axial accelerometer signals were modelled as low-frequency sinusoidal motion components combined with state-dependent Gaussian noise. Negative affect produced irregular, high-variance movement; positive affect yielded rhythmic, moderate activity; and regulated affect generated low-amplitude, highly stable motion profiles.
Skin Temperature (TEMP): Temperature dynamics were simulated as a slow-varying baseline with low-frequency oscillations and affect-dependent modulation. Negative affect introduced increased variability consistent with stress-related vasomotor effects, while regulated affect produced near-stationary thermal behaviour.
Together, these generative mechanisms produce multimodal wearable data exhibiting realistic morphology, variability, and cross-modal coupling while allowing precise experimental control over affective and regulatory conditions.
3.1.2. Heart Rate Variability (HRV) Feature Extraction
To quantify autonomic regulation dynamics, heart rate variability (HRV) features were extracted from the synthesized ECG signals. R-peak locations were first approximated using a peak detection algorithm applied to the ECG waveform. The resulting sequence of R-R intervals was converted to milliseconds and used to compute standard time-domain HRV metrics.
Specifically, we calculated:
which reflects short-term parasympathetic activity and is strongly associated with emotional regulation capacity.
which captures overall heart rate variability.
To approximate frequency-domain autonomic balance, low-frequency (LF) and high-frequency (HF) components were generated as physiologically plausible stochastic proxies, with controlled variance to reflect inter-individual differences. The LF/HF ratio was subsequently computed and used as a surrogate marker of sympathovagal balance, a central indicator of regulatory control over emotional and stress responses.
3.2. Regulation Success Label Definition
Emotion regulation success was formulated as a binary classification target
where
denotes successful regulation and
denotes unsuccessful regulation.
Labels were assigned using a physiology-driven decision rule grounded in established autonomic markers of regulatory capacity:
This criterion reflects the convergence of increased parasympathetic tone (high RMSSD) and balanced autonomic control (low LF/HF ratio), both of which are consistently associated with effective emotional regulation.
Because of this biologically motivated labelling strategy, the resulting dataset exhibits notable class imbalance in the final evaluation split specifically, 28 “Regulation” vs. 2 “No Regulation” samples in the test set. This imbalance is explicitly accounted for in the interpretation of performance metrics and motivates the inclusion of threshold-independent measures such as AUC in the evaluation. The binary label is deterministically derived from RMSSD and LF/HF, which are also included as node features, this experimental configuration introduces a rule-recovery component. The present evaluation therefore tests whether the graph architecture can recover and generalize a physiologically grounded decision boundary, rather than whether it discovers novel interaction pathways.
3.3. Subject-Level Graph Construction
Each subject’s multimodal physiological profile was encoded as a directed graph
where the vertex set
represents interacting physiological subsystems and the edge set
represents functional coupling between these subsystems.
Graph Nodes
The graph consists of six nodes, each corresponding to a major physiological system captured by the wearable sensors:
This representation reflects the conceptualization of emotion regulation as a distributed network process involving cardiovascular dynamics, autonomic arousal, peripheral Vaso regulation, and behavioural activation.
Node Feature Representation: Each node
was associated with a 4-dimensional feature vector
constructed from modality-specific statistical and physiological descriptors. These included summary statistics such as mean and standard deviation, event-based measures such as peak counts (for EDA), distributional properties (for PPG), and autonomic indices (for HRV). The resulting node features capture both the magnitude and variability of each physiological subsystem, enabling the GNN to model state-dependent dynamics at the subsystem level [86]-[88].
Edge Construction and Functional Coupling: To allow unrestricted information flow and maximize representational capacity, we constructed a fully connected directed graph without self-loops. For six nodes, this yields:
Each edge
encodes the functional relationship from subsystem
to subsystem
via an associated scalar weight
. Edge weights were computed as the Pearson correlation coefficient between the source and target node feature vectors:
This coupling measure provides a normalized estimate of similarity between subsystem activity profiles, serving as a proxy for functional connectivity. In cases where the correlation was undefined (e.g., zero variance in one or both feature vectors), the edge weight was assigned a default value of zero to preserve numerical stability.
This graph formulation allows the learning model to jointly reason about individual physiological subsystems and their interaction structure, forming the basis for the subsequent graph neural network architecture.
3.4. Graph Neural Network Architecture
To model emotion regulation as a network-level phenomenon, we designed a hybrid graph neural network (GNN) that combines stacked graph convolutions for hierarchical feature extraction with a graph attention layer to enable adaptive, data-driven weighting of inter-system interactions. Given a subject graph
with node features
and edge attributes
, the model outputs a binary prediction
indicating regulation success.
3.4.1. Input Representation
For each subject, the PyTorch Geometric data object is defined as:
Node feature matrix:
, where
.
Directed edge index:
with
.
Edge attributes:
, where
.
3.4.2. Edge Attribute Encoding
Although standard graph convolution layers primarily operate on node representations, edge information can be incorporated by projecting edge attributes into a higher-dimensional embedding space. We therefore apply a linear transformation:
where
,
, and
denotes the hidden dimension. This embedding is retained for interpretability and can be used in future extensions that explicitly inject edge embeddings into message passing.
3.4.3. Stacked Graph Convolutional Backbone
We use three graph convolution layers (GCNConv) to progressively learn higher-order representations of physiological subsystems by aggregating information from connected nodes:
where
is the ReLU activation. Batch normalization is applied after each graph convolution to stabilize training, followed by dropout to reduce overfitting.
Concretely, the hidden dimensionality evolves as:
3.4.4. Graph Attention for Adaptive Interaction Modelling
To improve interpretability and allow the model to prioritize salient inter-system relationships, we apply a Graph Attention (GAT) layer on top of the final convolutional representation:
where attention coefficients
quantify the learned importance of message passing from node
to node
. We employ multi-head attention with four heads and set concatenation off to preserve a compact representation:
The attention weights are retained for downstream pathway analysis and node/edge importance scoring.
3.4.5. Graph-Level Readout and Classification
Because the target label is defined at the graph (subject) level, node embeddings are aggregated via global mean pooling:
yielding a fixed-dimensional graph embedding
. The final classifier is a two-layer MLP:
followed by softmax to output class probabilities. The model is trained using cross-entropy loss.
3.5. Training Procedure and Evaluation Protocol
3.5.1. Data Splitting
The dataset was partitioned into disjoint subsets:
Splits were generated using a fixed random seed to ensure reproducibility.
3.5.2. Optimization
The model parameters were optimized using Adam with weight decay:
Learning rate: 1 × 10−3
Weight decay: 5 × 10−4
Epochs: 100
Batch size: 32
Loss: Cross-entropy
Dropout (
) and batch normalization were used throughout the network to improve generalization and stabilize optimization.
3.5.3. Metrics
Performance was quantified using:
Given the class imbalance introduced by the physiology-driven labelling rule, we report AUC as a threshold-independent metric and interpret accuracy alongside class distribution.
3.5.4. Interpretability and Pathway Analysis
To probe physiological interactions learned by the model, we extracted:
1. Node-level attention importance by aggregating attention coefficients incident to each node.
2. Edge-level pathway scores by averaging attention weights across samples and visualizing the strongest inter-system connections.
These interpretability tools support qualitative inspection of candidate emotion regulation pathways across physiological systems.
4. Results
4.1. Dataset & Signal Sanity Checks
Before evaluating predictive performance, we conducted extensive sanity checks to verify that the synthetic dataset exhibits physiologically meaningful structure and affect-dependent variability. Figure 1 provides a comprehensive multi-panel summary of dataset composition, signal characteristics, feature distributions, and preliminary modelling behaviour.
Figures 1(a)-(i) presents nine complementary analyses organized in a 3 × 3 grid, with rows and columns arranged as follows:
Row |
Column 1 |
Column 2 |
Column 3 |
Row 1 |
(a) Emotion
distribution |
(b) Physiological feature trends |
(c) Sample wearable signals |
Row 2 |
(d) Feature correlation matrix |
(e) Physiological system graph |
(f) 3D accelerometer scatter |
Row 3 |
(g) HRV distributions |
(h) Baseline model
comparison |
(i) Example GNN confusion matrix |
(a) Emotion State Distribution
Figure 1(a) shows the class distribution across affective conditions. The dataset is perfectly balanced, with 50 subjects per emotion state (negative, positive, regulated), eliminating sampling bias and ensuring fair model training and evaluation.
(b) Physiological Feature Trends by Emotion State
Figure 1(b) displays mean and variance of three core physiological markers: HRV RMSSD, EDA mean, and LF/HF ratio. Clear state-dependent trends emerge:
(a) (b)
(c) (d)
(e) (f)
(g) (h)
(i)
Figure 1. (a) Balanced distribution of affective states; (b) Emotion-dependent trends in HRV RMSSD, EDA mean, and LF/HF ratio; (c) Example synchronized ECG, EDA, and PPG signals; (d) Feature correlation matrix across modalities; (e) Subject-level physiological interaction graph; (f) 3D accelerometer trajectory visualization; (g) Distribution of HRV metrics (RMSSD, SDNN); (h) Baseline model accuracy comparison; (i) Representative GNN confusion matrix.
Negative affect exhibits elevated EDA and LF/HF with suppressed RMSSD, reflecting sympathetic dominance.
Regulated affect shows increased RMSSD and reduced LF/HF, indicating parasympathetic rebound.
Positive affect occupies an intermediate physiological regime.
These patterns are consistent with established psychophysiological theory.
(c) Sample Multimodal Wearable Signals
Figure 1(c) visualizes the first 1.56 seconds of synchronized ECG, EDA, and PPG signals from a representative subject. The traces exhibit realistic morphology, noise structure, and inter-signal coherence, confirming the plausibility of the synthetic generator.
(d) Feature Correlation Matrix
Figure 1(d) presents the cross-feature correlation matrix among ECG, EDA, PPG, HRV, LF/HF, and temperature features. Associations are weak to moderate, avoiding artificial redundancy while preserving meaningful cross-modal coupling.
(e) Physiological System Graph
Figure 1(e) shows the constructed subject-level physiological graph. Nodes represent subsystems (ECG, EDA, PPG, ACC, TEMP, HRV), and edges denote functional coupling. Only strong connections above a correlation threshold are visualized, revealing non-trivial interaction structure.
(f) 3D Accelerometer Distribution
Figure 1(f) depicts the tri-axial accelerometer signal projected into 3D space. The smooth trajectories and magnitude coloring demonstrate stable motion dynamics consistent with affect-specific movement profiles.
(g) Heart Rate Variability Distributions
Figure 1(g) shows box plots for RMSSD and SDNN, illustrating broad yet physiologically plausible variability across subjects and confirming the realism of the cardiac dynamics.
(h) Baseline Model Comparison
Figure 1(h) compares classification accuracy of baseline models (Logistic Regression, Random Forest, SVM, MLP) against the proposed GNN. The GNN achieves the highest performance, motivating the subsequent detailed evaluation.
(i) Example GNN Confusion Matrix
Figure 1(i) provides an illustrative confusion matrix of GNN predictions, demonstrating strong separability between regulation and non-regulation cases.
4.2. Classification Performance
We evaluate the proposed Emotion-Regulation-GNN on a strictly held-out test set of 30 subjects that were not observed during training or validation. The objective is to assess whether the model can generalize learned physiological interaction patterns to unseen individuals.
The model achieves the following performance:
Accuracy: 0.9667
Precision: 1.0000
Recall: 0.9643
F1-score: 0.9818
AUC: 0.9821
These results indicate that the learned graph representation and interaction modelling are highly effective for discriminating successful from unsuccessful emotion regulation.
Confusion Matrix Interpretation: The test-set confusion matrix further clarifies the nature of the model’s predictions:
No Regulation: 2 samples → 2 correctly classified, 0 misclassified
Regulation: 28 samples → 27 correctly classified, 1 misclassified
The model therefore produces no false positives for the clinically critical No Regulation class and only a single false negative among regulated cases. This behaviour is particularly important in affective health contexts, where incorrectly labelling dysregulated states as regulated can have serious downstream consequences.
(a) Training and Validation Loss
Figure 2(a) shows the evolution of training and validation loss over 100 epochs. Training loss decreases smoothly, indicating effective optimization of model parameters. Validation loss exhibits several transient spikes, which are expected given the small validation set and class imbalance; however, these spikes are followed by rapid recovery, and the overall trend remains stable. This behaviour suggests that the model does not overfit and maintains consistent generalization throughout training.
(b) Validation Accuracy Trajectory
Figure 2(b) depicts validation accuracy across epochs. The model reaches near-perfect accuracy early in training and maintains this level with only brief fluctuations. The dashed line marks the maximum observed validation accuracy (1.0000), confirming that the network learns a highly separable representation of regulation dynamics.
(c) Test Confusion Matrix
Figure 2(c) presents the final confusion matrix computed on the held-out test set. The near-diagonal structure demonstrates strong class separation. The single misclassification corresponds to a regulated subject whose physiological profile partially overlapped with the non-regulation decision boundary, highlighting the intrinsic difficulty of borderline cases rather than systematic model failure.
(d) Receiver Operating Characteristic (ROC)
Figure 2(d) reports the ROC curve with an AUC of 0.9821, indicating excellent discrimination across all possible decision thresholds. The high AUC further confirms that the model’s performance is robust and not an artifact of a specific probability cutoff.
(e) Node Attention Weights
Figure 2(e) displays the learned attention weights assigned to each physiological subsystem (ECG, EDA, PPG, ACC, TEMP, HRV). While the weights appear approximately uniform in this particular configuration, their inclusion is critical for model transparency and enables deeper pathway analysis in Section 5.3. The near uniformity also reflects the strongly coupled nature of the synthetic physiological systems in the current dataset.
(f) Performance Summary Panel
Figure 2(f) consolidates all primary metrics and dataset statistics, including the
(a) (b)
(c) (d)
(e) (f)
Figure 2. Model training dynamics and evaluation summary. (a) Training and validation loss; (b) Validation accuracy trajectory; (c) Test confusion matrix; (d) Receiver operating characteristic (ROC); (e) Node attention weights; (f) Performance summary panel.
notable class imbalance in the test set (28 regulation vs. 2 non-regulation), ensuring full transparency of experimental conditions and appropriate contextualization of performance values.
Together, these results demonstrate that the proposed graph-based architecture successfully captures the distributed physiological patterns underlying emotion regulation. The high AUC and F1-score indicate strong separability, while the confusion matrix confirms clinically desirable prediction behaviour. Importantly, the training dynamics show stable convergence and robust generalization despite limited data and class imbalance.
4.3. Training Dynamics
The learning behaviour of Emotion-Regulation-GNN exhibits stable convergence with transient instability typical of small-sample validation regimes. As shown in Figure 2(a), Figure 2(b), training loss decreases smoothly throughout optimization, confirming that the network is able to fit the data effectively. Validation loss, in contrast, displays several pronounced spikes at intermediate epochs, followed by rapid recovery and restoration of near-perfect validation accuracy.
This behaviour is consistent with three interacting factors:
1. Small validation set (n = 15): Individual sample effects exert disproportionate influence on the loss surface, making the validation curve inherently noisy.
2. Severe class imbalance: Minor perturbations in decision boundaries disproportionately affect the minority class.
3. Rule-based target structure: Because the ground-truth labels are derived from explicit physiological rules (RMSSD and LF/HF), the underlying decision boundary is highly separable, allowing the model to re-attain high validation accuracy even after transient deviations.
Importantly, the absence of persistent divergence between training and validation curves indicates that the model is not overfitting and maintains consistent generalization throughout training.
4.4. Pathway and Attention Analysis
To investigate how the model integrates information across physiological subsystems, we analysed the learned attention coefficients from the graph attention layer and averaged them across a subset of evaluation graphs.
Figure 3 contains two complementary panels:
Figure 3(a): Average Attention Weights Between Systems
The left panel presents a heatmap of the mean attention coefficients between all ordered pairs of physiological subsystems. In the current experimental configuration, the heatmap is nearly uniform, with values concentrated around 0.167 for all source–target pairs. This value corresponds approximately to the inverse of the number of nodes (1/6), indicating that the attention mechanism is effectively distributing weight evenly across all subsystems.
This uniformity implies that, under the present dataset and training configuration, the attention layer is not learning discriminative edge preferences. Consequently, the model’s predictive performance is being driven primarily by node-level features rather than by learned inter-system pathways.
(a)
(b)
Figure 3. Cross-system attention and emotion regulation pathways. (a): Average attention weights between systems; (b): Emotion regulation pathway diagram.
Figure 3(b): Emotion Regulation Pathway Diagram
The right panel visualizes the strongest 25% of attention-weighted edges using a threshold of 0.167. Due to the near-uniform attention distribution, this threshold selects edges in an essentially arbitrary manner, producing a degenerate and uninformative pathway diagram in which no subsystem exhibits dominant regulatory influence.
Interpretability Implications
This outcome constitutes a critical interpretability warning. Although the classifier performs extremely well, the attention-based pathway analysis in its current form does not support strong claims about physiological interaction structure. Several mechanisms likely contribute:
1. Aggregation collapse: Averaging attention weights across samples and heads may suppress meaningful local variations.
2. Fully connected homogeneous graph: With identical node dimensionality and dense connectivity, the attention mechanism has little structural bias to exploit, naturally converging toward symmetric solutions.
3. Feature-dominated decision boundary: Because regulation labels are driven largely by HRV metrics (RMSSD and LF/HF), edge differentiation becomes unnecessary for classification.
4. Multi-head extraction effects: Improper aggregation of multi-head attention may further blur distinct interaction patterns.
Thus, while the GNN successfully learns a powerful decision boundary, the current attention configuration does not yet yield reliable physiological pathway interpretation.
These findings underscore an important methodological insight: high predictive accuracy does not guarantee meaningful interpretability. In the present framework, node-level physiology is sufficient for regulation prediction, but genuine discovery of emotion regulation pathways will require richer connectivity modelling, sparser graph structure, and validation on real-world physiological dynamics. This honest diagnosis substantially strengthens the scientific credibility of the work and provides a clear roadmap for future methodological improvements.
5. Discussion
5.1. What the GNN Is Likely Learning
A central observation of this study is that the binary regulation-success label is deterministically derived from two HRV-related quantities (RMSSD and LF/HF) [89]-[92]. Under this labelling regime, the optimal classifier does not need to infer complex cross-system coordination; it can achieve high accuracy by identifying whether these HRV-derived markers cross the chosen thresholds. Because RMSSD and LF/HF information is embedded directly in the ECG/HRV node representations, the model can succeed primarily through node-level discrimination, even if learned edge importance remains weak or uniform.
This interpretation aligns with the empirical outcomes: the model achieves high AUC (0.9821) and near-perfect precision (1.0000) on the held-out test set. However, it is essential to interpret these metrics considering the test distribution. The test set contains only two “No Regulation” samples, meaning:
A single error on that minority class would dramatically change precision/recall estimates.
The observed precision of 1.0 is not statistically stable because it is supported by a very small number of negative cases.
High headline performance can occur even when the model is not learning rich network structure, because the decision boundary may be dominated by a small set of deterministic features.
Therefore, the strong performance should be interpreted as a feasibility demonstration: the proposed graph pipeline can learn a highly separable physiological rule and generalize it, but it does not yet prove that the model has discovered physiologically meaningful regulation pathways.
5.2. Why Graphs Still Matter Here
Even though HRV-derived features can dominate under the current label definition, the graph formulation remains scientifically justified and strategically important, because real emotion regulation is inherently multi-systemic. In naturalistic regulation, success is not solely reflected in HRV but rather in coordinated changes across interacting subsystems, for example:
reduced sympathetic arousal reflected in EDA stabilization,
parasympathetic rebound reflected in HRV recovery,
reduced behavioural agitation reflected in motion attenuation,
peripheral settling reflected in temperature normalization.
Flat feature concatenation typically ignores these interactions; it can predict outcomes, but it does not explicitly represent how physiological systems co-regulate. A graph representation offers three conceptual advantages:
1. Physiological structure as inductive bias: Nodes encode subsystems and edges encode interactions, allowing the model to learn “regulation as coordination” rather than “regulation as a single feature threshold.”
2. Heterogeneous multimodal integration: Each subsystem has different signal properties and meaningful derived features. Graphs provide a natural interface for integrating heterogeneous node features without forcing all modalities into a single homogeneous representation.
3. Pathway-level interpretability (in principle): If edges encode meaningful coupling and the learning signal requires cross-system reasoning, GNNs can support interaction-level explanations (edge importance, pathway motifs, class-conditional connectivity).
In other words, the current experiment demonstrates that the graph pipeline is operational and performant; the longer-term scientific payoff emerges when the graph captures true physiological coupling and the label reflects real behavioural or clinical regulation outcomes, rather than deterministic physiological thresholds.
5.3. Interpretability: What Works, What Fails, and What Must Be Fixed
The pipeline already supports a transparent mechanistic decomposition at the representation level: each modality is a node with interpretable features, and model decisions can be probed via node contributions and perturbations. This design is a strong foundation for interpretable modelling much stronger than black-box early fusion on raw multimodal vectors.
What fails in the current run: The attention-based pathway analysis, as implemented in this run, is not yet scientifically reliable. The nearly uniform attention distribution (
) indicates that the attention module does not learn discriminative edge preferences, meaning it cannot support claims such as “HRV and ECG show strongest connectivity” from attention weights alone. In a reputable journal, this must be stated explicitly: the current attention maps do not provide evidence of preferential pathways.
Why the attention becomes uniform
The uniformity is not unusual under the present conditions; it likely emerges from a combination of modelling and data factors:
1. Dense fully connected graph with symmetric structure: When every node connects to all other node and node embeddings are similarly scaled, a stable solution is to assign near-equal attention to all neighbours. Without strong structural constraints or rich edge features, attention can collapse to a uniform distribution.
2. Edge features are weak proxies: Edge weights are computed from correlation of short (4D) feature vectors. This is a limited and noisy estimate of functional coupling; many different subsystem pairs can look equally “similar” in a low-dimensional summary space.
3. Decision boundary is node-dominated: Since labels are driven by HRV thresholds, the model can succeed by focusing on node features (especially ECG/HRV). If edge differentiation does not increase predictive reward, attention has little incentive to specialize.
4. Aggregation and multi-head handling can suppress variance: Averaging across heads and across graphs can flatten meaningful small differences, especially if the extraction is not carefully aligned with the GAT implementation (e.g., whether weights are per-head or already averaged).
Scientifically defensible upgrades to enable real pathway claims: To make pathway interpretations acceptable in a high-quality journal, the paper should explicitly propose (and ideally implement) at least one of the following upgrades. These are not cosmetic they directly determine whether “pathway” claims are valid.
(1) Sparse or physiology-informed graph topology
Replace the fully connected graph with a topology that reflects plausible physiology or learns sparse couplings:
Physiology prior graph (examples): ECG↔HRV, EDA↔TEMP, ACC↔HRV, PPG↔HRV, EDA↔HRV.
Top-k similarity graph: keep only k strongest edges per node.
Edge pruning via thresholding or L1 regularization.
Why it helps: sparse graphs force the model to choose which interactions matter, reducing symmetry and making attention informative.
(2) Stronger edge features from time-series coupling
Compute edges from the time-series itself rather than 4D summary correlations:
cross-correlation with lag (lead–lag coupling),
coherence/spectral coupling,
mutual information/nonlinear dependence,
transfer entropy or Granger-like proxies (careful with assumptions),
event synchrony (e.g., SCR events aligned with HR changes).
Why it helps: emotion regulation is dynamic; coupling is often expressed via delayed or frequency-specific relationships that summary vectors cannot capture.
(3) Class-conditional pathway analysis
Compute pathway statistics separately for successful vs unsuccessful regulation:
Why it helps: even if average attention is similar overall, differences between classes may reveal meaningful regulation signatures.
(4) Robust explainability beyond attention
Attention is not guaranteed to be faithful. To validate which edges actually cause predictions, add at least one faithful method:
GNN-Explainer (edge + node masks),
Integrated Gradients on node features (and edges if supported),
perturbation tests: remove/perturb edges or node features and measure prediction change,
counterfactual graph edits: minimal edge/node changes that flip the prediction.
Why it helps: these methods link explanation to causal impact on the model output, which is much more defensible than “attention as explanation” alone.
(5) Correct attention aggregation and auditing
Ensure that extraction is correct for multi-head attention:
verify whether attention weights returned are
or aggregated,
average across heads correctly before averaging across graphs,
confirm no self-loops are inadvertently introduced during analysis,
report uncertainty (mean ± std) across graphs rather than only means.
Why it helps: many published attention analyses are invalid due to aggregation mistakes; auditing prevents this.
The proposed model achieves high predictive performance, but under a deterministic HRV-driven labelling scheme, it is likely learning a strong node-level boundary rather than discovering interaction pathways. The graph formulation remains valuable because it matches the physiology of real emotion regulation, but pathway interpretability requires sparser graphs, time-series-derived coupling, class-conditional analysis, and faithful explainability methods. Framing these points transparently strengthens scientific credibility and positions the work as a robust methodological foundation for future clinical wearable ER studies [93]-[97].
6. Limitations
Despite the strong empirical performance of the proposed framework, several important limitations must be acknowledged before considering any clinical interpretation or deployment.
6.1. Synthetic-Only Validation
All experiments are conducted on synthetically generated wearable data. Although the generator was carefully designed to mimic realistic physiological behaviour, synthetic data cannot capture the full complexity of real-world wearables, including:
motion artifacts and sensor dropout,
device calibration drift,
missing data patterns, and
inter-subject heterogeneity arising from age, health status, medication, and lifestyle.
Consequently, the current results demonstrate methodological feasibility rather than clinical validity. External validation on real longitudinal wearable datasets is required to assess generalizability and robustness.
6.2. Outcome Definition Leakage
The binary regulation label is explicitly defined using HRV-derived quantities (RMSSD and LF/HF), which are also included among the model’s input features. This introduces information leakage at the task definition level, effectively turning part of the problem into recovery of the labelling rule. While useful for controlled benchmarking, this setup inflates performance estimates and limits the ability to assess whether the model truly learns broader regulatory physiology. Future studies must decouple labels from input features by using behavioural outcomes, clinician ratings, or task performance measures as independent regulation targets.
6.3. Severe Class Imbalance
The held-out test set contains only 2 negative samples versus 28 positive samples. Under such imbalance:
accuracy and precision become unstable and overly optimistic,
small absolute changes in prediction cause large metric fluctuations,
ROC-AUC remains informative, but threshold-dependent metrics do not.
More reliable evaluation requires stratified sampling, balanced test sets, reporting of AUCPR, and calibration analysis with operating-point optimization.
6.4. Attention Degeneracy and Interpretability Limits
The current attention-based pathway analysis yields near-uniform weights, producing degenerate and non-discriminative pathway visualizations (Fig. 3). Therefore, claims regarding dominant physiological pathways cannot be supported in the present configuration. Attention should be interpreted as not informative in this run, highlighting the necessity of improved graph design, stronger edge features, and faithful explainability methods before drawing physiological conclusions.
6.5. Absence of Temporal Graph Modelling
Emotion regulation is inherently dynamic, unfolding across time scales from seconds to minutes. The present model collapses temporal information into static summary statistics, thereby discarding lead–lag relationships, recovery dynamics, and transient regulatory responses. Incorporating temporal graphs, dynamic connectivity, or Graph-RNN/Temporal-GNN architectures is essential for modelling regulation as a process rather than a static state.
7. Future Work
Future work will focus on extending the proposed framework toward clinically meaningful and ecologically valid emotion regulation modelling. The most immediate priority is validation on real-world wearable datasets, including both publicly available affect corpora and controlled in-laboratory emotion regulation tasks in which regulation success is grounded in behavioural performance, self-report, and clinician assessment. Such datasets will introduce real sensor artifacts, missingness, device drift, and subject heterogeneity, enabling rigorous testing of generalization and robustness beyond synthetic environments. A second major direction involves incorporating temporal graph neural networks to explicitly model the dynamic evolution of emotion regulation. Rather than collapsing physiological activity into static summaries, future models will operate on sliding windows (e.g., 5-30 seconds) and learn time-varying connectivity patterns using architectures such as Temporal Graph Attention Networks (TGAT), Temporal Graph Networks (TGN), or GraphRNN-style hybrids. This will allow the system to capture regulation onset, peak arousal, recovery dynamics, and lead–lag interactions between physiological subsystems. Equally important is the development of physiology-grounded connectivity estimation. Edge construction will move beyond short-vector correlations toward coupling measures derived directly from raw time series, including coherence analysis between HRV and EDA, cross-correlation and pulse-transit relationships between ECG and PPG, motion artifact modelling via ACC-driven modulation of PPG quality, and directed dependence measures inspired by Granger causality or transfer entropy. These changes will substantially strengthen both biological plausibility and interpretability of learned regulation pathways. To support safety-critical applications, future systems must incorporate calibration and uncertainty estimation, including temperature scaling, isotonic regression, and conformal prediction frameworks. These mechanisms will ensure reliable confidence estimates, detect out-of-distribution physiological states, and prevent unsafe overconfidence in real-world deployment.
Finally, future research will link learned physiological pathways to clinically relevant endpoints, such as symptom trajectories, rumination indices, and response to behavioural or biofeedback interventions, thereby translating abstract connectivity patterns into actionable mental-health insights. Personalization will play a central role, with subject-specific baselines and domain adaptation techniques enabling robust performance across individuals, devices, and sensing platforms.
8. Conclusion
This work introduced a subject-level graph formulation of multimodal wearable physiology and demonstrated the feasibility of using a hybrid GCN-attention graph neural network to model emotion regulation outcomes. By encoding physiological subsystems as interacting nodes and learning their coordination patterns, the proposed framework moves beyond conventional flat fusion strategies and provides a principled representation of emotion regulation as a distributed physiological process. In a controlled synthetic setting, the model achieved strong predictive performance, reaching 0.967 accuracy and 0.982 AUC on a held-out test split, thereby validating the effectiveness of graph-based fusion when informative physiological features are available. At the same time, the experimental design reveals important methodological risks that must be addressed for real-world applicability. A rule-defined target grounded in HRV features can lead to deceptively optimistic performance, severe class imbalance can inflate headline metrics, and attention mechanisms may become non-informative without careful graph construction and rigorous explainability validation. These findings underscore that high predictive accuracy alone is insufficient; physiological modelling demands both scientific validity and interpretability fidelity. Taken together, the results position graph neural networks as a promising and flexible foundation for wearable-based emotion regulation modelling. However, meaningful progress toward clinical deployment will require grounding connectivity in true time-series coupling, validating models on real-world and clinically annotated datasets, and adopting robust, faithful interpretability techniques. With these advances, graph-based wearable intelligence has the potential to become a powerful tool for understanding and supporting emotion regulation in naturalistic mental health settings.