Mood on Move
Detecting Momentary Emotional States Using Smartwatch Sensing in Naturalistic Settings
Abstract
Detecting momentary emotional states with a low-cost, open-source smartwatch in naturalistic settings using on-device personalized models.
Mental health encompasses not only chronic conditions such as depression or anxiety, but also acute fluctuations in mood that unfold over minutes to hours and can disrupt daily functioning. These transient states — sudden fatigue, irritability, or low energy — remain largely invisible to current digital health approaches, which typically aggregate behavioral and physiological data over days or weeks to detect trait-level conditions.
The ability to detect momentary mood shifts in real time carries significant clinical promise: continuous affective monitoring could enable early detection of mental health crisis, support clinical decisions and clinical trials with continuous mood measurements, and improve occupational safety with detection of states like fatigue or confusion. However, most prior work in affective computing relies on controlled laboratory settings where performance degrades substantially in naturalistic environments, or employs research-grade devices with proprietary sensors unavailable on consumer hardware.
This study investigates whether continuous sensing from a low-cost, open-source smartwatch can support detection of multi-dimensional momentary mood states in naturalistic settings, using personalized models with on-device computation.
Methods
We conducted a 7-day field study in which participants (N=10) wore Bangle.js 2 smartwatches1 that continuously collected physiological and contextual data — heart rate, accelerometry, barometric pressure, temperature, and GPS — while prompting hourly mood self-reports using the Brunel Mood Scale (BRUMS)2 across six mood dimensions (tension, depression, anger, vigor, fatigue, confusion) and additional affective and physical states. All feature extraction was performed on-device. We developed personalized mood detection models using best-subset regression across multiple feature combinations.
Results
Personalized models decoded momentary states with mean R² values ranging from 0.09 (pain) to 0.31 (vigor). Fatigue, happiness, vigor, and depression were the most reliably decoded dimensions (mean R² = 0.26–0.31). Cross-subject decoding was substantially lower3, confirming that personalization is essential for accurate mood inference. Including privacy-preserving location features did not significantly improve prediction accuracy beyond physiological and contextual sensors alone.
Conclusions
This work demonstrates that a broad range of momentary mood states can be decoded from low-cost, open-source wearable sensors as people go about their daily lives, bridging the gap between controlled laboratory studies and real-world momentary assessment. The finding that personalized models substantially outperform generalized approaches underscores the need for individual calibration in affective computing systems. The on-device, privacy-preserving architecture establishes a foundation for future closed-loop adaptive interventions in clinical and occupational contexts, including continuous monitoring of high-risk psychiatric populations, early warning systems for substance use relapse, and real-time assessment of cognitive and emotional fitness in safety-critical work environments.
Acknowledgements
We thank the participants in our 7-day field study for their patience with hourly prompts and a non-trivial wearable form factor. We are grateful to the Fluid Interfaces group at the MIT Media Lab and the Connected Mind + Body research theme for ongoing feedback during the design and analysis phases, and to the maintainers of the open-source Bangle.js 2 firmware, on top of which all on-device feature extraction in this work was built.
Research Groups
- Fluid Interfaces, MIT Media Lab
- Media Lab Research Theme: Connected Mind + Body
Gallery
More Images
Footnotes
-
The Bangle.js 2 is a $80 hackable, open-source smartwatch running Espruino. Choosing a low-cost consumer device — rather than a research-grade actigraph — was a deliberate design constraint: we wanted to know what is decodable from sensors that anyone could realistically wear for weeks at a time. ↩
-
Terry, P.C., Lane, A.M., & Fogarty, G.J. (2003). Construct validity of the Profile of Mood States – Adolescents for use with adults. Psychology of Sport and Exercise, 4(2), 125–139. ↩
-
This echoes a well-documented pattern in wearable affective computing: features that map cleanly to one person’s physiology (e.g., resting HRV ranges) do not transfer to another’s. The practical implication is that any deployable system must include a personal calibration phase rather than relying on a one-size-fits-all decoder. ↩