Measuring Success, One Sensor at a Time: A Sensing Infrastructure for Longitudinal Workspace Behavior Monitoring
DOI: https://doi.org/10.1145/3600100.3626344
BuildSys '23: The 10th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, Istanbul, Turkey, November 2023
The development of built environments has expanded its focus beyond sustainability to health due to the potential to become a transformative health tool. Studies have shown that exposure to poor Indoor Environmental Quality (IEQ) can affect health and productivity, manifesting itself as sick building syndrome (SBS) and economic losses. Although previous studies have used wearables, mobile sensing, environmental sensing, and self-reports, none have utilized all four in a naturalistic environment. This study introduces a naturalistic multi-modal occupant state and behavior monitoring framework that (1) collects occupant and environment data through smart wearable devices, smartphones, environmental sensors, and self-reported surveys; (2) processes data to gain insight into participants. To assess the validity and ease of use of this framework, a pilot study was conducted with 13 participants, some in a smart office building space and others in their homes. This preliminary study confirmed the feasibility of employing surveys, smart wearable devices, environmental sensors, and passive smartphone sensing in a multi-modal approach to monitor occupant states and behaviors within smart office settings. The results revealed a positive linear relationship (r = 0.2497, 95% CI of [0.1502, 0.3493]) between subjective sleep ratings and total sleep time (TST). The reported sleep times were cross-validated with the identified sleep cycles, confirming the reliability of smart wearables in assessing sleep. Furthermore, in both the office and home participant data, noise levels exhibited a high incidence of coinciding change points with physical activity, suggesting a relationship between shifts in noise levels and changes in the physical activity of the occupant and vice versa. These findings further underscore the complex interaction between environmental factors and human behavior in the wild that can be closely examined in the proposed framework.
ACM Reference Format:
Beatrice Li, Arash Tavakoli, Alan Wang, Navreet Kaur, Laura Barnes, Afsaneh Doryab, and Arsalan Heydarian. 2023. Measuring Success, One Sensor at a Time: A Sensing Infrastructure for Longitudinal Workspace Behavior Monitoring. In The 10th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '23), November 15--16, 2023, Istanbul, Turkey. ACM, New York, NY, USA 8 Pages. https://doi.org/10.1145/3600100.3626344
1 INTRODUCTION
Throughout the COVID-19 pandemic, individuals spent an exceptional amount of time indoors, a significant shift given that even before the pandemic, approximately 90% of their time was already spent inside [2]. With most of the time spent indoors, occupants can experience symptoms and health illnesses due to exposure to poor indoor environmental quality (IEQ), known as Sick Building Syndrome (SBS) [24]. Additionally, there are also economic consequences with a loss of productivity[6]. The relationship between IEQ and the occupant state motivates the development of smart buildings that are not only sustainable, but supportive of human well-being and health, especially since smart buildings have the potential to be a public health tool [7]. Smart buildings are touted for their ability to reduce energy costs, but can also increase productivity by 11% through improved ventilation and reduce short-term sick leave by 35% [11].
Building management systems are essential for monitoring and adjusting the IEQ for the improved health of occupants [7, 18, 38]. Many studies have found thresholds for many IEQ metrics that would increase the prevalence of SBS, such as relative humidity below 30% or ventilation rates below 10 liters per second per person [18]. IEQ has also been found to affect sleep quality, productivity, and overall well-being of individuals [30, 35]. Specifically, a study [15] found that elevated levels of CO, CO2, and temperature corresponded to significant decreases in sleep quality.
It is worth exploring the environmental factors that can cause occupants to be distracted, leading to increased mobility and decreased productivity. A recent study gathered environmental data and subjective assessments to assess productivity and health [20]. The study discovered that illuminance, temperature, and airflow velocity significantly improved productivity. However, no physiological data was obtained and the study was conducted among manufacturing workers in a factory; elements contributing to productivity in office settings could be different, since tasks differ in dexterity and physical coordination. Individual physiological data and passive mobile sensing could serve as a proxy for measuring productivity in an objective manner as they can provide insight into times of user distraction (e.g., physical activity, receiving calls) [40]. Many studies [25, 32] that used wearables to evaluate well-being did not utilize environmental sensors, and a study that used both wearables and environmental sensors [15] only investigated sleep.
In contrast to studies that used sensors to collect quantitative data, many studies on the influence of the building environment on the occupant state relied primarily on subjective responses and lacked the support of quantitative data [8]. However, the merits of qualitative studies should not be dismissed, as they can be conducted on a larger scale at a lower cost than studies that implement sensors to collect quantitative data.
As evident in prior discussion, studies on the effects of the building environment on occupant states and behaviors lack a standardized sensing framework [13]. The lack of standardization also impedes comparison between studies and the reproducibility of longitudinal studies. Many studies conducted in the indoor environment have been found to be deficient in several ways, such as a lack of quantitative data, inadequate reporting of collected data and how it is processed, and insufficient details regarding the sample of participants [8]. A standard sensing framework will streamline and simplify the process of conducting studies, improving the quality of research in the domain of human-building interactions.
This study proposes a framework for naturalistic multi-modal occupant state and behavior monitoring in the built environment. Consequently, we introduce a naturalistic longitudinal case study that utilizes surveys, smart wearables, environmental sensors, and passive smartphone sensing. To evaluate the validity and ease of use of this framework, a pilot study is conducted to evaluate the merits, areas of improvement, and concerns.
Source | Metrics | Sampling Frequency |
Fitbit | Steps | Every minute |
(Wearable) | Heart Rate (HR) | 5 seconds; 1 second during exercise |
Heart Rate Variability (HRV) | 5 minutes | |
Skin Temperature | Every minute during sleep | |
Respiratory Rate | Every minute during sleep | |
Awair Omni | Temperature (°C) | Every 10 Seconds |
(Environmental Sensor) | Humidity(%) | |
CO2 (ppm) | ||
TVOCs (ppb) | ||
Lighting (lux) | ||
Noise (dB) | ||
AWARE | Location | Approx. every 3 minutes |
(Smartphone Application) | Battery | Event-triggered |
Wi-fi | Event-triggered | |
Screen Status | Event-triggered | |
Activity Recognition | Event-triggered | |
Application | Event-triggered (Android Only) |
2 METHODS
2.1 Data Collection Framework
The proposed naturalistic multi-modal occupant state and behavioral monitoring framework is composed of (1) smart wearables, (2) smartphones, (3) environmental sensors, and (4) surveys. Fusing the different data modalities provides a much richer source of data to answer various questions. Smart wearables can provide information on the physiological state of the occupant, sleep, physical activity, and stress. Smartphone data can capture the daily behaviors of the occupant – from mobility to social interactions and sleep. Environmental sensors provide information on the occupant's environment, dependent on the installation location, such as by their workspace or bedroom. Surveys are used to capture subjective responses of the occupants and provide a point of comparison to quantitative data collected from the sensors. The combination of these data sources enables us to recognize the connections between the various modalities and better understand the results.
2.1.1 Smart Wearables. For this pilot study we used Fitbit Sense and the associated API, which allows the automated extraction of unit steps, heart rate (HR), heart rate variability (HRV), skin temperature, and estimated oxygen variation. Most of the other metrics, such as sleep stages and exercise minutes, are derivatives of these metrics. The sampling frequency varied as skin temperature and respiratory rate were only recorded during detected sleep events. Heart rate was also measured at a higher frequency during detected exercise, as described in Table 1.
Sleep is recorded with a timestamp, sleep stage, and time spent in the sleep stage. Raw data must be processed to retrieve bedtime and wake-up time, the total duration of time in each stage of sleep, and the overall duration of sleep. Participants were excluded if they did not have enough observations, as underlined in Table 3. Data processing must account for moments of stillness mistaken for sleep, napping, and waking up at night before falling asleep again. To help clean the data, an arbitrary value of 100 minutes was used to group sleep cycles such that if the time difference between rows was greater than 100 minutes, then the next row was the start of the next sleep cycle. Self-reported sleep times were also used to help filter out detected sleep not within range.
Additionally, we want to use the survey responses as validation for the smart wearable observations, thus we only use sleep observations that have corresponding surveys for the day after. This validation step helps us to clean the Fitbit data prior to analysis. As a result, the original 731 sleep observations were reduced to 524 observations of sleep and daily surveys across twelve participants. Furthermore, Fitbit sleep observations can be used to validate self-reported bedtimes and wake-up times, as the error in selecting AM and PM is common. The comparison can be used to remove data considered outside the scope and to evaluate the discrepancy of self-reported sleep times.
Sleep stages include light, deep, REM, asleep, wake and restless. Light sleep, the initial stage of sleep, helps restore both mental and physical restoration; it is marked by a readiness to wake up and a slight decrease in breathing and heart rate. Deep sleep occurs in the early hours of sleep with a reduced response to external stimuli and slower breathing; it aids physical recovery, memory storage, and immune system support [14]. REM sleep, which occurs later in the sleep cycle, is characterized by active brain activity, dreaming, increased heart rate, and irregular breathing and is essential for mood regulation, learning, and memory storage [14]. While the asleep stage is where the smartwatch detects sleep but is unable to categorize the specific stage. Each stage of sleep has its own benefits and has a specific optimal range. Two of the major measures of proper sleep quality in the literature are described in Eqns. 1, 2, from Fritz et al. [15]. The first is Total Sleep Time (TST), which has an optimal range of seven to nine hours and REM to non-REM ratio (REM:nREM) with an optimal range between 0.25 and 0.33 [17, 27].
(1)
(2)
2.1.2 Smartphones. Smartphone data is collected through AWARE, an open source framework application designed to help conduct user studies in the mobile context [3]. The application can collect data from various smartphone sensors, including WiFi networks, location, applications, and communication. We observed varying degrees of data collection in iPhone and Android users, where Androids were able to collect more detailed data as described in 1. Smartphone data can provide details on the daily behaviors of participants and help understand events of interest found in the other data modalities. The amount of data collected depends not only on the type of operating software, but also on the sensors that are selected when the application is downloaded on the phone. For the pilot study, we did not utilize all available sensors. To have central storage for all the smartphone data, the AWARE application allows the syncing of data to a database, which also records the timestamp of the last sync and allows for compliance tracking.
Processing of smartphone data requires reference to the AWARE documentation as some fields are nominal data (i.e., screen status: 0 = off, 1 = on, 2 = locked, 3 = unlocked) and also depend on the type of phone that the participant has. The data processing for iPhones will not necessarily apply to that of Androids due to the available data. Even when the same type of sensor data is available for both types of smartphones, such as screen status, the detail of the data is higher on Android than on the iPhone.
2.1.3 Environmental Sensors. For the collection of environmental data, we deployed Awair Omni sensors as described in Table 1. An Awair Omni sensor was installed at the desk or location closest to the participant in the workspace. Figure 1 shows how Awair Omni sensors were installed for remote and in-person participants. The sampling frequency for the two different work contexts is also different; sensors in the office had a sampling frequency of ten seconds, while those in the home workspaces have a sampling frequency of five minutes. The environmental sensors in the office space are connected to the cloud and, through the Awair API, more granular data can be extracted. On the contrary, the sensors in homes could not be accessed by the API, so less granular data was extracted from the Awair dashboard. Each IEQ metric has associated recommended threshold values that can be used to analyze the collected data. As a way to limit and refine the data that is analyzed, location data from smartphones can be utilized to define the times that the participant is at their workspace (office or home) as opposed to being outside.
Surveys | Subjective Measures | |||
Baseline | Socio-Demographic [22] | Big-Five Inventory [19] | ||
Pre-Study | UCLA Loneliness Scale [31] | Flourishing Scale [12] | Multidimensional Scale of Perceived Social Support [43] | General Self-Efficacy [33] |
Monthly | Perceived Stress Scale [9, 10] | Pittsburg Sleep Quality Index [5] | ||
Bi-Weekly | PHQ-8 [21] | |||
Weekly | Productivity and Stress | General Health | ||
Daily | Sleep Rating | Social Interactions | Emotions |
2.1.4 Surveys. At the start of the study, a baseline survey was administered to participants to collect data on their sociodemographic status, personality, and psychological well-being through various standardized scales. Table 2 details the various subjective measures collected at different frequencies throughout the study. The baseline and pre-study was conducted once at the very start, which collected data that would not see much change during the course of the study. Five formal scales were used in the baseline and pre-study survey:
Weekly and daily surveys serve to collect more granular measures of sleep quality, stress, and productivity. More specifically, the weekly survey assesses the completion of tasks, the efficiency, satisfaction, and quality of the completed tasks, the time management, the workload, and the physical health. The daily check-in is a brief survey that is open from 9 am to 5 pm and evaluates overall sleep rating, frequency of trouble staying awake, and self-reports of when they went to bed and when they woke up that morning.
For the purposes of this paper, in proposing a sensing framework, most of the analysis is focused on responses to daily surveys. The daily surveys contain questions about the day before, which assess the frequency of difficulty staying awake, self-reported bedtime and wake-up time, sleep quality rating, physical activity, and social interactions. Additionally, it also assesses their current state with respect to a rating of their stress, productivity, and emotions.
As mentioned in 2.1.1, self-reported bedtime and wake-up time are very prone to errors, as participants overlook the option of AM and PM. Sleep observations from their Fitbit devices helped to correct the values. A histogram of responses can be plotted to assess the validity of this justification, which is as shown in our data. Therefore, missing data can be imputed with the most likely value, which is the default value of the slider. Daily surveys offer a subjective view of the data collected from the other sensors, which helps to understand the state and behavior of the occupants.
2.1.5 Pilot Study. A recruitment email was sent through the listserv to residents of the smart building space, which includes students, faculty, and staff. Fifteen participants were recruited between April and May 2022. Two participants dropped out. A majority of participants (n = 11) were graduate students, while the rest were faculty (n=2). There were four female and nine male participants, and the age distribution was as follows: 20-29 years old (n=8), 30-39 (n=4), and 50-59 (n=1). The countries of origin of the participants included the United States (n=5), China (n=2), Brazil, Iran, Sri Lanka, South Korea, Bangladesh and Egypt. Participants were compensated with Tango gift cards of up to $100 for two months, depending on compliance with data collection. The study was conducted from the end of April 2022 to July 2022. The study was approved by the Institutional Review Board for Social & Behavioral Sciences at the University of Virginia (IRB-SBS Protocol #2668). All individuals who participated in the study read and accepted the informed consent form. All procedures were carried out according to applicable guidelines and regulations.
For the purpose of this paper, we focus on the relationship between physical movement as a proxy for distraction and lack of productivity, and environmental factors, namely CO2, TVOC, and noise. More specifically, we are interested to know whether abrupt changes in CO2, TVOC, and noise are associated with increased physical activity measured through step count.
ParticipantID | Work | Role |
|
|
||||||
edr | Office | Graduate Student | 27 | 26 | ||||||
egl | Office | Graduate Student | 44 | 32 | ||||||
j02 | Home (Bedroom) | Graduate Student | 14 | 17 | ||||||
uja | Office | Graduate Student | 33 | 45 | ||||||
lpz | Home (Bedroom) | Graduate Student | 48 | 8 | ||||||
oyb | Office | Graduate Student | 19 | NA | ||||||
mr1 | Office | Graduate Student | 28 | 22 | ||||||
xil | Office | Graduate Student | 32 | 29 | ||||||
pgm | Office | Faculty | 0 | 11 | ||||||
h9u | Home | Graduate Student | 58 | 21 | ||||||
vxx | Office | Faculty | 6 | 15 | ||||||
heh | Home | Graduate Student | 53 | 34 | ||||||
ssg | Office | Graduate Student | 26 | 17 |
Table 3 shows the breakdown of each participant with respect to their primary place of work, role, and number of available observations for analysis. For two of the participants at home, their workspace is in their bedroom, so the environmental sensors are installed in their bedroom, as noted in Table 3. The merged sleep and survey observations were used for sleep validation, whereas the merged steps and IEQ data were used to perform the Bayesian change point analysis. The underlined values show which participants had less than 15 days of data and were subsequently excluded from the analysis.
Bayesian Change Points: To quantify the probability and presence of abrupt changes in the indoor environment measures and the physical activity of the occupant, we leverage Bayesian change points (BCP) detection analysis as described by Barry and Hartigan [4]. This model uses a probabilistic framework and product partition models to detect the point at which the mean changes. Using a change-point detector, we can detect the moments in the time series of an occupant's physical activity that can be associated with changes in the environment and vice versa. This has also been explored in previous studies using BCP for HR analysis [34]. We perform this process in R using the package bcp with default values [39]. Additionally, due to the presence of numerous change points, as evidenced by the posterior probability peaks, we utilized the scipy package in Python to attenuate noise and identify the local maxima of these peaks.
We applied Bayesian change point analysis to examine physical activity (steps), CO2 levels, noise, and TVOC data across ten participants due to the availability of data. The ten participants are divided based on their working location for analysis purposes – in office (n = 7) and at home (n = 3). We investigated possible associations between workplace environmental changes and physical activity patterns, as indicated by step counts, of occupants. Also, note that Bayesian change point analysis was conducted separately for those who worked remote and in person due to the different contexts and sampling frequency. For participants who primarily work from home, it becomes uncertain whether they are in their workspace near the environmental sensor or not. In comparison, for those who work primarily in office, when the location data show that they are in the office, they are more likely to be at their desk.
3 RESULTS
3.1 Sleep Quality Validation
In the sleep quality analysis, three participants were exempted since they did not have at least 15 sleep observations, as indicated by an underline in Table 3. In Figure 2, we compare the subjective sleep rating of the participant with the observed TST, which resulted in an overall Pearson correlation coefficient r = 0.2497, p < 0.001, with a 95% confidence interval of [0.1502, 0.3493]. Self-reported sleep times were cross-referenced with the sleep cycles observed by smart wearables, serving as a mutual validation method. Approximately 53.3% of all sleep observations in the 10 participants met the recommended sleep of seven to nine hours and 33% met the recommended REM ratio of 0.25 to 0.33.
Window | Steps | CO2 | Noise | TVOC | |||||
CO2 | Noise | TVOC | Noise | TVOC | CO2 | TVOC | CO2 | Noise | |
10 min. | 0.191 | 0.275 | 0.220 | 0.235 | 0.231 | 0.236 | 0.073 | 0.125 | 0.178 |
20 min. | 0.276 | 0.422 | 0.338 | 0.469 | 0.412 | 0.488 | 0.174 | 0.256 | 0.410 |
30 min. | 0.324 | 0.533 | 0.433 | 0.652 | 0.556 | 0.653 | 0.283 | 0.362 | 0.545 |
3.2 Working in Office
We examined the relationships between physical activity and IEQ metrics using different window sizes centered on observed time points and calculated the proportion of change points in a reference metric (first-level header) that were concurrent with change points in another metric (second-level header), as seen in Table 4. Figure 3a illustrates the simultaneous behavior of various metrics for one of the participants, who works mainly in an office. The dotted lines indicate the change points, which makes it evident that the change points for the different metrics occur within a window of time from each other.
With respect to physical activity (steps), it can be discerned that noise levels exhibited the highest incidence of coinciding change points, which indicates that noise levels were particularly likely to undergo simultaneous changes when abrupt changes in physical activity were observed, ranging from 27.5% to 53.3% as shown in Table 4. This was followed by TVOC change points occurring simultaneously with 22% of step count changes when using a 10 minute window and 33. 8% and 43. 3% at 20 and 30 minute windows, respectively. Lastly, the changes in CO2 occur simultaneously with 19. 1% of the changes in step count in a 10-minute window and 27.6 %, and 32.4 % in a 20 and 30 minute window, respectively. Of the CO2 change points, 46.9% coincided with the change points in noise and 41.2% coincided with TVOC, in a 20 minute window. With TVOC as the reference metric, noise has the highest rate of change points at around 41%, compared to CO2 at 25.6% in a 20 minute window.
Window | Steps | CO2 | Noise | TVOC | |||||
CO2 | Noise | TVOC | Noise | TVOC | CO2 | TVOC | CO2 | Noise | |
15 min. | 0.034 | 0.076 | 0.060 | 0.109 | 0.200 | 0.120 | 0.114 | 0.190 | 0.081 |
25 min. | 0.119 | 0.150 | 0.125 | 0.181 | 0.263 | 0.180 | 0.169 | 0.238 | 0.152 |
35 min. | 0.174 | 0.221 | 0.168 | 0.266 | 0.317 | 0.238 | 0.206 | 0.269 | 0.247 |
3.3 Working at Home
For work-from-home participants, we used the step data that were detected to be at home to merge with the IEQ data. The data frequency is with a 5-minute interval, as opposed to a 1-minute interval. Noise had the highest rate of change points when steps were the reference metric, with 7.6%, 15%, and 22.1% in 15, 25, and 35 minute windows, respectively, as shown in Table 5. CO2 exhibited similar but slightly higher proportions of coincident change points than TVOC among change points in steps. Compared to CO2 as the benchmark, TVOC had a higher frequency of simultaneous change points ranging from 20% to 31.7%, while noise had a range of 10.9% to 26.6%. Of the noise change points, the CO2 change points coincided at a slightly higher rate compared to TVOC. Of the TVOC change points, 23.8% coincided with the change points in CO2 and 15.2% coincided with noise, in a 25 minute window. Figure 3b shows the metrics over time for a participant who primarily works from home. The metrics show no change points until about 8 AM in steps and VOC and after about 10 PM, which was when Fitbit had observed that the participant had woke up at about 7 AM that morning and went to bed a little past 10 PM that night.
4 DISCUSSION
This study introduced and tested a framework to analyze the effect of environmental factors on occupant state changes in the wild. Through the framework, longitudinal studies can be conducted and replicated with ease. This framework is characterized by the systematic integration of diverse data collection methods, each contributing unique dimensions of information. It encompasses a structured methodology for data acquisition, synchronization, and analysis, all embedded within a comprehensive sensor infrastructure.
In the pilot study, we employed the framework in a real-world scenario, which allowed us to examine various aspects of sleep patterns, IEQ, and physical activity in a dynamic workplace setting. Our findings revealed a positive linear relationship (r = 0.2497, 95% CI of [0.1502, 0.3493]) between subjective sleep ratings and observed TST, establishing the reliability of smart wearables to detect sleep. Sleep detection within smartwatches is not completely reliable, but can also be cross-referenced with screen use that is collected by the Aware mobile application. The validation of sleep data is only one example of the different validation checks that should be performed.
The application of using Bayesian change point analysis explores the environmental triggers to human behavior changes as indicated by their movement. The results, in both the office and home participant data, indicate that often when there is a change in physical state of the occupant, such as from rest to active, it tends to be accompanied by a respective change point in noise data. The in-office data has shown higher proportions of coincident change points between CO2, TVOC, and noise than those observed in the work-from-home participants, which can be attributed to the increased granularity of the office data. These findings emphasize the intricate relationship between environmental factors and human behavior in the workplace, which aligns with previous research on IEQ, occupant satisfaction, and productivity [16, 24, 28]. Although physical activity may indicate distraction, we cannot definitively link these changes to work-related activities without more comprehensive data, which can be collected through Ecological Momentary Assessments (EMA). EMAs can enrich the understanding of environmental and physiological data while minimizing recall bias in participants [41]. Additional ground truth combined with the data could help produce a distraction measure for the workplace, revealing information on the impact of the built environment on the focus of the occupants [37]. This highlights the need for responsible data collection and awareness of privacy, as many occupants are unaware of the inferences that can be drawn from seemingly harmless sensors, such as IEQ sensors [23, 42].
Due to the number of surveys and the short frequency in between, the compliance of some surveys was fairly low. The average compliance for the surveys is as follows: monthly (73.1%), biweekly (77.7%), weekly (69.9%), and daily (73.5%). However, only two monthly surveys were administered to each person due to the short duration of the study, and only one bi-weekly survey was administered due to technical difficulties. However, the research team strived to make the questions in the daily survey as brief as possible to minimize survey fatigue [29]. Participant stress and productivity were each surveyed with a single-question Likert scale. While this approach minimized survey fatigue, it revealed the unreliability of current measurement methods. Stress and productivity, intricate and context-dependent constructs, are difficult to capture accurately using Likert scales, which are susceptible to response bias, interpretation challenges, and limited in capturing the nuances of participant experiences. Future research should consider the refinement of survey methodologies to mitigate these challenges.
When considering each modality individually, it became evident that some participants lacked sufficient data for each modality for a robust analysis. This discrepancy arose from variations in the availability of data, as certain participants had more data in one modality and less in another, making it more challenging to establish connections and discern relationships. This situation not only underscores the importance of careful data handling and statistical approaches to account for this variability, but also highlights the critical need for consistent data monitoring throughout the study to address and mitigate data discrepancies as they arise. Many of the limitations discussed so far can also be addressed with the transition from surveys to EMAs [1, 26, 36].
Our pilot study explored the intricate relationship between environmental and behavioral factors in dynamic workplace settings. The objective of the framework is to explicitly consider the impact of Cyber-Physical Systems (CPS) on social objectives such as productivity and well-being. By investigating how workplace environments influence the two, we contribute to understanding how CPSISs can be harnessed to enhance user experiences and improve social outcomes. This preliminary research confirmed the feasibility of employing surveys, smart wearables, environmental sensors, and passive smartphone sensing in a naturalistic, multi-modal approach to monitor occupant states and behaviors within smart office settings. Furthermore, the pilot study laid the foundation for future in-depth examinations of how workplace conditions impact occupants and the role of individual differences in shaping these effects, emphasizing the need to address potential social inequities. The versatility and adaptability of this framework further underscore its suitability for conducting repeated studies with diverse research objectives, opening doors for a wide range of investigations into workplace well-being, productivity, and the dynamic interplay between environmental factors and human behavior. The framework can also be used to study the privacy implications of collected data and how facilities can prioritize responsible data collection, operate with transparency and accountability, and safeguard user privacy while harnessing the potential of smart sensing technologies for the betterment of occupants.
5 FUTURE WORK
The pilot study has shed light on the intricate dynamics between workplace factors, human behavior, and well-being. As we look ahead, there are several promising avenues for future research. Future research can refine survey methodologies, moving beyond Likert scales to capture nuanced constructs such as stress and productivity and improvements to minimize missing data and response bias. Furthermore, research should explore the practical applications of our findings in workplace design and interventions, including that of occupant privacy. Advanced data integration and analysis techniques can address data discrepancies, and ethical considerations surrounding data privacy must be paramount. By pursuing these avenues, we can build on this foundation and contribute to developing evidence-based strategies to improve employee well-being and productivity in dynamic workplace environments.
ACKNOWLEDGMENTS
This paper is based on work supported by the National Science Foundation (NSF) Research Traineeship (NRT) under Grant No.182900 and NSF Grant No. 1823325 and was also partially supported by the Virginia Commonwealth Cyber Initiative (CCI). The authors thank UVA Link Lab for providing support and resources to enable this project, including Alex Zummo for his help with onboarding participants. We also thank Feng Yi Chang for his help with troubleshooting and improving the sensing infrastructure.
REFERENCES
- Michael F. Armey, Heather T. Schatten, Natasha Haradhvala, and Ivan W. Miller. 2015. Ecological momentary assessment (EMA) of depression-related phenomena. Current Opinion in Psychology 4 (8 2015), 21–25. https://doi.org/10.1016/J.COPSYC.2015.01.002
- Mohamad Awada, Burcin Becerik-Gerber, Simi Hoque, Zheng O'Neill, Giulia Pedrielli, Jin Wen, and Teresa Wu. 2021. Ten questions concerning occupant health in buildings during normal operations and extreme events including the COVID-19 pandemic. Building and Environment 188 (1 2021), 107480. https://doi.org/10.1016/j.buildenv.2020.107480
- AWARE. 2022. AWARE – Open-source Context Instrumentation Framework For Everyone. https://awareframework.com/
- Daniel Barry and J. A. Hartigan. 1993. A Bayesian Analysis for Change Point Problems. J. Amer. Statist. Assoc. 88 (3 1993), 309–319. Issue 421. https://doi.org/10.1080/01621459.1993.10594323
- Daniel J. Buysse, Charles F. Reynolds, Timothy H. Monk, Susan R. Berman, and David J. Kupfer. 1989. The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry research 28, 2 (1989), 193–213. https://doi.org/10.1016/0165-1781(89)90047-4
- Matthew Caruso, Jason Jabbour, Caleb Neale, Alden Summerville, Avery Walters, Arsalan Heydarian, Arthur Small, and Mahsa Pahlavikhah Varnosfaderani. 2022. Developing a Dynamic Control Algorithm to Improve Ventilation Efficiency in a University Conference Room. In 2022 Systems and Information Engineering Design Symposium (SIEDS). IEEE, Charlottesville, VA, USA, 145–150. https://doi.org/10.1109/SIEDS55548.2022.9799313
- J. G. Cedenõ-Laurent, A. Williams, P. MacNaughton, X. Cao, E. Eitland, J. Spengler, and J. Allen. 2018. Building Evidence for Health: Green Buildings, Current Science, and Future Challenges. Annual Review of Public Health 39 (4 2018), 291–308. https://doi.org/10.1146/ANNUREV-PUBLHEALTH-031816-044420
- Giorgia Chinazzo, Rune Korsholm Andersen, Elie Azar, Verena M. Barthelmes, Cristina Becchio, Lorenzo Belussi, Christiane Berger, Salvatore Carlucci, Stefano Paolo Corgnati, Sarah Crosby, Ludovico Danza, Luiza de Castro, Matteo Favero, Stephanie Gauthier, Runa T. Hellwig, Quan Jin, Joyce Kim, Mandana Sarey Khanie, Dolaana Khovalyg, Carola Lingua, Alessandra Luna-Navarro, Ardeshir Mahdavi, Clayton Miller, Isabel Mino-Rodriguez, Ilaria Pigliautile, Anna Laura Pisello, Ricardo Forgiarini Rupp, Abdul Manan Sadick, Francesco Salamone, Marcel Schweiker, Marc Syndicus, Giorgia Spigliantini, Natalia Giraldo Vasquez, Donna Vakalis, Marika Vellei, and Shen Wei. 2022. Quality criteria for multi-domain studies in the indoor environment: Critical review towards research guidelines and recommendations. Building and Environment 226 (12 2022), 109719. https://doi.org/10.1016/j.buildenv.2022.109719
- Sheldon Cohen. 1994. Perceived Stress Scale. www.mindgarden.com
- S. Cohen, T. Kamarck, and R. Mermelstein. 1983. A global measure of perceived stress. Journal of health and social behavior 24 (12 1983), 385–396. Issue 4. https://doi.org/10.2307/2136404
- Maarten De Groote, Jonathan Volt, and Frances Bean. 2017. Smart Buildings Decoded. Technical Report. Buildings Performance Institute Europe (BPIE). www.bpie.eu
- Ed Diener, Derrick Wirtz, William Tov, Chu Kim-Prieto, Dong won Choi, Shigehiro Oishi, and Robert Biswas-Diener. 2010. New well-being measures: Short scales to assess flourishing and positive and negative feelings. Social Indicators Research 39, 2 (2010), 247266. https://doi.org/10.1007/S11205-009-9493-Y
- Bing Dong, Romana Markovic, Salvatore Carlucci, Yapan Liu, Andreas Wagner, Antonio Liguori, Christoph van Treeck, Dmitry Oleynikov, Elie Azar, Gianmarco Fajilla, Ján Drgoňa, Joyce Kim, Marika Vellei, Marilena De Simone, Masood Shamsaiee, Mateus Bavaresco, Matteo Favero, Mikkel Kjaergaard, Mohamed Osman, Moritz Frahm, Sanam Dabirian, Da Yan, and Xuyuan Kang. 2022. A guideline to document occupant behavior models for advanced building controls. Building and Environment 219 (7 2022), 109195. https://doi.org/10.1016/j.buildenv.2022.109195
- Fitbit. 2023. What should I know about Fitbit sleep stages?https://help.fitbit.com/articles/en_US/Help_article/2163.htm
- Hagen Fritz, Kerry A. Kinney, Congyu Wu, David M. Schnyer, and Zoltan Nagy. 2022. Data fusion of mobile and environmental sensing devices to understand the effect of the indoor environment on measured and self-reported sleep quality. Building and Environment 214 (4 2022), 108835. https://doi.org/10.1016/j.buildenv.2022.108835
- M. Frontczak, S. Schiavon, J. Goins, E. Arens, H. Zhang, and P. Wargocki. 2012. Quantitative relationships between occupant satisfaction and satisfaction aspects of indoor environmental quality and building design. Indoor Air 22 (4 2012), 119–131. Issue 2. https://doi.org/10.1111/J.1600-0668.2011.00745.X
- Ana Allen Gomes, José Tavares, and Maria Helena P. de Azevedo. 2011. Sleep and academic performance in undergraduates: a multi-measure, multi-predictor approach. Chronobiol Int 28 (11 2011), 786–801. Issue 9. https://doi.org/10.3109/07420528.2011.606518
- Milica Gomzi and Jasminka Bobic. 2009. SICK BUILDING SYNDROME - Do we live and work in unhealthy environment?Periodicum Biologorum 111, 1 (2009), 79–84.
- Oliver P John and Sanjay Srivastava. 1999. The Big-Five Trait Taxonomy: History, Measurement, and Theoretical Perspectives. In Handbook of personality: Theory and research, Lawrence A. Pervin and O.P John (Eds.). Guilford Press, New York, 102–138.
- Ruzena Kralikova and Emil Wessely. 2018. Impact of the Environmental Factors and its Effects on Productivity and Health. In 29th DAAAM International Symposium on Intelligent Manufacturing and Automation. DAAAM International, Vienna, Austria, 0119–0124. https://doi.org/10.2507/29th.daaam.proceedings.016
- Kurt Kroenke, Tara W. Strine, Robert L. Spitzer, Janet B.W. Williams, Joyce T. Berry, and Ali H. Mokdad. 2009. The PHQ-8 as a measure of current depression in the general population. Journal of affective disorders 114, 1-3 (4 2009), 163–173. https://doi.org/10.1016/J.JAD.2008.06.026
- Tu Le, Alan Wang, Yaxing Yao, Yuanyuan Feng, Arsalan Heydarian, Norman Sadeh, and Yuan Tian. 2023. Exploring Smart Commercial Building Occupants’ Perceptions and Notification Preferences of Internet of Things Data Collection in the United States. In 2023 IEEE 8th European Symposium on Security and Privacy (EuroS&P). IEEE, Delft, Netherlands, 1030–1046. https://doi.org/10.1109/EuroSP57164.2023.00064
- B. Li, A. Tavakoli, and A. Heydarian. 2023. Occupant privacy perception, awareness, and preferences in smart office environments. Scientific Reports 13 (2023), 1–11. Issue 1. https://doi.org/10.1038/s41598-023-30788-5
- Dusan Licina and Serra Yildirim. 2021. Occupant satisfaction with indoor environmental quality, sick building syndrome (SBS) symptoms and self-reported productivity before and after relocation into WELL-certified office buildings. Building and Environment 204 (10 2021), 108183. https://doi.org/10.1016/j.buildenv.2021.108183
- Rainer Lutze. 2018. Practicality of Smartwatch Apps for Supporting Elderly People – A Comprehensive Survey. In 2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC). IEEE, Stuttgart, Germany, 1–7. https://doi.org/10.1109/ICE.2018.8436370
- Gonzalo J. Martinez, Ted Grover, Stephen M. Mattingly, Gloria Mark, Sidney D'Mello, Talayeh Aledavood, Fatema Akbar, Pablo Robles-Granda, and Aaron Striegel. 2022. Alignment Between Heart Rate Variability From Fitness Trackers and Perceived Stress: Perspectives From a Large-Scale In Situ Longitudinal Study of Information Workers. JMIR Hum Factors 2022;9(3):e33754 https://humanfactors.jmir.org/2022/3/e33754 9 (8 2022), e33754. Issue 3. https://doi.org/10.2196/33754
- Institute of Medicine. 2006. Sleep Disorders and Sleep Deprivation. National Academies Press, Washington, D.C. 1–404 pages. https://doi.org/10.17226/11617
- Jegar Pitchforth, Elizabeth Nelson-White, Marc Van Den Helder, and Wouter Oosting. 2020. The work environment pilot: An experiment to determine the optimal office design for a technology company. PLOS ONE 15 (5 2020), e0232943. Issue 5. https://doi.org/10.1371/JOURNAL.PONE.0232943
- Stephen R. Porter, Michael E. Whitcomb, and William H. Weitzer. 2004. Multiple surveys of students and survey fatigue. New Directions for Institutional Research 2004, 121 (1 2004), 63–73. https://doi.org/10.1002/IR.101
- R. Runeson, D. Norbäck, B. Klinteberg, and C. Edling. 2004. The influence of personality, measured by the Karolinska Scales of Personality (KSP), on symptoms among subjects in suspected sick buildings. Indoor Air 14, 6 (10 2004), 394–404. https://doi.org/10.1111/J.1600-0668.2004.00261.X
- Daniel W. Russell. 1996. UCLA Loneliness Scale (Version 3): Reliability, Validity, and Factor Structure. Journal of Personality Assessment 66, 1 (1996), 20–40. https://doi.org/10.1207/S15327752JPA6601_2
- Stanislaw Saganowski, Przemyslaw Kazienko, Maciej Dziezyc, Patrycja Jakimow, Joanna Komoszynska, Weronika Michalska, Anna Dutkowiak, Adam Polak, Adam Dziadek, and Michal Ujma. 2020. Consumer Wearables and Affective Computing for Wellbeing Support. In MobiQuitous 2020 - 17th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services. ACM, New York, NY, USA, 482–487. https://doi.org/10.1145/3448891.3450332
- Mark Sherer, James E. Maddux, Blaise Mercandante, Steven Prentice-Dunn, Beth Jacobs, and Ronald W. Rogers. 1982. The Self-Efficacy Scale: Construction and Validation:. Psychological Reports 51, 2 (10 1982), 663–671. https://doi.org/10.2466/PR0.1982.51.2.663
- Arash Tavakoli, Shashwat Kumar, Xiang Guo, Vahid Balali, Mehdi Boukhechba, and Arsalan Heydarian. 2021. HARMONY: A Human-Centered Multimodal Driving Study in the Wild. IEEE Access 9 (2021), 23956–23978. https://doi.org/10.1109/ACCESS.2021.3056007
- Thuan Quoc Thach, Dhiya Mahirah, Gerard Dunleavy, Nuraini Nazeha, Yichi Zhang, Christina En Hui Tan, Adam Charles Roberts, George Christopoulos, Chee Kiong Soh, and Josip Car. 2019. Prevalence of sick building syndrome and its association with perceived indoor environmental quality in an Asian multi-ethnic working population. Building and Environment 166 (12 2019), 106420. https://doi.org/10.1016/J.BUILDENV.2019.106420
- Sofia Triantafillou, Sohrab Saeb, Emily G. Lattie, David C. Mohr, and Konrad Paul Kording. 2019. Relationship Between Sleep Quality and Mood: Ecological Momentary Assessment Study. JMIR Mental Health 6, 3 (3 2019), e12613. https://doi.org/10.2196/12613
- Mahsa Pahlavikhah Varnosfaderani, Arsalan Heydarian, and Farrokh Jazizadeh. 2021. Using Statistical Models to Detect Occupancy in Buildings through Monitoring VOC, CO2, and Other Environmental Factors. In Computing in Civil Engineering 2021. American Society of Civil Engineers, Orlando, FL, 705–712. https://doi.org/10.1061/9780784483893.087
- Mengmeng Wang, Lili Li, Caixia Hou, Xiaotong Guo, and Hanliang Fu. 2022. Building and Health: Mapping the Knowledge Development of Sick Building Syndrome. Buildings 12, 3 (3 2022), 287. https://doi.org/10.3390/buildings12030287
- Xiaofei Wang, Chandra Erdman, and John W Emerson. 2022. Bayesian Analysis of Change Point Problems.
- Hongyi Wen, Michael Sobolev, Rachel Vitale, James Kizer, J P Pollak, Frederick Muench, and Deborah Estrin. 2021. mPulse Mobile Sensing Model for Passive Detection of Impulsive Behavior: Exploratory Prediction Study. JMIR Mental Health 8 (1 2021), e25019. Issue 1. https://doi.org/10.2196/25019
- Yong Sook Yang, Gi Wook Ryu, Insu Han, Seojin Oh, and Mona Choi. 2018. Ecological Momentary Assessment Using Smartphone-Based Mobile Application for Affect and Stress Assessment. Healthcare Informatics Research 24 (10 2018), 381–386. Issue 4. https://doi.org/10.4258/HIR.2018.24.4.381
- Serena Zheng, Noah Apthorpe, Marshini Chetty, and Nick Feamster. 2018. User Perceptions of Smart Home IoT Privacy. Proceedings of the ACM on Human-Computer Interaction 2 (11 2018), 1–20. Issue CSCW. https://doi.org/10.1145/3274469
- Gregory D. Zimet, Nancy W. Dahlem, Sara G. Zimet, and Gordon K. Farley. 1988. The Multidimensional Scale of Perceived Social Support. Journal of Personality Assessment 52, 1 (1988), 30–41. https://doi.org/10.1207/S15327752JPA5201_2
This work is licensed under a Creative Commons Attribution International 4.0 License.
BuildSys '23, November 15, 16, 2023, Istanbul, Turkey
© 2023 Copyright held by the owner/author(s).
ACM ISBN 979-8-4007-0230-3/23/11.
DOI: https://doi.org/10.1145/3600100.3626344