The University of Southampton
University of Southampton Institutional Repository

Assessment of the psychometric properties of the mask usability scale: a measure of the perceived usability of N95 respirators among healthcare students and staff

Assessment of the psychometric properties of the mask usability scale: a measure of the perceived usability of N95 respirators among healthcare students and staff
Assessment of the psychometric properties of the mask usability scale: a measure of the perceived usability of N95 respirators among healthcare students and staff

Aim: to test the reliability and construct validity of the Mask Usability Scale in healthcare students and staff. 

Design: a methodological study involving repeated measures. 

Methods: the study included two batches of participants: (1) 283 university nursing students and (2) 1753 participants composed of students (61%) and clinical staff (39%). All participants underwent N95 respirator fit tests and user seal checks. They also responded to the Mask Usability Scale, which comprises 11 items evaluated using Likert scales. The internal consistency was assessed using Cronbach's alpha and item–total correlation test. Test–retest reliability was evaluated by the intraclass correlation coefficient (ICC). The factor structure was initially identified through exploratory factor analysis (EFA), laying the groundwork for the model. This approach was followed by confirmatory factor analysis (CFA) to ensure the model fits with the standardised solution. 

Results: excluding items 9, 10 and 11, the study showed satisfactory internal consistency, evidenced by a Cronbach's alpha of 0.842 for the eight-item scale from the combined samples. Factors, such as ‘Heat’, ‘Breathability’, ‘Tightness’ and ‘Ease in talking’ showed moderate to strong correlations. The test–retest reliability in the batch one sample was acceptable with ICCs ranging between 0.69 and 0.71 for different models. The EFA and fit indices supported a two-factor structure. The first factor ‘Comfort and Usage’ included ‘Heat’, ‘Breathability’, ‘Tightness’, ‘Ease in talking’ and ‘Prolonged use’, which were keys for the usability of N95 respirators. The second factor ‘Suitability’ encompassed ‘Itchy’, ‘Easily displaced’ and ‘Ear soreness’. The variance explained by the first and second factors was 49% and 12%, respectively, with a strong inter-factor correlation. The CFA results were satisfactory with fit metrics (NFI = 0.967, IFI = 0.969, TLI = 0.952, CFI = 0.969, RMSEA = 0.078 with 90% CI [0.069, 0.086] and p < 0.001) and a chi-squared to df ratio of 13.58. Conclusion: The eight-item mask usability scale exhibited satisfactory internal consistency and construct validity in both healthcare student and staff samples. 

Implications for the Profession and/or Patient Care: the primary concern in the purchase policy of N95 respirators for clinical use is to strike the right balance between usability and fit rate (passing % of fit testing). Our study solidified the concept of quantifying the usability of respirators. With that mask usability scale measurement, a provision of benchmark and reference for the design and selection of respirators would be possible. This validated scale has significant implications for senior management in clinical settings and respirator manufacturers regarding the N95 respirator purchase policy and design. 

Impact: the results indicated the psychometric properties of mask usability scale in measuring the usability of N95 respirators. This scale is particularly valuable for assessing the perceptions of healthcare students and staff of factors, namely, ‘Heat’, ‘Breathability’, ‘Tightness’, ‘Ease in talking’, ‘Prolonged use’, ‘Itchy’, ‘Easily displaced’ and ‘Ear soreness’ concerning the use of N95 respirators. Reporting 

Method: we adhered to EQUATOR guidelines following the STROBE statement. Patient or Public Contribution: No patient or public contribution. Trial Registration: ISRCTN registry: ISRCTN40115047.

health care, N95 respirators, psychometrics, usability, validation
0309-2402
Suen, Lorna Kwai Ping
3927a819-69fb-4681-8d9b-0aad1be7faff
Kwok, Wai Hang
9c2e53ce-2fd5-42a7-b96f-4bdb0fc9075d
Yu, Ignatius Tak Sun
116df660-8d71-407a-aa0a-a9eee85b5089
So, Sony Nai Yeung
40126d5e-1738-4323-93b3-f07cb6b416d0
Cheung, Kin
0ea00a3c-505c-4da0-bfe6-581bdddac5d8
Lee, Paul Hong
02620eab-ae7f-4a1c-bad1-8a50e7e48951
Ho, Lily Yuen Wah
25f4653f-6f57-4943-939b-e87281cd5687
Ko, Ka Yan
37fff326-9cc5-4312-a52f-aea7eb13df30
Ho, Sukki
8c0d6f4f-0801-413c-b5f1-faef88e06ef2
Lam, Simon Ching
72f4d1ac-b686-4044-ac7d-677205dd25cf
Suen, Lorna Kwai Ping
3927a819-69fb-4681-8d9b-0aad1be7faff
Kwok, Wai Hang
9c2e53ce-2fd5-42a7-b96f-4bdb0fc9075d
Yu, Ignatius Tak Sun
116df660-8d71-407a-aa0a-a9eee85b5089
So, Sony Nai Yeung
40126d5e-1738-4323-93b3-f07cb6b416d0
Cheung, Kin
0ea00a3c-505c-4da0-bfe6-581bdddac5d8
Lee, Paul Hong
02620eab-ae7f-4a1c-bad1-8a50e7e48951
Ho, Lily Yuen Wah
25f4653f-6f57-4943-939b-e87281cd5687
Ko, Ka Yan
37fff326-9cc5-4312-a52f-aea7eb13df30
Ho, Sukki
8c0d6f4f-0801-413c-b5f1-faef88e06ef2
Lam, Simon Ching
72f4d1ac-b686-4044-ac7d-677205dd25cf

Suen, Lorna Kwai Ping, Kwok, Wai Hang, Yu, Ignatius Tak Sun, So, Sony Nai Yeung, Cheung, Kin, Lee, Paul Hong, Ho, Lily Yuen Wah, Ko, Ka Yan, Ho, Sukki and Lam, Simon Ching (2024) Assessment of the psychometric properties of the mask usability scale: a measure of the perceived usability of N95 respirators among healthcare students and staff. Journal of Advanced Nursing. (doi:10.1111/jan.16590).

Record type: Article

Abstract

Aim: to test the reliability and construct validity of the Mask Usability Scale in healthcare students and staff. 

Design: a methodological study involving repeated measures. 

Methods: the study included two batches of participants: (1) 283 university nursing students and (2) 1753 participants composed of students (61%) and clinical staff (39%). All participants underwent N95 respirator fit tests and user seal checks. They also responded to the Mask Usability Scale, which comprises 11 items evaluated using Likert scales. The internal consistency was assessed using Cronbach's alpha and item–total correlation test. Test–retest reliability was evaluated by the intraclass correlation coefficient (ICC). The factor structure was initially identified through exploratory factor analysis (EFA), laying the groundwork for the model. This approach was followed by confirmatory factor analysis (CFA) to ensure the model fits with the standardised solution. 

Results: excluding items 9, 10 and 11, the study showed satisfactory internal consistency, evidenced by a Cronbach's alpha of 0.842 for the eight-item scale from the combined samples. Factors, such as ‘Heat’, ‘Breathability’, ‘Tightness’ and ‘Ease in talking’ showed moderate to strong correlations. The test–retest reliability in the batch one sample was acceptable with ICCs ranging between 0.69 and 0.71 for different models. The EFA and fit indices supported a two-factor structure. The first factor ‘Comfort and Usage’ included ‘Heat’, ‘Breathability’, ‘Tightness’, ‘Ease in talking’ and ‘Prolonged use’, which were keys for the usability of N95 respirators. The second factor ‘Suitability’ encompassed ‘Itchy’, ‘Easily displaced’ and ‘Ear soreness’. The variance explained by the first and second factors was 49% and 12%, respectively, with a strong inter-factor correlation. The CFA results were satisfactory with fit metrics (NFI = 0.967, IFI = 0.969, TLI = 0.952, CFI = 0.969, RMSEA = 0.078 with 90% CI [0.069, 0.086] and p < 0.001) and a chi-squared to df ratio of 13.58. Conclusion: The eight-item mask usability scale exhibited satisfactory internal consistency and construct validity in both healthcare student and staff samples. 

Implications for the Profession and/or Patient Care: the primary concern in the purchase policy of N95 respirators for clinical use is to strike the right balance between usability and fit rate (passing % of fit testing). Our study solidified the concept of quantifying the usability of respirators. With that mask usability scale measurement, a provision of benchmark and reference for the design and selection of respirators would be possible. This validated scale has significant implications for senior management in clinical settings and respirator manufacturers regarding the N95 respirator purchase policy and design. 

Impact: the results indicated the psychometric properties of mask usability scale in measuring the usability of N95 respirators. This scale is particularly valuable for assessing the perceptions of healthcare students and staff of factors, namely, ‘Heat’, ‘Breathability’, ‘Tightness’, ‘Ease in talking’, ‘Prolonged use’, ‘Itchy’, ‘Easily displaced’ and ‘Ear soreness’ concerning the use of N95 respirators. Reporting 

Method: we adhered to EQUATOR guidelines following the STROBE statement. Patient or Public Contribution: No patient or public contribution. Trial Registration: ISRCTN registry: ISRCTN40115047.

Text
Journal of Advanced Nursing - 2024 - Suen - Assessment of the Psychometric Properties of the Mask Usability Scale A - Version of Record
Download (1MB)

More information

Accepted/In Press date: 17 October 2024
e-pub ahead of print date: 17 November 2024
Keywords: health care, N95 respirators, psychometrics, usability, validation

Identifiers

Local EPrints ID: 497375
URI: http://eprints.soton.ac.uk/id/eprint/497375
ISSN: 0309-2402
PURE UUID: 32244674-dcab-45e9-8f17-95eca81591f1
ORCID for Paul Hong Lee: ORCID iD orcid.org/0000-0002-5729-6450

Catalogue record

Date deposited: 21 Jan 2025 17:45
Last modified: 22 Aug 2025 02:37

Export record

Altmetrics

Contributors

Author: Lorna Kwai Ping Suen
Author: Wai Hang Kwok
Author: Ignatius Tak Sun Yu
Author: Sony Nai Yeung So
Author: Kin Cheung
Author: Paul Hong Lee ORCID iD
Author: Lily Yuen Wah Ho
Author: Ka Yan Ko
Author: Sukki Ho
Author: Simon Ching Lam

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×