Assessment of the psychometric properties of the mask usability scale: a measure of the perceived usability of N95 respirators among healthcare students and staff
Assessment of the psychometric properties of the mask usability scale: a measure of the perceived usability of N95 respirators among healthcare students and staff
Aim: to test the reliability and construct validity of the Mask Usability Scale in healthcare students and staff.
Design: a methodological study involving repeated measures.
Methods: the study included two batches of participants: (1) 283 university nursing students and (2) 1753 participants composed of students (61%) and clinical staff (39%). All participants underwent N95 respirator fit tests and user seal checks. They also responded to the Mask Usability Scale, which comprises 11 items evaluated using Likert scales. The internal consistency was assessed using Cronbach's alpha and item–total correlation test. Test–retest reliability was evaluated by the intraclass correlation coefficient (ICC). The factor structure was initially identified through exploratory factor analysis (EFA), laying the groundwork for the model. This approach was followed by confirmatory factor analysis (CFA) to ensure the model fits with the standardised solution.
Results: excluding items 9, 10 and 11, the study showed satisfactory internal consistency, evidenced by a Cronbach's alpha of 0.842 for the eight-item scale from the combined samples. Factors, such as ‘Heat’, ‘Breathability’, ‘Tightness’ and ‘Ease in talking’ showed moderate to strong correlations. The test–retest reliability in the batch one sample was acceptable with ICCs ranging between 0.69 and 0.71 for different models. The EFA and fit indices supported a two-factor structure. The first factor ‘Comfort and Usage’ included ‘Heat’, ‘Breathability’, ‘Tightness’, ‘Ease in talking’ and ‘Prolonged use’, which were keys for the usability of N95 respirators. The second factor ‘Suitability’ encompassed ‘Itchy’, ‘Easily displaced’ and ‘Ear soreness’. The variance explained by the first and second factors was 49% and 12%, respectively, with a strong inter-factor correlation. The CFA results were satisfactory with fit metrics (NFI = 0.967, IFI = 0.969, TLI = 0.952, CFI = 0.969, RMSEA = 0.078 with 90% CI [0.069, 0.086] and p < 0.001) and a chi-squared to df ratio of 13.58. Conclusion: The eight-item mask usability scale exhibited satisfactory internal consistency and construct validity in both healthcare student and staff samples.
Implications for the Profession and/or Patient Care: the primary concern in the purchase policy of N95 respirators for clinical use is to strike the right balance between usability and fit rate (passing % of fit testing). Our study solidified the concept of quantifying the usability of respirators. With that mask usability scale measurement, a provision of benchmark and reference for the design and selection of respirators would be possible. This validated scale has significant implications for senior management in clinical settings and respirator manufacturers regarding the N95 respirator purchase policy and design.
Impact: the results indicated the psychometric properties of mask usability scale in measuring the usability of N95 respirators. This scale is particularly valuable for assessing the perceptions of healthcare students and staff of factors, namely, ‘Heat’, ‘Breathability’, ‘Tightness’, ‘Ease in talking’, ‘Prolonged use’, ‘Itchy’, ‘Easily displaced’ and ‘Ear soreness’ concerning the use of N95 respirators. Reporting
Method: we adhered to EQUATOR guidelines following the STROBE statement. Patient or Public Contribution: No patient or public contribution. Trial Registration: ISRCTN registry: ISRCTN40115047.
health care, N95 respirators, psychometrics, usability, validation
Suen, Lorna Kwai Ping
3927a819-69fb-4681-8d9b-0aad1be7faff
Kwok, Wai Hang
9c2e53ce-2fd5-42a7-b96f-4bdb0fc9075d
Yu, Ignatius Tak Sun
116df660-8d71-407a-aa0a-a9eee85b5089
So, Sony Nai Yeung
40126d5e-1738-4323-93b3-f07cb6b416d0
Cheung, Kin
0ea00a3c-505c-4da0-bfe6-581bdddac5d8
Lee, Paul Hong
02620eab-ae7f-4a1c-bad1-8a50e7e48951
Ho, Lily Yuen Wah
25f4653f-6f57-4943-939b-e87281cd5687
Ko, Ka Yan
37fff326-9cc5-4312-a52f-aea7eb13df30
Ho, Sukki
8c0d6f4f-0801-413c-b5f1-faef88e06ef2
Lam, Simon Ching
72f4d1ac-b686-4044-ac7d-677205dd25cf
Suen, Lorna Kwai Ping
3927a819-69fb-4681-8d9b-0aad1be7faff
Kwok, Wai Hang
9c2e53ce-2fd5-42a7-b96f-4bdb0fc9075d
Yu, Ignatius Tak Sun
116df660-8d71-407a-aa0a-a9eee85b5089
So, Sony Nai Yeung
40126d5e-1738-4323-93b3-f07cb6b416d0
Cheung, Kin
0ea00a3c-505c-4da0-bfe6-581bdddac5d8
Lee, Paul Hong
02620eab-ae7f-4a1c-bad1-8a50e7e48951
Ho, Lily Yuen Wah
25f4653f-6f57-4943-939b-e87281cd5687
Ko, Ka Yan
37fff326-9cc5-4312-a52f-aea7eb13df30
Ho, Sukki
8c0d6f4f-0801-413c-b5f1-faef88e06ef2
Lam, Simon Ching
72f4d1ac-b686-4044-ac7d-677205dd25cf
Suen, Lorna Kwai Ping, Kwok, Wai Hang, Yu, Ignatius Tak Sun, So, Sony Nai Yeung, Cheung, Kin, Lee, Paul Hong, Ho, Lily Yuen Wah, Ko, Ka Yan, Ho, Sukki and Lam, Simon Ching
(2024)
Assessment of the psychometric properties of the mask usability scale: a measure of the perceived usability of N95 respirators among healthcare students and staff.
Journal of Advanced Nursing.
(doi:10.1111/jan.16590).
Abstract
Aim: to test the reliability and construct validity of the Mask Usability Scale in healthcare students and staff.
Design: a methodological study involving repeated measures.
Methods: the study included two batches of participants: (1) 283 university nursing students and (2) 1753 participants composed of students (61%) and clinical staff (39%). All participants underwent N95 respirator fit tests and user seal checks. They also responded to the Mask Usability Scale, which comprises 11 items evaluated using Likert scales. The internal consistency was assessed using Cronbach's alpha and item–total correlation test. Test–retest reliability was evaluated by the intraclass correlation coefficient (ICC). The factor structure was initially identified through exploratory factor analysis (EFA), laying the groundwork for the model. This approach was followed by confirmatory factor analysis (CFA) to ensure the model fits with the standardised solution.
Results: excluding items 9, 10 and 11, the study showed satisfactory internal consistency, evidenced by a Cronbach's alpha of 0.842 for the eight-item scale from the combined samples. Factors, such as ‘Heat’, ‘Breathability’, ‘Tightness’ and ‘Ease in talking’ showed moderate to strong correlations. The test–retest reliability in the batch one sample was acceptable with ICCs ranging between 0.69 and 0.71 for different models. The EFA and fit indices supported a two-factor structure. The first factor ‘Comfort and Usage’ included ‘Heat’, ‘Breathability’, ‘Tightness’, ‘Ease in talking’ and ‘Prolonged use’, which were keys for the usability of N95 respirators. The second factor ‘Suitability’ encompassed ‘Itchy’, ‘Easily displaced’ and ‘Ear soreness’. The variance explained by the first and second factors was 49% and 12%, respectively, with a strong inter-factor correlation. The CFA results were satisfactory with fit metrics (NFI = 0.967, IFI = 0.969, TLI = 0.952, CFI = 0.969, RMSEA = 0.078 with 90% CI [0.069, 0.086] and p < 0.001) and a chi-squared to df ratio of 13.58. Conclusion: The eight-item mask usability scale exhibited satisfactory internal consistency and construct validity in both healthcare student and staff samples.
Implications for the Profession and/or Patient Care: the primary concern in the purchase policy of N95 respirators for clinical use is to strike the right balance between usability and fit rate (passing % of fit testing). Our study solidified the concept of quantifying the usability of respirators. With that mask usability scale measurement, a provision of benchmark and reference for the design and selection of respirators would be possible. This validated scale has significant implications for senior management in clinical settings and respirator manufacturers regarding the N95 respirator purchase policy and design.
Impact: the results indicated the psychometric properties of mask usability scale in measuring the usability of N95 respirators. This scale is particularly valuable for assessing the perceptions of healthcare students and staff of factors, namely, ‘Heat’, ‘Breathability’, ‘Tightness’, ‘Ease in talking’, ‘Prolonged use’, ‘Itchy’, ‘Easily displaced’ and ‘Ear soreness’ concerning the use of N95 respirators. Reporting
Method: we adhered to EQUATOR guidelines following the STROBE statement. Patient or Public Contribution: No patient or public contribution. Trial Registration: ISRCTN registry: ISRCTN40115047.
Text
Journal of Advanced Nursing - 2024 - Suen - Assessment of the Psychometric Properties of the Mask Usability Scale A
- Version of Record
More information
Accepted/In Press date: 17 October 2024
e-pub ahead of print date: 17 November 2024
Keywords:
health care, N95 respirators, psychometrics, usability, validation
Identifiers
Local EPrints ID: 497375
URI: http://eprints.soton.ac.uk/id/eprint/497375
ISSN: 0309-2402
PURE UUID: 32244674-dcab-45e9-8f17-95eca81591f1
Catalogue record
Date deposited: 21 Jan 2025 17:45
Last modified: 22 Aug 2025 02:37
Export record
Altmetrics
Contributors
Author:
Lorna Kwai Ping Suen
Author:
Wai Hang Kwok
Author:
Ignatius Tak Sun Yu
Author:
Sony Nai Yeung So
Author:
Kin Cheung
Author:
Paul Hong Lee
Author:
Lily Yuen Wah Ho
Author:
Ka Yan Ko
Author:
Sukki Ho
Author:
Simon Ching Lam
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics