Researchers in Shanghai have confirmed the strong content validity of the Chinese-language Psychosocial Risk Assessment in Pediatrics scale, while highlighting wording issues that could impact clinical application, underscoring the need for further psychometric testing.
Researchers in Shanghai have reported that the Chinese-language version of the Psychosocial Risk Assessment in Pediatrics scale has strong overall content validity, while also flagging wording issues that may affect how some items are understood in practice.
The study, published in Frontiers in Health Services, used a mixed-methods design between August 2022 and November 2023 at a tertiary children’s hospital in Shanghai. A panel of 57 raters, including nurses, social workers and family caregivers, assessed the scale’s relevance, comprehensiveness and comprehensibility. The investigators then paired those ratings with semi-structured interviews to see not only whether the items appeared useful, but whether they were interpreted as intended and whether any important concepts were missing.
The PRAP scale was created to help identify psychosocial risks in hospitalised children, a group that the study notes can face stress from separation from family, unfamiliar clinical environments and invasive procedures. The Chinese version had already been translated and tested for internal consistency, but this new evaluation was designed to go further by following the COSMIN framework, which recommends looking separately at relevance, completeness and clarity. That matters because a scale can appear statistically sound while still being hard to apply consistently in day-to-day clinical work.
Quantitatively, the scale performed well. The overall scale content validity index averaged 0.92, which the authors describe as evidence of strong content validity. Item 5, which concerns parent or caregiver stress, received the lowest relevance score at 0.79, just above the study’s threshold for retention. The comprehensiveness score was particularly high at 0.98, suggesting that raters generally believed the instrument covered the main domains of psychosocial risk. Comprehensibility also scored well overall at 0.94.
The interviews added more nuance. Participants questioned the wording of several items, especially those dealing with temperament, special needs, traumatic medical experiences and invasive procedures. Some raters also said certain response options were too vague or did not clearly fit real clinical encounters. In some cases, caregivers and health professionals understood the same item differently, which the authors say helps explain why quantitative scores alone can miss practical problems in scale use. The study also identified concepts that interviewees thought might matter, such as parental emotional influence and comfort objects, but these were not added because they fell outside the instrument’s current scope.
The researchers concluded that the Chinese PRAP scale has a defensible basis for clinical use, but they stopped short of treating the result as final proof of validity. They said more psychometric testing is still needed, including further work on structural validity, before the instrument can be considered fully established. For paediatric services, the findings suggest that the scale may be useful as a rapid screening tool, but only if staff understand its terminology and apply it carefully.
Disclaimer: This content is for informational purposes only and is not intended to be a substitute for professional medical judgment, advice, diagnosis, or treatment.
