Skip directly to site content Skip directly to page options Skip directly to A-Z link Skip directly to A-Z link Skip directly to A-Z link
Volume 30, Number 3—March 2024
Research

Systematic Review of Scales for Measuring Infectious Disease–Related Stigma

Amy PatersonComments to Author , Ashleigh Cheyne, Benjamin Jones, Stefan Schilling, Louise Sigfrid, Jeni Stolow, Lina Moses, Piero Olliaro, and Amanda Rojek
Author affiliations: University of Oxford, Oxford, UK (A. Paterson, A. Cheyne, B. Jones, S. Schilling, L. Sigfrid, P. Olliaro, A. Rojek); Tulane University, New Orleans, Louisiana, USA (J. Stolow, L. Moses); Global Outbreak Alert and Response Network, World Health Organization, Geneva, Switzerland (J. Stolow, L. Moses); The Royal Melbourne Hospital, Melbourne, Victoria, Australia (A. Rojek)

Main Article

Table 2

Definitions of psychometric properties used in a systematic review of scales for measuring infectious disease–related stigma*

Domain Property Aspect of property Definition
Validity The degree to which an instrument measures the constructs it purports to measure
Content validity The degree to which the content of an instrument is an adequate reflection of the construct to be measured
Face validity The degree to which an instrument looks as though it reflects the construct to be measured
Construct validity The degree to which the scores of an instrument are consistent with hypotheses (for instance regarding internal relationships, relationships to scores of other instruments, or differences between relevant groups) based on the assumption that the instrument validly measures the construct to be measured
Structural validity The degree to which the scores of an instrument are an adequate reflection of the dimensionality of the construct to be measured
Hypotheses testing The degree to which the scores of an instrument are consistent with hypotheses on relationships to scores of other instruments
Cross-cultural validity The degree to which an instrument accurately measures the same construct in different population groups.
Criterion validity†
The degree to which the scores of an instrument are an adequate reflection of a gold standard*
Reliability The degree to which the measurement is free from measurement error
Internal consistency The degree of the interrelatedness among the items
Test-retest reliability The amount of the total variance in two sets of measurements which is due to 'true’ differences between respondents
Measurement error
The systematic and random error of a respondent's score that is not attributed to true changes in the construct to be measured
Responsiveness The ability of an instrument to detect change over time in the construct to be measured

*Table adapted from COSMIN definitions of domains, measurement properties, and aspects of measurement properties, which uses the term “gold standard” (21). †Criterion validity assessment was not considered in this review because no standard for stigma assessment is available.

Main Article

References
  1. Cénat  JM, Rousseau  C, Bukaka  J, Dalexis  RD, Guerrier  M. Severe anxiety and PTSD symptoms among Ebola virus disease survivors and healthcare workers in the context of the COVID-19 pandemic in Eastern DR Congo. Front Psychiatry. 2022;13:767656. DOIPubMedGoogle Scholar
  2. Gregorio  ER Jr, Medina  JRC, Lomboy  MFTC, Talaga  ADP, Hernandez  PMR, Kodama  M, et al. Knowledge, attitudes, and practices of public secondary school teachers on Zika Virus Disease: A basis for the development of evidence-based Zika educational materials for schools in the Philippines. PLoS One. 2019;14:e0214515. DOIPubMedGoogle Scholar
  3. Lee  S, Chan  LY, Chau  AM, Kwok  KP, Kleinman  A. The experience of SARS-related stigma at Amoy Gardens. Soc Sci Med. 2005;61:2038–46. DOIPubMedGoogle Scholar
  4. Usifoh  SF, Odigie  AE, Ighedosa  SU, Uwagie-Ero  EA, Aighewi  IT. Lassa fever-associated stigmatization among staff and students of the University of Benin, Nigeria. J Epidemiol Glob Health. 2019;9:107–15. DOIPubMedGoogle Scholar
  5. Goffman  E. Stigma: notes on the management of spoiled identity. New York: J. Aronson; 1974.
  6. Jones  N, Corrigan  PW. Understanding stigma. In: Corrigan PW, editor. The stigma of disease and disability. Understanding causes and overcoming injustices. Washington: American Psychological Association; 2014. p. 9–34.
  7. Weiss  MG. Stigma and the social burden of neglected tropical diseases. PLoS Negl Trop Dis. 2008;2:e237. DOIPubMedGoogle Scholar
  8. Stangl  AL, Earnshaw  VA, Logie  CH, van Brakel  W, C Simbayi  L, Barré  I, et al. The Health Stigma and Discrimination Framework: a global, crosscutting framework to inform research, intervention development, and policy on health-related stigmas. BMC Med. 2019;17:31. DOIPubMedGoogle Scholar
  9. Major  B, Dovidio  JF, Link  BG, Calabrese  SK. Stigma and its implications for health: introduction and overview. In: Major B, Dovidio JF, Link BG, editors. The Oxford handbook of stigma, discrimination, and health. New York: Oxford University Press; 2018. p. 3–28.
  10. Trinh  DH, McKinn  S, Nguyen  AT, Fox  GJ, Nguyen  AT, Bernays  S. Uneven stigma loads: Community interpretations of public health policies, ‘evidence’ and inequities in shaping Covid-19 stigma in Vietnam. SSM Popul Health. 2022;20:101270. DOIPubMedGoogle Scholar
  11. Van Brakel  WH. Measuring health-related stigma—a literature review. Psychol Health Med. 2006;11:307–34. DOIPubMedGoogle Scholar
  12. Cénat  JM, Noorishad  PG, Kokou-Kpolou  CK, Dalexis  RD, Hajizadeh  S, Guerrier  M, et al. Prevalence and correlates of depression during the COVID-19 pandemic and the major role of stigmatization in low- and middle-income countries: A multinational cross-sectional study. Psychiatry Res. 2021;297:113714. DOIPubMedGoogle Scholar
  13. Cénat  JM, Noorishad  PG, Dalexis  RD, Rousseau  C, Derivois  D, Kokou-Kpolou  CK, et al. Prevalence and risk factors of depression symptoms among rural and urban populations affected by Ebola virus disease in the Democratic Republic of the Congo: a representative cross-sectional study. BMJ Open. 2022;12:e053375. DOIPubMedGoogle Scholar
  14. Nyblade  L, Stockton  MA, Giger  K, Bond  V, Ekstrand  ML, Lean  RM, et al. Stigma in health facilities: why it matters and how we can change it. BMC Med. 2019;17:25. DOIPubMedGoogle Scholar
  15. Rajkumar  E, Rajan  AM, Daniel  M, Lakshmi  R, John  R, George  AJ, et al. The psychological impact of quarantine due to COVID-19: A systematic review of risk, protective factors and interventions using socio-ecological model framework. Heliyon. 2022;8:e09765. DOIPubMedGoogle Scholar
  16. Li  L, Wang  J, Leng  A, Nicholas  S, Maitland  E, Liu  R. Will COVID-19 vaccinations end discrimination against COVID-19 patients in China? New evidence on recovered COVID-19 patients. Vaccines (Basel). 2021;9:490. DOIPubMedGoogle Scholar
  17. Mazzagatti  R, Riva  MA. Monkeypox vaccine-related stigma. Public Health Pract (Oxf). 2022;4:100336. DOIPubMedGoogle Scholar
  18. Logie  CH. What can we learn from HIV, COVID-19 and mpox stigma to guide stigma-informed pandemic preparedness? J Int AIDS Soc. 2022;25:e26042. DOIPubMedGoogle Scholar
  19. Kwon PhD  S. Mask wearing and perceived discrimination associated with COVID-19 in the United States from March 2020 to May 2021: three-level longitudinal analyses. Health Educ Behav. 2022;49:200–9. DOIPubMedGoogle Scholar
  20. Page  MJ, McKenzie  JE, Bossuyt  PM, Boutron  I, Hoffmann  TC, Mulrow  CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. DOIPubMedGoogle Scholar
  21. Prinsen  CAC, Mokkink  LB, Bouter  LM, Alonso  J, Patrick  DL, de Vet  HCW, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27:1147–57. DOIPubMedGoogle Scholar
  22. Cicchetti  DV, Sparrow  SA. Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. Am J Ment Defic. 1981;86:127–37.PubMedGoogle Scholar
  23. Stevelink  SAM, van Brakel  WH. The cross-cultural equivalence of participation instruments: a systematic review. Disabil Rehabil. 2013;35:1256–68. DOIPubMedGoogle Scholar
  24. Carroll  C, Booth  A, Leaviss  J, Rick  J. “Best fit” framework synthesis: refining the method. BMC Med Res Methodol. 2013;13:37. DOIPubMedGoogle Scholar
  25. Mokkink  LB, de Vet  HCW, Prinsen  CAC, Patrick  DL, Alonso  J, Bouter  LM, et al. COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27:1171–9. DOIPubMedGoogle Scholar
  26. Pantelic  M, Ziauddeen  N, Boyes  M, O’Hara  ME, Hastie  C, Alwan  NA. Long Covid stigma: Estimating burden and validating scale in a UK-based sample. PLoS One. 2022;17:e0277317. DOIPubMedGoogle Scholar
  27. Pescosolido  BA, Martin  JK. The stigma complex. Annu Rev Sociol. 2015;41:87–116. DOIPubMedGoogle Scholar
  28. Alchawa  M, Naja  S, Ali  K, Kehyayan  V, Haddad  PM, Bougmiza  I. COVID-19 perceived stigma among survivors: A cross-sectional study of prevalence and predictors. Eur J Psychiatry. 2023;37:24–35. DOIPubMedGoogle Scholar
  29. Mlouki  I, Zammit  N, Ghammem  R, Ben Fredj  S, Bannour  R, El Echi  A, et al. Validity and reliability of a modified short version of a stigma scale for use among Tunisian COVID-19 patients after quarantine: A cross-sectional study. Health Sci Rep. 2022;5:e520. DOIPubMedGoogle Scholar
  30. Nair  S, Joshi  A, Aggarwal  S, Adhikari  T, Mahajan  N, Diwan  V, et al. Development & validation of scales to assess stigma related to COVID-19 in India. Indian J Med Res. 2022;155:156–64. DOIPubMedGoogle Scholar
  31. Boateng  GO, Neilands  TB, Frongillo  EA, Melgar-Quiñonez  HR, Young  SL. Best practices for developing and validating scales for health, social, and behavioral research: a primer. Front Public Health. 2018;6:149. DOIPubMedGoogle Scholar
  32. Dar  SA, Khurshid  SQ, Wani  ZA, Khanam  A, Haq  I, Shah  NN, et al. Stigma in coronavirus disease-19 survivors in Kashmir, India: A cross-sectional exploratory study. PLoS One. 2020;15:e0240152. DOIPubMedGoogle Scholar
  33. Kibria  MG, Islam  T, Islam  MT, Kabir  R, Ahmed  S, Sultana  P. Stigma and its associated factors among patients with COVID-19 in Dhaka City: evidence from a cross-sectional investigation. PeerJ. 2022;10:e14092. DOIPubMedGoogle Scholar
  34. Overholt  L, Wohl  DA, Fischer  WA II, Westreich  D, Tozay  S, Reeves  E, et al. Stigma and Ebola survivorship in Liberia: Results from a longitudinal cohort study. PLoS One. 2018;13:e0206595. DOIPubMedGoogle Scholar
  35. Mokkink  LB, Prinsen  CA, Patrick  DL, Alonso  J, Bouter  LM, de Vet  HCW, et al. COSMIN study design checklist for patient-reported outcome measurement instruments 2019 [cited 2023 Nov 3] https://www.cosmin.nl/wp-content/uploads/COSMIN-study-designing-checklist_final.pdf
  36. Li  T, Bu  H, Duan  W. A brief measure of perceived courtesy and affiliate stigma on COVID-19: A study with a sample from China. Pers Individ Dif. 2021;180:110993. DOIPubMedGoogle Scholar
  37. Al-Zamel  LA, Al-Thunayan  SF, Al-Rasheed  AA, Alkathiri  MA, Alamri  F, Alqahtani  F, et al. Validation and cultural adaptation of Explanatory Model Interview Catalogue (EMIC) in assessing stigma among recovered patients with COVID-19 in Saudi Arabia. Int J Environ Res Public Health. 2021;18:8261. DOIPubMedGoogle Scholar
  38. Stangl  AL, Lilleston  P, Mathema  H, Pliakas  T, Krishnaratne  S, Sievwright  K, et al.; HPTN 071 (PopART) Study Team. Development of parallel measures to assess HIV stigma and discrimination among people living with HIV, community members and health workers in the HPTN 071 (PopART) trial in Zambia and South Africa. J Int AIDS Soc. 2019;22:e25421. DOIPubMedGoogle Scholar
  39. Sigfrid  L, Maskell  K, Bannister  PG, Ismail  SA, Collinson  S, Regmi  S, et al. Addressing challenges for clinical research responses to emerging epidemics and pandemics: a scoping review. BMC Med. 2020;18:190. DOIPubMedGoogle Scholar
  40. World Health Organization. Prioritizing diseases for research and development in emergency contexts [cited 2023 Nov 3]. https://www.who.int/activities/prioritizing-diseases-for-research-and-development-in-emergency-contexts

Main Article

Page created: December 31, 2023
Page updated: February 22, 2024
Page reviewed: February 22, 2024
The conclusions, findings, and opinions expressed by authors contributing to this journal do not necessarily reflect the official position of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions. Use of trade names is for identification only and does not imply endorsement by any of the groups named above.
file_external