Cross-cultural adaptation and psychometric evaluation of oral health impact profile among school teacher community
Shaleen Vyas, Sandesh Nagarajappa, Pralhad L Dasar, Prashant Mishra
Department of Public Health Dentistry, Sri Aurobindo College of Dentistry, Indore, Madhya Pradesh, India
|Date of Submission||27-Apr-2017|
|Date of Acceptance||12-Aug-2017|
|Date of Web Publication||10-Jan-2018|
Dr. Shaleen Vyas
19, White Church Colony, Hasmukhsadan, Indore, Madhya Pradesh
Source of Support: None, Conflict of Interest: None
Aim: To translate OHIP-14 into Hindi and test its psychometric properties among school teacher community.
Methods: The OHIP-14 was translated to OHIP-14-H using WHO recommended translation protocol. During pre-testing, an expert panel assessed content validity of the questionnaire. Face validity was assessed on a sample of 10 individuals. The OHIP-14-H was administered on a random sample of 170 primary school teachers. Internal consistency and test-retest reliability were assessed using Cronbach's alpha and Intra-class correlation coefficient (ICC) respectively, with 2 weeks interval. Predictive validity was tested by comparing OHIP-14-H scores with clinical parameters. The concurrent validity was assessed using self-reported oral health and discriminant validity was ascertained through negative association with sociodemographic variables.
Results: The mean OHIP-14-H score was 9.57 (S.D = 4.58). ICC and Cronbach's alpha for OHIP-14-H was 0.96 and 0.92 respectively. Concurrent validity using binomial regression model indicated that good (OR = 0.56, 95% CI = 0.55 – 4.47) and moderate (OR = 0.25, 95% CI = 0.17 – 1.87) OHIP-14-H scores were negative but significant risk indicators of poor self reported oral health (P < 0.009). Significant predictive validity was observed between OHIP-14-H scores and clinical parameters (P < 0.000).
Conclusion: Translated and culturally adapted OHIP-14-H indicates good reliability and validity among primary school teachers.
Keywords: Health status measure, oral health, quality of life, questionnaire, reliability, validity
|How to cite this article:|
Vyas S, Nagarajappa S, Dasar PL, Mishra P. Cross-cultural adaptation and psychometric evaluation of oral health impact profile among school teacher community. J Edu Health Promot 2018;7:4
|How to cite this URL:|
Vyas S, Nagarajappa S, Dasar PL, Mishra P. Cross-cultural adaptation and psychometric evaluation of oral health impact profile among school teacher community. J Edu Health Promot [serial online] 2018 [cited 2022 Dec 8];7:4. Available from: https://www.jehp.net//text.asp?2018/7/1/4/222739
| Introduction|| |
The impact on various oral conditions on social life determines oral health-related quality of life (OHRQoL) and significantly occupy a prominent place in mind set of researchers, policy makers, and dental health-care professionals. Significant association with OHRQoL and its impact on general health has well been documented in literature. Editorial report by Aubrey Sheiham 2005, concluded the hampering physical, physiological, and social aspects of life leads to poor OHRQoL.,
Indicators assessing OHRQoL before 1997 consisted of Social impact on disease (SID), Geriatric oral health assessment index (GOHAI), Dental impact profile, and Oral impacts on daily performance (OIDP). Tools addressed post-1997 included child-OIDP scale, OHRQoL for dental hygiene, orthognathic quality of life (QoL) questionnaire, and surgical orthodontic outcome questionnaire. Majority of these tools either focused on specific groups and social classes of the community or influence of therapeutic outcome on OHRQoL. Amidst all, “Oral Health Impact Profile scale (OHIP-49)” developed by Gary Slade 1994 had a multidimensional construct. Further in 1997, item-reduction statistics restricted the scale, rendering it equally effective and easy to administer 14-item questionnaire.
In due course of time, researchers came up with easy to administer, shorter but valid and reliable culturally adapted versions of OHIP-14, namely, Spanish, Arabic, Nepalese, Dutch, Brazilian, German, Chinese, and Hungarian to evaluate the OHRQoL in community at large.,,,,,, We undertook to develop a Hindi translated version of OHIP-14 to implement and easily assess OHRQoL in Hindi-speaking community. The rationale for selecting the desired population was to secondarily explore the community participation in primary school teachers in building up strong oral health motives in school going children.
The objective of our study was to translate the original English version of OHIP-14 into Hindi (OHIP-14-H) and demonstrate its psychometric properties on teacher community. An important aspect of Hindi translation was to assess the level of community acceptance for the OHRQoL assessment questionnaire.
| Subjects and Methods|| |
A cross-sectional study was conducted in teacher community among primary school teachers. The study was carried out for a period of 2 months (June to July 2015) in Indore city. Ethical clearance was obtained from the Institutional review board. A registered list of primary schools in Indore city was sought to randomly approach 15 schools for permission regarding conduct of the study. A simple random sampling strategy was employed to obtain an a priori determined the sample of primary school teachers.
The sample size was derived based on the concept of N/p ratio that is item to participant ratio of 1:10. Each question was addressed by 10 responders. The 14-item questionnaire enabled us to compute a sample size of 140 participants. Nonparticipation of the responders in the study was compensated by increasing the sample size of 20% of the predetermined. Thus, final samples for the study consisted of 170 primary school teachers.
The translation of OHIP-14 was done as per the procedure for forward-backward translation and adaptation protocol, recommended by the World Health Organization. The translation procedure was carried out in four sequential stages. The forward translation into Hindi language emphasized on conceptual rather than literal translation thus avoiding technical terms and jargons. The aim was to use natural and acceptable Hindi language for majority of Hindi-speaking community.
Stage two consisted of appointing a bilingual expert panel including the forward translator, one expert in public health and one expert with experience in translation and development of questionnaires. Based on consensus arrived by the panel, subsequent changes and discrepancies in translated questionnaire were sorted.
The initial forward translated Hindi version was backtranslated into English by a single-independent translator having good technical command of both the languages. The back translator had no previous knowledge regarding questionnaire. The back-translated version was cross-checked with original (English) OHIP-14 questionnaire. Apparent discrepancies were discussed and eventually resolved with the back-translator.
Ten participants from the study community were recruited for pretesting procedure. Participants in the pretesting phase were not considered as a part of the main study. The Hindi-translated version was administered to the study subjects with a small debriefing of the content. Face-to-face interview sessions with participants were carried out by primary investigator. The respondents were also interviewed regarding understanding and content of the questionnaire. The final version of OHIP-14-H was collaborative compilation of all iterations made throughout the process. All the activities were well-coordinated by the primary investigator.
Four main aspects of validity considered in the study were face, content, criterion, and construct validity. The content and face validity assessment of the translated scale was undertaken to ascertain the appropriateness and relevance to content ensuring feasibility, readability, and clarity of language to the participating audience. The expert panel analyzed the content validity assessing stability of the questionnaire despite cultural/linguistic reframing. The target population was made a part of the assessment protocol for face validity. Necessary discussions were done with participants to ascertain encountered difficulties.
In the present study, construct validity was assessed to correlate theoretical paradigm of construct by examining measures of predictive and discriminant validity. Clinical parameters such as oral hygiene status and Decayed Missing Filled Teeth (DMFT) levels were compared with OHIP-14-H scores to determine the significance level of correlation. Besides, discriminant validity was assessed by negative/insignificant association with OHIP-14-H scores of socio demographic variables such as gender, education, and socioeconomic status.
Criterion validity (concurrent validity) was assessed by examining correlation between self-reported oral health and OHIP-14-H scores. Internal consistency or homogeneity of the translated OHIP-14-H scale was determined by subjecting participant's responses for all 14-items to alpha reliability analysis. Cronbach's alpha values of 0.8 and 0.9 were considered to establish good to almost perfect consistency.,
Reproducibility of the questionnaire was evaluated by readministering the translated scale to one-half of the participants randomly in 2 weeks duration. A “test-retest” reliability analysis was performed [Figure 1]. The period of readministering was crucial since shorter interval could lead to high-assumed correlation in comparison to longer interval.
|Figure 1: Flowchart representation of psychometric assessment/validation of Oral Health Impact Profile-14|
Click here to view
Data onto sociodemographic details, clinical oral examination, and self-rated oral health was collected using a structured pro forma. Oral hygiene index – simplified and DMFT score was recorded by the primary investigator (κ = 0.84)., ADA Type III oral examination was carried out under natural light and illumination using mouth mirror, explorer and CPI probe. Modified Kuppuswamy's socioeconomic scale, upgraded to the latest consumer price index, May 2015 was employed to classify the socioeconomic status of the participants.,
Data collected was entered into Microsoft Excel and analyzed using Statistical Package for Social Sciences, SPSS Version 20.0. (2011), (IBM SPSS Statistics for Windows, Armonk, NY: IBM Corp.). The internal consistency was assessed using Cronbach's alpha values while intraclass Correlation Coefficient determined the reproducibility of the translated scale. Kappa statistics was used to evaluate the intrarater reliability of the primary investigator. The frequency distribution analysis was done using Chi-square tests. Binary logistic regression analysis was employed to assess the reliability and validity of OHIP-14-H. The level of significance was set at 5%.
| Results|| |
Distribution of study participants in with respect to age, gender, education, socioeconomic status, and tooth brushing behavior identified majority of participants belonging to middle (38.82%) and postmiddle age group (37.05%). 69.41% females belonging to the upper/middle socioeconomic class had higher educational level. Higher percentage of female respondents could be attributed to the fact that majority of primary schools employed female teaching staff as compared to males.
Irrespective of age stratification, significant number of respondents had poor OHIP (P < 0.003) [Table 1]. 55.35% respondents, brushing twice or more daily reported of having poor impact on their oral health while similar but contrasting, results were derived from participant who never brushed but reported good OHIP scores (P < 0.03) [Table 1]. Insignificant association with gender, education, and socioeconomic status indicated that OHIP of the participants did not diverge with the following variables in consideration justifying the discriminant validity of the questionnaire.
|Table 1: Frequency distribution of sociodemographic variables in contrast to differing levels of oral health impact profile - a measure of discriminant validity|
Click here to view
The mean total score of 14-item OHIP-14-H scale was 9.57 ± 4.58 [Table 2]. The maximum difficulty was encountered with physical discomfort domain (48%) followed by functional limitation domain (38%), respectively. The result suggests that respondents were more comfortable reporting, assessing and evaluating the impact of oral conditions on QoL through all domains except for physical discomfort and functional limitation domains.
|Table 2: Mean total scores of oral health impact profile-14-Hindi and its seven domains with percentage difficulty encountered in responding to questions in respective domains|
Click here to view
“Test-retest reliability” assessed using bivariate correlation analysis showed significant results of almost perfect agreement (intraclass correlation coefficient = 0.96, confidence interval [CI] = 0.93–0.99) indicating highly reliable translated scale (P < 0.000). Internal consistency of the scale was found to be high (0.92) [Table 3]. The mean interitem correlation value of 0.45 was in agreement to the fact that, for a scale with converging domain structures the interitem correlation should lie between 0.25 and 0.60 (Watson and Clark 1992).
|Table 3: Internal consistency and reliability of the Hindi translated questionnaire (Oral health impact profile-14-Hindi)|
Click here to view
A statistically significant difference was observed in relation to oral hygiene status. Participants having good (80%) to fair (55.55%) oral hygiene displayed good OHIP-14-H score (P < 0.001). Majority of participants (72.74%) having DMFT scores >5 reported significant poor OHIP-14-H scores as compared to those having DMFT <5 (P < 0.000) [Table 4]. The result suggests that clinical parameters such as oral hygiene status and caries experience show a positive-predictive behavior regarding QoL of an individual, thus establishing a good predictive validity. Majority of teachers having good OHIP-14 score responded to have significantly good self-rated oral health status (58.06%) thus documenting a significant concurrent validity of OHIP-14-H scale (P < 0.019).
|Table 4: Comparison of level of literacy with clinical parameters and self-reported oral health - a measure of predictive and concurrent validity of oral health impact profile-14-Hindi respectively|
Click here to view
A bivariate logistic regression analysis implemented to determine poor self-rated oral health illustrated that middle-aged, graduate, men belonging to the upper or middle socioeconomic class and brushing only once daily were more likely to have poor self-rated oral health [Table 5]. On the contrary, participants having either moderate or good OHIP-14-H scores were less likely to report poor self-rated oral health (odds ratio [OR] = 0.56, CI = 0.55–4.47) and (OR = 0.25, CI = 0.17–1.87), respectively. The findings significantly ascertained the correlation between the impact on oral conditions and likelihood of reporting oral health status (P < 0.009). The study results further strengthened the evidence for acceptable concurrent validity of OHIP-14-H.
|Table 5: Determinants of poor self-rated oral health based on binary regression analysis among primary school teachers (n=170)|
Click here to view
| Discussion|| |
The original OHIP-14 was concerned with impairment and three functional dimensions, namely, social, psychological, and physical. These domains represented four of seven qualities of life-dimensions proposed by Patrick and Bergner. The translated OHIP-14-H scale was intended to complement traditional oral epidemiological indicators of clinical disease, thereby providing information about “burden of oral disease” within community inmates and the effectiveness of health services in reducing this burden of illness.
The projected results of culturally adapting OHIP-14 scale of Hindi-speaking communities were in agreement with other studies except for some undermined differences in methodology and interpretation. The present study focused on corroborating WHO proposed methodology for translation, back-translation of OHIP-14-H, which was contrasting with similar studies on linguistic adaptation of OHIP-14. Recently, published data onto aforementioned title lacked to justify the translation protocol and validation methodology. It was observed that flaws in the translation, back-translation protocol could probably lead to the deterioration of face and content validity. The present study was able to justify both validities through the expert panel iterations as well as interaction with pilot participants.
Sufficient evidence for scientific basis of the present study was provided by systematic sample size determination through existing literatures.,, Majority of studies were conducted on conveniently selected sample population. In contrast to these findings, the present study adopted a simple random sampling strategy to obtain an a priori determined sample size. Supportive evidence enabled us to derive the sample size using item to participant ratio (N/p). As rules-of-thumb, number of subjects per variable may vary from 4 to 10, with a minimum of 100 subjects to ensure stability of variance–covariance matrix. Although this method of sample size determination holds true for studies involving item-reduction through factorial analysis, the results of a systematic review on quality of factor analysis of the Medical Outcome Short Form (SF-36) scale identified 3 out of 22 studies on cross-validation justifying the use of similar method for sample size estimation. Recommendation as per another systematic review considered a range from 2 to 20 subjects per item, with an absolute minimum of 100–250 subjects for cross-validation research.
The internal consistency and reproducibility of the translated scale were in agreement with studies conducted by Oliveira et al., 2005. Similar studies by Al Habashneh, et al. 2012, also revealed comparable results.  Cross-cultural adaption in various geographical extents yielded similar results except for minor differences observed in Chinese and Persian versions.,,,,,
Predictive and discriminant validity were considered as measures of construct validity. The clinical parameters evaluated in present study were oral hygiene status and caries experience in comparison to the Dutch version of OHIP-14 which utilized WHO pro forma and compared parameters such as community periodontal index treatment needs (CPITN). The assessment of predictive validity and discriminant validity was a contrasting feature of our study as we compared the clinical parameters and sociodemographic variables with OHIP-14-H scores. Determination of convergent validity was reserved for future studies, as we considered the comparison of OHIP-14-H scores with similar prevalidated scale would yield accurate convergent validity.,
A differentiating feature of this investigation was specific community involvement. The primary school teachers play a crucial role as pioneers in child education and can contribute to capacity building. The participation of primary school teachers in the study was credited to the fact that teacher's can inculcate a positive oral health attitude and reinforce adequate cognitive behavior for good oral health in children. The initiative behind our study was in lieu to the concept of “Dental socialization.” The present study also focuses on concept of significant others (Primary school teachers) in contributing to better QoL. The scientific layout behind selecting our study population was a key factor differentiating present study from similar studies.,,
The limited sample size for the study may be of concern, meaning that psychometric properties of the scale may vary in a larger subset of population. The study results can be generalized on teacher community, but the external validation on a larger sample, consisting of local population, with limited educational level and differing level of literacy on language used in OHIP-14-H should be done cautiously.
Hence, successive studies using the OHIP-14-H will be focused more toward large sample of more representative local population to have more comprehensive assessment of psychometric properties of OHIP-14-H. Influenced by the ease and understandability of the tool it is recommended to organize randomized control trials in future taking OHIP-14-H scale and similar other OHRQoL scales on local/rural communities.
| Conclusion|| |
The psychometric assessment of the translated OHIP-14-H demonstrated a valid and reliable instrument to assess the impact of oral conditions on QoL among primary school teachers. OHIP-14-H can effectively be used to conduct researches on OHRQoL. Thus, OHIP-14-H being a culturally acceptable scale enables its use at both epidemiological and clinical levels.
Authors express gratitude toward the expert panel for forward-backward translation, school teachers and the schools, respectively, for rendering their precious time, understanding the rationale and being a part of the study.
We hereby transfer, assign, or otherwise convey all copyright ownership, including any and all rights incidental thereto, exclusively to the journal, in the event that such work is published by the journal.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Nikias M. Measurement of oral health studies. In: Elinson J, Mooney A, Siegmann A, editors. Health Goals and Health Indicators: Policy, Planning and Evaluation. Washington, D.C., Boulder, CO: West View Press for the American Association for the Advancement of Science; 1977. p. 95-111.
Cohen LK. Dental care delivery in seven nations: The international collaborative study of dental manpower systems in relation to oral health studies. In: Ingle JI, Blair P, editors. International Dental Care Delivery Systems. Cambridge, MA: Ballinger Publishing Co.; 1978. p. 201-14.
Bakas T, McLennon SM, Carpenter JS, Buelow JM, Otte JL, Hanna KM, et al
. Systematic review of health-related quality of life models. Health Qual Life Outcomes 2012;10:134.
Sheiham A. Oral health, general health and quality of life. Bull World Health Organ 2005;83:644.
Locker D, Allen F. What do measures of 'oral health-related quality of life' measure? Community Dent Oral Epidemiol 2007;35:401-11.
Slade GD, Spencer AJ. Development and evaluation of the oral health impact profile. Community Dent Health 1994;11:3-11.
Slade GD. Derivation and validation of a short-form oral health impact profile. Community Dent Oral Epidemiol 1997;25:284-90.
Peterson P. Society and oral health. In: Pine CM, editor. Community Oral Health. Ch. 3. Write, Oxford, U.K, Reed Educational and Professional Publishing Ltd.; 1997. p. 20-37.
John MT, Patrick DL, Slade GD. The German version of the oral health impact profile – translation and psychometric properties. Eur J Oral Sci 2002;110:425-33.
Wong MC, Lo EC, McMillan AS. Validation of a Chinese version of the oral health impact profile (OHIP). Community Dent Oral Epidemiol 2002;30:423-30.
Larsson P, List T, Lundström I, Marcusson A, Ohrbach R. Reliability and validity of a Swedish version of the oral health impact profile (OHIP-S). Acta Odontol Scand 2004;62:147-52.
Szentpétery A, Szabó G, Marada G, Szántó I, John MT. The Hungarian version of the oral health impact profile. Eur J Oral Sci 2006;114:197-203.
John MT, Miglioretti DL, LeResche L, Koepsell TD, Hujoel P, Micheelis W, et al
. German short forms of the oral health impact profile. Community Dent Oral Epidemiol 2006;34:277-88.
van der Meulen MJ, John MT, Naeije M, Lobbezoo F. The Dutch version of the oral health impact profile (OHIP-NL): Translation, reliability and construct validity. BMC Oral Health 2008;8:11.
de Vet HC, Adèr HJ, Terwee CB, Pouwer F. Are factor analytical techniques used appropriately in the validation of health status questionnaires? A systematic review on the quality of factor analysis of the SF-36. Qual Life Res 2005;14:1203-18.
Sun J, Won C, Damansara PJ. Questionnaire translation and psychometric properties evaluation. SEGi Univ Coll 2009;2:45-51.
Coles ME, Cook LM, Blake TR. Assessing obsessive compulsive symptoms and cognitions on the internet: Evidence for the comparability of paper and internet administration. Behav Res Ther 2007;45:2232-40.
Parsian N. Developing and validating a questionnaire to measure spirituality: A psychometric process. Glob J Health Sci 2009;1:1-11.
Greene JC, Vermillion JR. The simplified oral hygiene index. J Am Dent Assoc 1964;68:7-13.
Bairwa M, Rajput M, Sachdeva S. Modified Kuppuswamy's socioeconomic scale: Social researcher should include updated income criteria, 2012. Indian J Community Med 2013; 38:185-6.
] [Full text]
Government of India, Ministry of Labour & Employment. Consumer Price Index Numbers for Industrial Workers on Base; 2001. p. 100. Available from: http://www.labourbureau.gov.in
. [Last updated on 2015 May 29].
Clark LA, Watson D. Constructing validity: Basic issues in objective scale development. Psychol Assess 1995;7:309-19.
Patrick DL, Bergner M. Measurement of health status in the 1990s. Annu Rev Public Health 1990;11:165-83.
Tugwell P, Bennett KJ, Sackett D. Relative risks, benefits and costs of intervention. In: Warren KS, Mahmoud AA, editors. Tropical and Geographic Medicine. New York: McGraw Hill; 1985. p. 1097-113.
Deshpande NC, Nawathe AA. Translation and validation of Hindi version of oral health impact profile-14. J Indian Soc Periodontol 2015;19:208-10.
] [Full text]
Anthoine E, Moret L, Regnault A, Sébille V, Hardouin JB. Sample size used to validate a scale: A review of publications on newly-developed patient reported outcomes measures. Health Qual Life Outcomes 2014;12:176.
Oliveira BH, Nadanovsky P. Psychometric properties of the Brazilian version of the oral health impact profile-short form. Community Dent Oral Epidemiol 2005;33:307-14.
Al Habashneh R, Khader YS, Salameh S. Use of the Arabic version of oral health impact profile-14 to evaluate the impact of periodontal disease on oral health-related quality of life among Jordanian adults. J Oral Sci 2012;54:113-20.
Motallebnejad M, Hadian H, Mehdizadeh S, Hajiahmadi M. Validity and reliability of the Persian version of the oral health impact profile (OHIP)-14. Caspian J Intern Med 2011; 2:314-20.
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]