Home About us Editorial board Search Browse articles Submit article Instructions Contacts Login 
Users Online: 948
Home Print this page Email this page

 



 
Previous article Browse articles Next article 
ORIGINAL ARTICLE
J Edu Health Promot 2019,  8:7

Evaluation of the website of public hospitals in Isfahan with the WebMedQual approach in 2018


Health Information Technology Research Center, Isfahan University of Medical Sciences, Isfahan, Iran

Date of Submission17-Feb-2018
Date of Acceptance22-Sep-2018
Date of Web Publication29-Jan-2019

Correspondence Address:
Dr. Sakineh Saghaeiannejad-Isfahani
Health Information Technology Research Center, Isfahan University of Medical Sciences, Isfahan
Iran
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/jehp.jehp_48_18

Rights and Permissions
  Abstract 

INTRODUCTION: Hospital websites are one of the most important communication and information distribution tools in hospitals. Evaluation of hospital websites based on different aspects including design, content, accessibility, and other related criteria can determine hospitals' situation in the use of novel information technologies. Therefore, this study aims to evaluate public hospital websites of Isfahan using WebMedQual approach.
MATERIALS AND METHODS: This study is an applied study carried out using a survey method which evaluated the public hospital websites of Isfahan using WebMedQual scale in the year 2015. Validity and reliability of the scale was confirmed. This scale includes 8 main components, 8 subcomponents, 95 items, and 3 supplementary questions. The study population included 17 public hospital websites in the city of Isfahan. Data were analyzed using SPSS version 22 software.
RESULTS: Based on the general score of WebMedQual scale, the websites of Noor and Ali Asghar hospitals with 42.21% had the highest and the website of Ibn Sina hospital with 22.81% had the lowest score. Findings also showed that among eight factors used in this scale, design with 59.96% and accessibility with 44.70% had the highest average scores. On the other hand, source credibility, user support, and privacy have the lowest average scores with averages of 22.87%, 21.56%, and 1.63%, respectively. The total average score of all factors was 31.94%.
CONCLUSION: Scores showed that based on WebMedQual, public hospital websites in Isfahan have low quality. Therefore, it is necessary to review and make corrections regarding privacy and confidentiality guidelines, update website information, website content (clinical content and other contents) and website writers, and provide forums and other design-related factors for these websites.

Keywords: Evaluation, health information, hospital, website


How to cite this article:
Saghaeiannejad-Isfahani S, Abumasoudi RS, Esmaeli N, Saberi T, Mahmodi N. Evaluation of the website of public hospitals in Isfahan with the WebMedQual approach in 2018. J Edu Health Promot 2019;8:7

How to cite this URL:
Saghaeiannejad-Isfahani S, Abumasoudi RS, Esmaeli N, Saberi T, Mahmodi N. Evaluation of the website of public hospitals in Isfahan with the WebMedQual approach in 2018. J Edu Health Promot [serial online] 2019 [cited 2019 Jul 23];8:7. Available from: http://www.jehp.net/text.asp?2019/8/1/7/250947


  Introduction Top


World Wide Web (WWW) is the most important information distribution tool[1] and currently, websites can be considered as the most important professional media outlets.[2],[3] Hospital websites are one of these information networks and their varieties depend on the needs of patients, health-care providers, and health centers.

Health information is one of the three highly popular topics of Internet users, and every day, many people worldwide visit health-center websites to gather their health-related information.[4],[5] Clinical and nonclinical staff of hospitals also require access to accurate information generated in each health center for patient and hospital management tasks. It is possible to gather, store, and retrieve relevant information using patient's information management systems such as hospital information systems, electronic patient's files, and Internet websites. Hospital websites can also be used as an important communication tool in society. For example, during social crises, hospitals can answer public queries using their websites.[6]

In the last two decades in which WWW has become a widespread tool for increasing people's access to information, hospitals have attempted to develop their websites to provide access to necessary information for their customers. However, it seems that most hospitals have failed to get a clear view of facilities, services, and resources necessary for users and suitable accessibility options.[7] This is despite the fact that hospital websites should provide a system for information exchange and communication between patients, hospital, and treatment staff.[4],[8] Hospital managers have a high incrimination toward the use of computer facilities to access patient's information for decision-making activities. The most important and vital reason for creating and optimizing hospital websites is the fact that, under current conditions, these websites are not suitable for providing information for hospital staff and patients.[4]

Hospital websites require characteristics such as high credibility, facilitating of constant communication, training and staff members and patients through accepted scientific content, easy of access, information privacy, and design based on users' needs. Researchers attempting to evaluate the quality of hospital websites proposed a specific scale based on the needs of hospital websites called WebMedQual. This scale measures the success of hospital websites in increasing user satisfaction. Despite the development of hospital websites in recent years, the websites successful in attracting users are the ones which offer suitable services in a timely fashion and with attractive and user-friendly content.[4] If users are unable to effectively access their information needs, they will give up on the website and more to other sources. Evaluation of hospital websites measures their attractiveness and execution of their stated aims. This evaluation can also help website designers to determine any present design errors.[4]

Kumar Singh et al. implemented a model for equality evaluation of websites. Their findings showed that multimedia facilities had the highest and credibility had the lowest ranking. Characteristics such as ease-of-use, esthetics, and content also had acceptable scores.[9] Salarvand et al. determined the quality indicators of hospital websites. Their findings indicated that, given the importance of hospital website quality and medical tourism, it is better for hospital websites to be useful, helpful, efficient, credible, secure, and accessible to increase customer satisfaction.[10]

The current study investigates aspects such as provided information, legibility, accessibility, design, reception and queueing services, up-to-date information, and public relations.

HagertyP (2012) evaluated the quality of hospital websites in Norway dedicated to cancer treatment. His finding showed that hospital websites offer useful information for cancer patients and their families, but that these websites are not effective or attractive.[11] Joaquín Mira et. al. (2006) evaluated the quality of public hospital websites in Spain. Their findings showed that these websites satisfied legibility criteria but failed to satisfy accessibility criteria.[12] Teymour Pour (1390) ranked the hospital websites of the Ministry of Health based on the webometrics criteria. In this ranking, hospital websites of medical science universities of Tehran, Shiraz, and Mashhad had the highest ranks.[13] Zahedi et al. (2013) evaluated the quality of Farsi websites related to addiction. Their findings showed that Farsi websites related to addiction had generally low quality.[14] Findings by Khaleghi & Davarpanah (2003) showed that more than half of the evaluated websites had acceptable conditions.[15] Jahanbakhsh et al. (2018) compared the quality of hospital websites for public and private hospitals in Isfahan. Their results showed statistically significant differences in four main criteria of “content information and methods,” “reception and queueing services,” “design characteristics,” and “up-to-date pages and public relations.”[16]

The results of previous studies indicate that the quality of hospital websites is low in general with mediocre scores in regard to structure and very low scores in regard to content. Many studies failed to precisely determine the capabilities and weaknesses of hospital websites. Therefore, the current study aims to evaluate the current quality situation of public hospital websites of Isfahan based on website content, source credibility, design, accessibility, website links, user support, and privacy based on the WebMedQual scale.


  Materials and Methods Top


This is an applied, descriptive, and cross-sectional study. The study population consisted of all public hospital websites of Isfahan (17 hospitals) which were evaluated using survey method. Based on the literature review, the first attempt for comprehensive quality evaluation and improvement of health-care websites was presented in the article titled “The initial development of the WebMedQual scale: Domain assessment of the construct of quality of health websites” by Provost et al. in 2006.[17] Therefore, the WebMedQual scale was used in the current study due to its comprehensiveness and relation to health-care activities.

The WebMedQual scale is a checklist and one of the most comprehensive quality evaluation scales for medical websites extracted form 26 sources. This scale includes 8 main components, 8 subcomponents, 95 items, and 3 supplementary questions. The main components include website content, source credibility, design, accessibility and usefulness, files, user support, privacy, and e-commerce (due to optional nature of the e-commerce component, it was not used in the current study). Subcomponents of the scale include content, up-to-date information, credibility and citation of information, intended audience (audience groups), disclosure of writer and site manager identities, discloser of website sponsors, contact address and feedback mechanisms, and access to resources, and information sources for users. To determine the validity of the scale, copies were translated and presented to the center of statistics and informatics, department of management and medical information technology, and department of medical informatics of Isfahan University of Medical Sciences and evaluated by experts.

Data gathering was carried out through observation and filling of the checklist. Data gathering was carried out after initial training and review of websites by design experts and through careful observation of studied websites. The scoring method of the checklist is based on the two-value scoring (yes or no), and data analysis was carried out using SPSS version 22 software (IBM SPSS Statistics for Windows, Version 22.0. Armonk, NY: IBM Corp). Due to the possibility of changes in websites, all websites were evaluated in a 15-day period in January 2015. The average scores were categorized for each hospital and each main component of the checklist as very good (81–100), good (61–80), mediocre (41–60), weak (21–40), and very weak (0–20).


  Results Top


The findings regarding content, source credibility, design, accessibility, links, user support, and privacy of each hospital website based on the WebMedQual scale are presented in [Table 1].
Table 1: Scores of public hospital websites of Isfahan based on score percentage

Click here to view


As can be seen in [Table 1], in regard to website content (quality, credibility, accuracy, and depth), Askarieh, Family, and Farabi hospitals had the highest score percentage with 52.63%, while Hazrat-E-Zahra, Chamran, and Milad hospitals had the lowest average score of 21.05% in regard to source credibility, websites of Farabi and Askarieh hospitals with 33.33% and website of Al Zahra hospital with 11.11% had the highest and lowest scores, respectively. In website design, Al Zahra hospital had the highest score of 81.82% and Sina hospital had the lowest score of 40.51%. In regard to accessibility, Milad hospital had the highest ranking with average score of 80%, while Imam Hossein pediatrics hospital had the lowest score with 20%. In links, Noor and Ali Asghar hospitals had the highest average score of 75% and Sina and Family hospitals had the lowest ranking with no scores. In regard to user support, Askarieh hospital had the highest ranking with 44.44% and Chamran and Sina hospital websites with no scores had the lowest ranking. In privacy, Milad, Noor, and Ali Asghar hospitals with 11.11% and Kashani with 5.56% had the first to third ranks, and other hospitals had no scores in this component.

Findings regarding total scores in components of content, source credibility, design, accessibility, links, user support, and privacy based on the WebMedQual scale are presented in [Figure 1].
Figure 1: Total scores in each component

Click here to view


Total average scores of different components show that, in total, websites had the highest average score in design component with 59.96% and the lowest average score in privacy with 1.63% [Figure 1].


  Discussion Top


As can be seen from the findings of this study, the average score of public hospital websites based on the WebMedQual scale is weak and below average in all components (except design). Previous studies which have used a variety of different scales to evaluate websites also confirm the weaknesses of Farsi websites. Although scales and evaluation criteria in the current study and previous studies are different from each other, it is useful to compare these results with each other.

Zahedi et al.(2013) state that the quality of Farsi websites related to addiction is low.[14] Furthermore, according to HagertyP (2012), the hospital websites of Norway related to cancer were also not attractive.[11] Joaquín Mira et al.(2006) also state that none of the websites satisfy the essential needs and accessibility standards.[12] Farhadi Pour et al.(2014) in their studies state that Farsi websites for children and adolescents are far from desirable conditions.[18] Kaicker et al. reported mediocre quality for websites related to chronic pains.[19] Salarvand et al. (2016)[10] and Shadpour et al. (2013)[13] also reported similar results. The findings of the study by Griffiths and Christensen showed the low quality of information in websites about depression. They stated that although investigated websites contain useful information, they had generally low quality of information.[20] Although different scales were used in different studies to measure different components in different samples, the results are mostly compatible with each other.

On the other hand, Ajili et al. (2017) stated that journal websites had satisfactory conditions in regard to esthetics, structure, and content.[21] Khaleghi & Davarpanah (2003) also stated that more than half of investigated websites had acceptable quality,[15] both of which are the opposite of the results of the current study.

Kumar Singh et al. stated that credibility component has the lowest score[9] which agrees with the results of the current study.

Furthermore, it is worth mentioning that the current study investigates more components in the evaluation of websites compared to previous studies. Therefore, we can claim that our study offers a more comprehensive and extensive evaluation of hospital websites. Based on the results of the current study and previous works, we suggest that users should have a critical view toward the contents of these websites and do not trust the accuracy of contents without first considering source credibility criteria. Furthermore, it is necessary for website designers to pay special attention to design components such as content, design, and accessibility while also considering components such as website links, scientific credibility, and accessibility of website services. This helps provide useful health information for websites' users and improves the quality of websites as a result.

The most important limitation of the current study was lack of website maps and categorization of provided information and services and scattered information which increased the time necessary for filling the checklist.


  Conclusion Top


By evaluating the total average scores of public hospital websites in Isfahan based on the WebMedQual scale, it is clear that none of these websites are in desirable conditions. It seems that these undesirable conditions are due to lack of consultation with experts, lack of attention to website design principles, and lack of content management and monitoring. Use of experts in website design, attention to the importance of design, and hospital rankings can be among valuable steps in improving the quality of hospital websites. In general, the reasons for low-quality score of websites based on the WebMedQual scale are as follows:

  • Lack of clinical content and health information on websites
  • Lack of up-to-date information
  • Lack of citation
  • Lack of forums for website users
  • Lack of FAQ menu in websites
  • Lack of capabilities for selecting more than one language
  • Lack of possibility for contacting hospital management and staff
  • Lack of information regarding privacy, guidelines, and confidentiality of information.


Since hospital websites provide a useful method of communication between the hospital, patients, and medical teams, they can help improve the quality of services provided for patients. Hospital websites with coordinated structure and content can increase the efficiency and user satisfaction. Furthermore, the key to improving the quality of hospital websites is considering criteria such as content quality and credibility, quality of links to other websites, and privacy and confidentiality of personal information and care in design components of the website. To reach the quality goals, a comprehensive effort by subject experts and website designers is necessary. However, these efforts will not reach fruition without the help of management and regulatory organizations at the national level.

Acknowledgments

This article has been extracted from a proposal no. 293037 of Health Information Technology Research Center of IUMS. The authors would like to extend their deep and sincere gratitude to each and every one of those who helped them.

Financial support and sponsorship

This study was financially supported by Isfahan University of Medical Sciences.

Conflicts of interest

There are no conflicts of interest.

 
  References Top

1.
Mehrad J, Binesh SM. Evaluation of web sites retrieved by two ODP and YAHOO web site guides in the field of library science and information based on content and performance criteria. Libr Inf Sci 2008;37:25-39.  Back to cited text no. 1
    
2.
Lundeen JD, Warr RJ, Cortes CG, Wallis F, Coleman JJ. The development of a clinical peer review tool. Nurs Educ Perspect 2018;39:43-5.  Back to cited text no. 2
    
3.
Fasugba O, Koerner J, Bennett N, Burrell S, Laguitan R, Hoskins A, et al. Development and evaluation of a website for surveillance of healthcare-associated urinary tract infections in Australia. J Hosp Infect 2018;99:98-102.  Back to cited text no. 3
    
4.
Moradi G, Ahmadi M, Zohoor A, Ebadi Fardazar F. Structure and Content analysis of selected educational hospitals in 2007. Health Inf Manage 2008;4:175-84.  Back to cited text no. 4
    
5.
Inthiran A, Macredie RD. Older Adults' Perception of Online Health Webpages Using Eye Tracking Technology. InInternational Conference on Information Theoretic Security 2018 Jan 10 (pp. 531-537). Springer, Cham.  Back to cited text no. 5
    
6.
Baumel A. Making the case for a feasible evaluation method of available E-mental health products. Adm Policy Ment Health 2018;45:1-4.  Back to cited text no. 6
    
7.
Olteanu A, Peshterliev S, Liu X, Aberer K. Web credibility: Features exploration and credibility prediction. 35th European Conference on Advances in Information Retrieval 24-27 March, 2013. Moscow, Russia; 2013.  Back to cited text no. 7
    
8.
O'Loan LM, Alexander AM, Evans DM. Evaluation of a self-development programme for hospital pharmacy technicians. Stroke 2018;13:57.  Back to cited text no. 8
    
9.
Kumar Singh K, Kumar P, Mathur J. Implementation of a model for websites quality evaluation- DU website. Int J Innov Adv Comput Sci 2014;3:27-37.  Back to cited text no. 9
    
10.
Salarvand S, Sheikh Abumasoudi R, Kashani F, Samadbeik M, Salarvand H. Assessing the necessitate quality indicators of hospitals' websites (A literature review). JHOSP 2016;15:87-100.  Back to cited text no. 10
    
11.
Hagerty P. The metaverse pioneers and the colonization of OpenSimulator. Metaverse Creat (New title: Virtual Creativity) 2012;2:97-114.  Back to cited text no. 11
    
12.
Joaquín Mira J, Llinás G, Tomás O, Pérez-Jover V. Quality of websites in Spanish public hospitals. Med Inform Internet Med 2006;31:23-44.  Back to cited text no. 12
    
13.
Shadpour P, Teimourpour B, Asadi R. (2013) Webometrics-based Analysis and Ranking of Iranian Hospital Websites, Int J Hosp Res, vol 2 (2), Spring 2013, pages 77-84.  Back to cited text no. 13
    
14.
Zahedi R, Taheri B, Shahrzadi L, Tazhibi M, Ashrafi-Rizi H. Quality of Persian addiction websites: A survey based on silberg, discern and wqet instruments (2011). Acta Inform Med 2013;21:46-50.  Back to cited text no. 14
    
15.
Khaleghi N, Davarpanah MR. Check the the website of Iranian state general evaluation criteria. J Educ Psychol 2003;43:121-43.  Back to cited text no. 15
    
16.
Jahanbakhsh M, Mithinfar M, Soghayannejad Esfahani S. Comparative evaluation of websites of public and private hospitals in Isfahan. Health Inf Manage 2018;14:199-204.  Back to cited text no. 16
    
17.
Provost M, Koompalum D, Dong D, Martin BC. The initial development of the webMedQual scale: Domain assessment of the construct of quality of health web sites. Int J Med Inform 2006;75:42-57.  Back to cited text no. 17
    
18.
Farhadpour R, Khalfabadi, R. Qualitative assessment of Iranian children and adolescents' websites using the web-based QWAI model. Q Natl Stud Libr Inf Organ 2014;26:91-110.  Back to cited text no. 18
    
19.
Kaicker J, Debono VB, Dang W, Buckley N, Thabane L. Assessment of the quality and variability of health information on chronic pain websites using the DISCERN instrument. BMC Med 2010;8:59.  Back to cited text no. 19
    
20.
Griffiths KM, Tang TT, Hawking D, Christensen H. Automated assessment of the quality of depression websites. J Med Internet Res 2005;7:e59.  Back to cited text no. 20
    
21.
Ajili F, Hajiahmadi S, Mohammadi M. Websites of Iranian Scientific Journals: Investing in structural content and visual features in websites. Inf Res Public Libr 2017;23:265-80.  Back to cited text no. 21
    


    Figures

  [Figure 1]
 
 
    Tables

  [Table 1]



 

Top
Previous article  Next article
 
  Search
 
Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
Access Statistics
Email Alert *
Add to My List *
* Registration required (free)

 
  In this article
Abstract
Introduction
Materials and Me...
Results
Discussion
Conclusion
References
Article Figures
Article Tables

 Article Access Statistics
    Viewed260    
    Printed27    
    Emailed0    
    PDF Downloaded45    
    Comments [Add]    

Recommend this journal