Adjustment and Development of Health User’s Mental Model Completeness Scale in Search Engines

Document Type : Articles

Authors

Abstract

Introduction: Users’ performance and their interaction with information retrieval systems can be observed in development of their mental models. Users, especially users of health, use mental models to facilitate their interactions with these systems and incomplete or incorrect models can cause problems for them . The aim of this study was the adjustment and development of health user’s mental model completeness scale in search engines.Method: This quantitative study uses Delphi method. Among various scales for users’ mental model completeness, Li’s scale was selected and some items were added to this scale based on previous valid literature. Delphi panel members were selected using purposeful sampling method, consisting of 20 and 18 participants in the first and second rounds, respectively. Kendall’s Coefficient of Concordance in SPSS version 16 was used as basis for agreement (95% confidence).Results:The Kendall coefficient of Concordance (W) was calculated to be 0.261(P-value<0.001) for the first and 0.336 (P-value<0.001) for the second round. Therefore, the study was found to be statistically significant with 95% confidence. Since the increase in the coefficient in two consecutive rounds was very little (equal to 0.075), surveying the panel members were stopped based on second Schmidt criterion and Delphi method was stopped after the second round. Finally, the dimensions of Li’s scale (existence and nature, search characteristics and levels of interaction) were confirmed again, but “indexing of pages or websites” was eliminated and “Difference between results of different search engines”, “possibility of access to similar or related webpages”, and “possibility of search for special formats and multimedia” were added to Li’s scale.Conclusion: In this study, the scale for mental model completeness of health users was adjusted and developed; it can help the designers of information retrieval systems in systematic development of these systems and can also help librarians and informatics experts in recognizing the necessary trainings for users in order to improve their information retrieval skills. Also, as a valid and adapted scale for Iranian universities of medical sciences, it can be used for investigating completeness level of health information users’ mental models of search engines.Keywords: Mental Model Completeness Scale, Health users, Search engines

References

  1. Sinkinson C, Alexander S, Hicks A, Kahn M. Guiding Design: Exposing Librarian and Student Mental Models of Research Guides. portal: Libraries and the Academy. 2012;12(1):63-84.
  2. Zhang Y. The construction of mental models of information-rich web spaces: The development process and the impact of task complexity: University of North Carolina at Chapel Hill; 2009.
  3. Zhang Y. The development of users’ mental models of MedlinePlus in information searching. Library & Information Science Research. 2013;35(2):159-70.
  4. Muramatsu J, Pratt W. Transparent Queries. 2001:217-24.
  5. Thatcher A, Greyling M. Mental models of search engines: How do search engines work. Human-centred Computing: Cognitive, social and ergonomics aspects Lawrence Erlbaum Associates Inc, Mahaw. 2003.
  6. Li P, Beheshti J, editors. Doctoral Students’ Mental Models of a Web Search Engine. CANADIAN JOURNAL OF INFORMATION AND LIBRARY SCIENCE-REVUE CANADIENNE DES SCIENCES DE L INFORMATION ET DE BIBLIOTHECONOMIE; 2005: CANADIAN ASSOC INFORMATION SCIENCE PO BOX 6174, STATION J, OTTAWA, ONTARIO K2A 1T2, CANADA.
  7. Mlilo S. Mental models: have users’ mental models of search engines improved in the last ten years? 2011.
  8. Alexandra D. Mental models and error behavior in an interactive bibliographic retrieval system: Ph. D. dissertation, 9, Ann Arbor, Mich.: University Microfilms International; 1990.
  9. Borgman CL. The user’s mental model of an information retrieval system: Effects on performance: Stanford University; 1984.
  10. Saxon SA. Seventh-grade students and electronic information retrieval systems: An exploratory study of mental model formation, completeness and change1997.
  11. Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000 Oct;32(4):1008-15.
  12. Powell C. The Delphi Technique: Myths and Realities. Methodological Issues in Nursing Research. 2003;41(4):376-82.Delphi survey technique. J Adv Nurs. 2000 Oct;32(4):1008-15.
  13. Dalkey N, Helmer O. An Experimental Application of the DELPHI Method to the Use of Experts. Management Science. 1963;9(3):458-67.
  14. Dalkey NC, Brown BB, Cochran S. The Delphi method: An experimental study of group opinion: Rand Corporation Santa Monica, CA; 1969.
  15. Woudenberg F. An Evolution of Delphi. Technological Foreeasting and Social Change. 1991.
  16. Faeizi K, Irandoost M. Delphi method: A method for Research and decision making. Tehran: Industrial Management Organization; 2013.
  17. Afshari B, al. e. [Internet in Libraries]. Tehran: Ketabdar; 1999.
  18. Asemi A, Bahraloo G. [Access to information in digital systems]. Tehran: Ketabdar; 2000.
  19. Clyde A. Search engines. Journal of National Studies on Librarianship and Information Organization. 1999;55:142-52.
  20. Johnson FC, Griffiths JR, Hartley RJ. DEVISE: a framework for the evaluation of internet search engines: CERLIM (Centre for Research in Library and Information Management); 2001.
  21. Mohamadifar D, Niakan S. Tools and skills for search in Web. Tehran: Chapar Publication; 1998.
  22. Soleymani H. Internet and Information. Tehran: Soleymani Publication; 2000.
  23. Baeza-Yates R, Berthier R. Modern Information Retrieval. Tehran: Chapar Publivation; 2005.
  24. Fahimnia F. A survey of Academic Information consertiums in Iran and other countries: The University of Tehran; 2000.
  25. Holman L. Millennial Students’ Mental Models of Search: Implications for Academic Librarians and Database Developers. The Journal of Academic Librarianship. 2011;37(1):19-27.
  26. Hochstotter N, Koch M. Standard parameters for searching behaviour in search engines and their empirical evaluation. Journal of Information Science. 2008;35(1):45-65.
  27. Marchionini G, Shneiderman B. Finding facts vs. browsing knowledge in hypertext systems. Computer. 1988;21(1):70-80.
  28. Zhang Y, Wang P. Measuring mental models: Rationales and instruments. Proceedings of the American Society for Information Science and Technology. 2005;42(1).
Health Management & Information Science
Volume 3, Issue 4 - Serial Number 4
19
October 2016
Pages 111-119

Files

Share

How to cite

Statistics