Skip to main content

Museums and the Web

An annual conference exploring the social, cultural, design, technological, economic, and organizational issues of culture, science and heritage on-line.

Exploring Affective Computing for Enhancing the Museum Experience with Online Collections

Abstract

Introduction

Traditionally, the focus of online museum collections has been to facilitate access and discovery for subject category experts seeking information about objects in the collection (Rayward & Twidale, 1999). Today, museums observe an increasing number of ‘untrained eyes’ visiting their online collections to browse or search art collections for intrinsic enjoyment and leisure (Marty, Sayre, & Fantoni, 2011; Packer, 2010). Research by the Steve.museum social tagging project has demonstrated that the language used by novice visitors to describe works of art differs significantly from that descriptive metadata used by museums to describe the same collections (Trant, 2009). Many visitors to museums’ online collections seek experience-centered online experiences that can be fun and pleasurable, rather than a suite of advanced features.

However, most of today’s online collections do not fully support such an experience-centered environment. A quick survey could show that these systems lack not only functionality, but also the appropriate affective and hedonic aspects necessary to support such an experience (Blythe, Wright, McCarthy, & Bertelsen, 2006). It is necessary to take holistic approaches for online museum experiences, which go beyond accessibility and functionality, to address the aspects of emotional interaction (Johnson, Gardner, & Wiles, 2004).   

 

Research Outline

Using the online collection of the Indianapolis Museum of Art (IMA), this study seeks to design and implement an affective online search and retrieval system for visitors who may have general interests in art, but may not know where to start.  Techniques from the affective computing literature will be applied to develop an affective embedded agent that can recognize and respond to the users’ expressed emotions and preferences. Social tagging tools will be used to record the visitors’ subjective views and interests in arts. These social tags will inform the affective agent and allow it to interact with visitors based on this information.

Because the proposed agent uses interactive techniques to incorporate the users’ emotions and preferences during the image retrieval process, the untrained online visitors can easily refine their interests about art collections and map those interests to terminology and metadata maintained by the museum. As such, online visitors do not need to be subject matter experts with knowledge in art historical terminology to navigate art collections; an enjoyable browsing experience can be created to support visitors’ known and unknown preferences. This study can contribute to the field of museum technology by providing empirical guidelines on how an affective agent can be designed and influence the internal state of a person to improve overall museum experience in an online setting.

 

Conclusion

When combined with user-generated social tags, an embedded agent can be a powerful search method that provides ‘general-purpose question-answering capabilities’ in the context of online museums (Etzioni, 2011). We hope our research serves to broaden our understanding of the role that emotions play in use of search and retrieval systems by novices, and that it will provide useful guidelines for the online museum community in studying interactions with systems that are intelligent and sensitive to online visitors’ emotions and preferences.

 

References

  1. Blythe, M., Wright, P., McCarthy, J., Bertelsen, O. W. (2006). Theory and Method for Experience Centered Design, CHI 2006, April 22-27, Montreal, Canada.

 

  1. Etzioni, O. (2011). “Search needs a shake-up,” Nature, Macmillan Publishers Limited, 476, 25-26.

 

  1. Johnson, D., Gardner, J., & Wiles, J. (2004). Experience as a moderator of the media equation: the impact of flattery and praise, International Journal of Human-Computer Studies, 61, 237-258.

 

  1. Marty, P. F., Sayre, S., & Fantoni, S. (2011). Personal digital collections: Involving users in the co-creation of digital cultural heritage. In G. Styliaras, D. Koukopoulos, & F. Lazarinis (Eds.), Handbook of research on technologies and cultural heritage: Applications and environments (pp. 285–304). Hershey, PA: IGI Global.

 

  1. Packer, J. (2010). Beyond Learning: Exploring Visitors’Perceptions of the Value and Benefits of Museum Experiences Curator, The Museum Journal, 51(1), 33-54.

 

  1. Rayward, W. B. & Twidale, M. B. (1999). From Docent to Cyberdocent: Education and Guidancein the Virtual Museum, Archives and Museum Informatics, Volume 13, Number 1, 23-53.

 

  1. Trant, J. (2009). Tagging, Folksonomy and Art Museums: Results of steve.museum’s research, Archives & Museum Informatics, http://conference.archimuse.com/files/trantSteveResearchReport2008.pdf

Type: 

Paper - in formal session

Authors

Gunho's picture
I graduated the Seoul National University Department of Communication, and got my master degree at KAIST Graduate School of Culture Technology(GSCT). I and currently a Ph.D candidate at KAIST Graduate School of Culture Technology(GSCT). I hold special interest in alternative methods of...
sp347's picture
I am a UX designer and a research scientist in human-computer interaction, affective computing, human factors, online trust, and cross-gender/cultural research. My professional goal is to design systems that can recognize and respond to users' emotions in culturally sensitive ways. While working...
rjstein's picture
Robert Stein is the Deputy Director for Research, Technology and Engagement at the Indianapolis Museum of Art (IMA). In that role, Stein leads a wide range of activities for the museum including an extensive effort in media, web technology and software. Since 2006, he has played a significant role...
Jungwha's picture
Professor Jungwha Kim is a professor at KAIST .She received her DEA from the department of formative arts theory from the Paris-Sorbonne University (Paris IV). She was the commissioner of the 2007 Spain ARCO partner country event, Director of the Cultural Events Hannover Messe Partner country Korea...
sw53's picture
Human-computer interaction End-user programming/development Cognition of programming Studies of web behavior