Using mobile devices and emergent technology for in-situ evaluations
All position
papers in one file
Click on the above link "All
position papers in one file", to download a pdf file all the accepted position papers combined in
one file. Below you can download the individual papers accepted for this workshop.
1 Position
paper
In performing field evaluations of technology, it is important to
understand the context while analyzing the results. In this position
paper, we present two methods for recording video in-situ to
support thinking-aloud with key visuals. We discuss their
implications in the field as we observed them in evaluating a
mobile wayfinding system. A third alternative to the videorecordings
that had to go untested so far is presented providing a
slightly different approach with interesting opportunities, but also
having other implications for study design.
Arjan Geven, CURE Center for Usability Research & Engineering, Austria
Reinhard Sefelin, CURE Center for Usability Research & Engineering, Austria
Manfred Tscheligi, CURE Center for Usability Research & Engineering / University of Salzburg, Austria
2 Position
paper
Existing methods for evaluating user experience have proven
to have serious shortcomings with regards to the emerging
services and systems within mobile, pervasive and ubiquitous
computing. Due to the way these systems are often dependent
on the context in which they are used, it is widely
believed that they should optimally be evaluated in the field.
The paper will present our thoughts about in-situ evaluations
through automated remote data capture and analysis
in general and our experiences from applying a prototype
framework in a field trial of a mobile diabetes management
service in particular. The focus of the latter has been on
investigating the user experience by identifying use patterns
and looking at quantitative aspects of user activities.
Kasper Løvborg Jensen, Aalborg University, Denmark
Lars Bo Larsen, Aalborg University, Denmark
3 Position
paper
One potential breakthrough application of real-time mobile
device sensing data is the ability to effect changes in the social
systems in real time. This data can come from devices that we
carry with us anyway: our cell phones, our name tags, and other
computing devices. As we have shown in previous work, by
using this data in offline analysis we can use this information to
not only identify social ties, but also the context of those ties.
The next necessary step is to define a model for how this data
should be used to mold individual behavior and organizational
structure.
Benjamin N. Waber, MIT Media Laboratory, USA
Alex “Sandy” Pentland, MIT Media Laboratory, USA
4 Position
paper
Navigational skills are often disrupted in people with cognitive
impairments. Navigation devices are being developed to support
community navigation. Selecting an effective mode to provide
route-prompts is a critical design issue. This study evaluated the
differential effects on pedestrian route finding using four different
modes of prompting delivered via an electronic device for
travelers with severe cognitive impairments: (1) aerial map image,
(2) point of view map image, (3) audio direction/no image and (4)
text based instructions/no image. Twenty travelers with severe
cognitive impairments walked four equivalent routes using four
different prompting modes delivered via a wrist-worn navigation
device. Results of the repeated measures Analysis of Variance
suggested that participants performed best when given prompts
via speech-based audio directions. The majority of the participants
also preferred this prompting mode.
Stephen Fickas, University of
Oregon, USA
Xiangkui Yao, University of Oregon, USA
McKay Sohlberg, University of Oregon, USA
Pei-Fang Hung, University of Oregon, USA
5 Position
paper
This paper reports on the deployment of a open, public SMS
service, Txt-2-DISplay, at a public event hosted by a university.
The service enabled texting to a public display in the foyer of a
building inhabited by ‘regulars’, largely known to each other and
with some previous association with the building, and ‘visitors’
who were visiting the building for the day. Here we describe the
design of the display and present a summary of the messages sent
to the service. We then discuss the implications of our experiences
for the evaluation of mobile and ubiquitous systems and present
some conclusions regarding usage of this ‘technology probe’
reflect on our approach as a means of evaluating such public
interactions.
Connor Graham, Lancaster University, UK
Ivo Widjaja, University of Melbourne, Australia
Mark Rouncefield, Lancaster University, UK
