Workshop on Implicit Measures of User Interests and Preferences
Friday, August 1, 2003
The goal of the workshop on Implicit Measures is to explore how various implicit measures of user interests can be used in information retrieval and filtering applications where it is difficult to obtain explicit user feedback. Since this is the first workshop on this topic at SIGIR, we encourage participation from people with different backgrounds and perspectives including predictive modeling, experimental analysis, and applications development. Applications from information retrieval, collaborative filtering, e-commerce, user modeling, and human-computer interaction are encouraged. As an outcome of the workshop we hope to identify key theoretical modeling issues, systematize engineering principles and best practices, and spark new research directions.
NOTE: All people wishing to attend the workshop must submit a position statement before June 2, 2003. Submission details below.
Workshop Schedule (tentative)
9:00-9:15 - Introductions [S. Dumais, moderator]
10:00-10:30 - D. V. Sreenath (Wayne State University), W. I. Grosky (University of Michigan-Dearborn), F. Fotouhi (Wayne State University), Deriving emergent web page semantics. [Extended Abstract] [Talk] [K. Bharat, discussant]
10:30-11:00 - break
11:00-11:30 - David Brown and Mark Claypool (Worcester Polytechnic Institute), Curious Browsers: Automated gathering of implicit interest indicators by an instrumented browser. [Extended Abstract] [Talk] [T. Joachims, discussant]
12:00-12:30 - Douglas W. Oard (University of Maryland), Anton Leuski (University of Southern California), Stuart Stubblebine (Stubblebine Research Labs), Protecting privacy of observable behavior in distributed recommender systems. [Extended Abstract] [Talk] [A.Weigend, discussant]
12:30-2:00 - Lunch and Posters
Poster - Diane Kelly (Rutgers University), Understanding implicit feedback: A naturalistic user study. [Extended Abstract]
2:30-3:00 - J. Díez, J. J. del Coz, O. Luaces and A. Bahamonde (Universidad de Oviedo at Gijón), A clustering algorithm to find groups with homogeneous preferences. [Extended Abstract] [Talk] [S. Dumais, discussant]
3:30-4:00 - break
4:00-4:30 - Andreas Lorenz and Andreas Zimmermann (Fraunhofer Institute for Applied Information Technology), Inferring interests from user movements: The LISTEN approach. [Extended Abstract] [Talk - cancelled] [S. Dumais, discussant]
4:30-5:00 - Final Discussion and Wrap Up
In most information retrieval or filtering applications, it is difficult to get explicit feedback from users about the relevance of the results, the appropriateness of the presentation, and more generally about the quality of their experience. Yet explicit judgments are assumed by researchers for many activities like the tuning and selection of ranking algorithms, information combination, user modeling, information presentation, etc. This workshop will explore how implicit measures of user interest (such as dwell time, click through, and user activities like annotation, printing, and purchasing) can be used to develop predictive models for a variety of purposes. Example uses in the context of information retrieval include: improved ranking and relevance assessment (e.g., the extent to which implicit measures can be used to evaluate the quality of systems, ranking algorithms and recommendations, or as input to relevance feedback algorithms); personalization in search, filtering or presentation; personalization in the large considering both individual and aggregate data; browsing or searching agents; automatic hyperlink generation; and adaptive web site design. An examination of theoretical issues such as modeling approaches (Bayesian techniques and other predictive models), gold standards for user behavior (e.g., relevance judgments, purchases), combining implicit and explicit preferences, and biases introduced by reliance on implicit measures are also encouraged.
We encourage presentation and participation from both researchers who are interested in theoretical issues, and practitioners who have deployed systems that make use of implicit indicators of user interest.
Topics of interest include, but are not limited to:
Planned activities include invited talks or introductory overviews in key areas, short talks grouped by topic along with substantial discussion periods. The workshop will also include a closing discussion on lessons learned, open issues, and potential follow-ups.
Two kinds of participation are solicited:
All applicants must submit a short position statement (maximum 250 words) describing their background and interest in implicit measures of user interest and preferences. Participants who would like to present should submit an abstract (maximum 750 words) in addition detailing the major points and/or results they would present during a talk. Submissions of both kinds will be reviewed by the program committee and invitations issued. Workshop attendance will be limited to presenters and attendees selected by the committee based on their submissions.
Submissions are due on June 2, 2003 (5pm PST). Email your submissions (ascii or pdf preferred) to Susan Dumais, firstname.lastname@example.org.
A notebook of participants’ position statements and presentation descriptions will be distributed to all attendees. A summary of workshop activities and emerging issues and trends will be prepared for the SIGIR Forum by the organizers.
Last modified Apr 28, 2003. Please send comments or corrections to email@example.com