Fall 2015

Interaction Design Research

COGS 230 / CSE 216

Tuesday & Thursday, 3:30PM – 4:50PM, CSE 4140

Piazza link

Scott Klemmer, Office Hours: Thursdays, Atkinson 1601B5:00PM – 6:00PM

taAilie Fraser, Office Hours: Tuesdays 5:00PM – 6:00PM, Atkinson 1601

Atkinson 1601 is just past the elevator on your right. Please come to office hours with any and all questions, from feedback on your coursework to broader questions about the field and jobs. So that we also have time to do our own research, we will not respond to email from students.


This course is a broad graduate-level introduction to interaction design research. The course begins with seminal work on interactive systems, and moves through current and future research areas in interaction techniques and the design, prototyping, and evaluation of user interfaces. Topics include social computing, crowdsourcing, software tools, design and evaluation methods, ubiquitous and context-aware computing, tangible interfaces, and mobile interfaces.

COGS 230 / CSE 216 is a 4-unit course, open to all doctoral students.
Masters students should have taken an intro HCI course like COGS 120 / CSE 170 Human-computer Interaction Design.
Undergrads may enroll in this course if they have two prerequisites: Cogs 14a or CSE 20, AND an A- or better in Cogs 120 or 102C.
Students registered for the class will receive a letter grade; the "credit/no credit" option is not available.
Students in this course are encouraged to enroll in the Design at Large seminar for 1 unit (details).

Course Structure

The course comprises two pieces: reading and discussing research papers, and a quarter-long research project.

For each class period, students will submit short commentaries on the assigned readings (submitted online in this format by 7am on the day of class). After 7am on the day of class, all commentaries will be made available for other students to read (again, through the online submission system). The discussion leader and course staff will all read these before class to prepare for discussion. Students are expected to do all of the readings; commentaries are only required for those marked on the syllabus.

Students will lead one class discussion each. In preparation for that, carefully read this explanation on how to structure a discussion. The discussant(s) should meet with the course staff at the end of the previous class - come to this meeting with a plan for your discussion. On discussion day, students submit their materials instead of their commentary using the online submission system. The discussant should read all student commentaries before class and integrate them into the discussion. Finally, the discussant is responsible for grading the student commentaries.


Note: Some readings require UC San Diego authentication. To access these resources from home you will need to go through UCSD's Web Proxy or run UCSD'S VPN

This class was created by Scott Klemmer in 2004, and benefits from contributions by Jeff Heer and Michael Bernstein. Thanks to UserTesting for enabling students to test work online.
Date Topic


24 Sept Foundations


The Computer for the 21st Century, Mark Weiser, Scientific American, September 1991, pp. 94 - 104.
29 Sept
Ubiquitous Computing

Getting in Touch, Paul Dourish in 'Where the Action is: The Foundations of Embodied Interaction', MIT Press, 2001, pp. 25-53

Skinput: Appropriating the Body as an Input Surface, Chris Harrison, Desney Tan, and Dan Morris. CHI 2010.
Skinput demo video!
1 Oct
Collective Intelligence

Predicting protein structures with a multiplayer online game. Seth Cooper, Firas Khatib, Adrien Treuille, Janos Barbero, Jeehyung Lee, Michael Beenen, Andrew Leaver-Fay, David Baker, Zoran Popovic & Foldit players. Nature 2010.
Demo Video 1- side chains- 3:30 onwards
Video 2- EteRNA
Center for Game Science, U Dub

Soylent: A Word Processor with a Crowd Inside. Bernstein, M., Little, G., Miller, R.C., Hartmann, B., Ackerman, M., Karger, D.R., Crowell, D., and Panovich, K. In Proc. UIST 2010. ACM Press.

Research Group Partner Choices due at end of class

6 Oct Social Computing

Evidence-based social design: Introduction Paul Resnick, Robert Kraut, Evidence-based social design: Mining the social sciences to build online communities. Cambridge, MA: MIT Press. Read through Section 5.

Distance Matters Gary M. Olson, Judith S. Olson. Journal Human-Computer Interaction, 2000
8 Oct Research

The Science of Design, Herbert A. Simon in The Sciences of the Artificial, 1969, pp. 128-159.

Pasteur's Quadrant, Ch. 3, Stokes D.E., pp 58-89

Project Abstract Draft Due at 7:00am - Submit Online as pdf pnly

13 Oct Design Process

Parallel Prototyping Leads to Better Design Results, More Divergence, and Increased Self-Efficacy Dow S.P, Glassco A., Kass J., Schwarz M., Schwartz D., Klemmer, S. Transactions on Computer-Human Interaction, 11(4), 2010.

Design-oriented human-computer interaction. Fallman, D. CHI 2003.


State of Design: How Design Education Must Change. Don Norman and Scott Klemmer LinkedIn 2014.
15 Oct Studying Behavior

Methodology Matters: Doing Research in the behavioral and social sciences, Joseph E. McGrath, in Readings in Human-Computer Interaction: Toward the Year 2000, R. M. Baecker, J. Grudin, W. A. S. Buxton, S. Greenberg, ed., 1995, pp. 154-169.
(Start at "Research Methods as Opportunities and Limitations")

Creative Hypothesis Generating in Psychology: Some Useful Heuristics, McGuire, W.J., Annual Review of Psychology, 48(1), 1-30.
20 Oct

Project Abstract Final Due at 7:00am - Submit Online as pdf pnly

Please sign up for Project Progress Meetings.

22 Oct Gathering Data

How to Do Experiments Ch. 2, David W. Martin in 'Doing Psychology Experiments', pp. 25-41 2008.

Getting Ready to Conduct Your Interviews Ch. 3, Steve Portigal in 'Interviewing Users', pp. 12-27 2013.
27 Oct Web experiments

Controlled experiments on the web: survey and practical guide Ron Kohavi, Roger Longbotham, Dan Sommerfield, Randal M. Henne. Data Mining and Knowledge Discovery (2009)


Experimental evidence of massive-scale emotional contagion through social networks Adam D. I. Kramera, Jamie E. Guillory, Jeffrey T. Hancock PNAS 2014


Goodbye, Google. Douglas Bowman Blog post, 2009
29 Oct Design Tools

Ability-Based Design: Concept, Principles and Examples. Jacob O. Wobbrock, Shaun K. Kane, Krzysztof Z. Gajos, Susumu Harada, and Jon Froehlich ACM Trans. Access. Comput., 3:9:1-9:27, April 2011.


Example-Centric Programming: Integrating Web Search into the Development Environment. Brandt, J., Dontcheva, M., Weskamp, M., Klemmer, S.R. CHI 2010.


*Impact*: Blueprint in Bing code search.
3 Nov Tools

Printed optics: 3D printing of embedded optical elements for interactive devices. Karl Willis, Eric Brockmeyer, Scott Hudson, and Ivan Poupyrev. UIST 2012.


Past, Present, and Future of User Interface Software Tools, Brad Myers, Scott E. Hudson, Randy Pausch, ACM Transactions on Computer-Human Interaction, March 2000, pp. 3 - 28.
5 Nov Input Modalities

PixelTone: A Multimodal Interface for Image Editing. Gierad Laput, Mira Dontcheva, Gregg Wilensky, Walter Chang, Aseem Agarwala, Jason Linder, and Eytan Adar. CHI 2013.


Gestural interfaces: a step backward in usability. Don Norman, Jacob Nielsen.Magazine interactions Interactions Volume 17 Issue 5, September + October 2010 Pages 46-49
10 Nov Input Models
Discussant: Prof. Scott Klemmer

User Technology: From Pointing to Pondering. Stuart K. Card and Thomas P. Moran. ACM conference on the history of personal workstations 1986.


The Word-Gesture Keyboard: Reimagining Keyboard Interaction. Shumin Zhai and Per Ola Kristensson Communications of the ACM 2012.
12 Nov Collaboration


Beyond Being There. Jim Hollan and Scott Stornetta. CHI 1992.

Project Review in second half of class - please bring analysis plan

17 Nov Finding Information

Elementary Foraging Models. Peter Pirolli. Chapter 2: Information Foraging Theory.


Beyond Performance: Feature Awareness in Personalized Interfaces. Leah Findlater and Joanna McGrenere. International Journal of Human Computer Studies 2010.
19 Nov Learning at Scale

Peer and Self Assessment in Massive Online Classes, Chinmay Kulkarni, Koh Pang Wei, Huy Le, Daniel Chia, Kathryn Papadopoulos, Justin Cheng, Daphne Koller, Scott R. Klemmer. TOCHI 2013.


Bayesian Ordinal Peer Grading. K. Raman, T. Joachims, ACM Learning at Scale, 2015
24 Nov Active Learning

Cognitive Tutors: Technology Bringing Learning Science to the Classroom. Kenneth R. Koedinger Albert Corbett, Ch. 5 in The Cambridge Handbook of the Learning Sciences


"Chapter 2: The Design of Battleship Numberline". In Optimizing Motivation and Learning with Large-Scale Game Design Experiments. J. Derek Lomas PhD Dissertation, 2014.
26 Nov No class: Thanksgiving
1 Dec Attention


Cognitive Control in Media Multitaskers. Ophir, E., Nass, C., Wagner, A. Proceedings of the National Academy of Sciences.


Examining the robustness of sensor-based statistical models of human interruptibility. James Fogarty, Scott E. Hudson, Jennifer Lai CHI 2004 .
3 Dec Global Citizenship

Avaaj Otalo: A Field Study of an Interactive Voice Forum for Small Farmers in Rural India. Patel, N., Chittamuru, D., Jain, A., Dave, P., Parikh, T. CHI 2010.


The case for technology in developing regions. Brewer, E Demmer, M Du, Bowei W Ho, M Kam, M Nedevschi, S Pal, J Patra, Rabin, Surana, S Fall, K IEEE Perspectives.
6 Dec

Project Papers Due at at 11:59 pm - Submit Online as pdf pnly

7 Dec

Project Presentations - Submit online too! · 3:00pm – 6:00pm, CSE 1202