CSE 218: Advanced Topics in Software Engineering: Ubiquitous Computing (Fall 2014)

Research: (Discussion of research topics) [required]: 
Mondays, 9:00am-10:20am, 
EBU3B 2154 (CSE Building)

Projects: (Project presentations and troubleshooting) [required]
Wednesday, 9:00am-10:20am,
EBU3B 2154 (CSE Building) 

Lab Home Base (Space Available for experimenting): 
EBU3B B260 Computer Lab
-> TAs will be available at specific times: Mon: 6:30pm - 8:30 pm; Wed: 6:30pm - 8:30 pm

Teams meet-ups [required]:
Mon/Wed/Thu 6.30pm-9.00pm,
EBU3B (CSE Building) 2109, 2217, 3217 (see below for group assignments)

CSE 118/218 Piazza page:

Course website: http://thiscourse.com/ucsd/cse218/fa14/


Nadir Weibel (Professor)


Office: CSE 3224

Abhishek Ray (TA)

Office Hours: Wed 4-5pm in B250A

Sachin Kantipudi (TA)

Office Hours: Mon 9-10am in B275

Azeem Ghumman (Tutor)

Office Hours: Mon: 6:30pm - 8:30 pm; Wed: 6:30pm - 8:30 pm in B260

Course Description

The advent of affordable sensors and interaction devices (e.g., web cams, mobile phone based sensors, digital pensMicrosoft SenseCamMicrosoft KinectGoogle glassesportable eye-tracking, etc.) and wireless mobile computing devices (e.g., mobile smart phones, Arduino boards with 802.11b wireless connectivity, etc.) has created boundless opportunities for in-the-world computing applications that can transform our lives. This course explores these opportunities in the form of both a project-based class and a deep dive into research and technology on and around ubiquitous computing
On the one hand we will focus on the development of specific applications and interaction techniques based on those devices. On the other hand, we will critically discuss research and technology from the literature of ubiquitous computing, pervasive computing, and human-computer interaction. 

Every week a new ubiquitous computing device will be introduced and we will discuss the technology behind it, and how it has been used in research (i.e. reading and discussing technical and research papers). In addition we will form teams to undertake small research projects. The projects will involve the design and implementation of a ubiquitous computing application, based on one of the devices presented in class. We will focus on three technologies: Google Glass, Microsoft Kinect, and the EyeTribe eyetracking. Teams will span CSE 218 graduate students and CSE 118 undergraduates.Graduate students will take a leadership and management role in the project.

--> This year students will all work on solving one specific problem, i.e. communication for people affected by the Locked-In Syndrome.

On Mondays we will introduce new ubiquitous technology, learn about how it works and what can be done with it. On Wednesday we will initially discuss potential projects ideas and later present current development within the various teamStudents will be assigned 2-3 papers to read and annotate every week. Those papers will serve to build the foundations for a better understanding of the specific ubiquitous technology of the week. Every Monday selected students will be presenting research and technology and will be driving a panel-like discussion. Students will be engaged in continuous self and peer evaluations (During Week 3 we will have Research presentations both on Monday and Wednesday).

The Home Base Labs are an opportunity to exchange ideas with your peers in your and other groups and get a dedicated space in the lab in the basement. A TA will be present in the Computer Lab on XXXX 

Finally, every team will be required to meet on a regular base every week in one of the CSE-assigned rooms between 6.30pm-9pm. Work should be done also in other locations and at other times, but the instructors team will be popping into the rooms during the evening time to check on progress and offer advices and help.

The course will culminate in team presentations of the applications created and a final demo event for interested students and faculty.

Students will be graded based on their participation in the weekly paper discussion (reports, presentations and panel discussion), as well as their performance in the research project. See Details and Policies for a breakdown and an explanation of the grading. 

Being a class on Ubiquitous computing, all the students will be required to have a laptop, tablet, smart phone, etc. for both lectures (Mondays and Wednesdays). It will be used to participate in the student evaluations. See below for details.

Course Details and Policies

-Week 01: Introduction to Ubicomp and Accessibility (Locked-in Syndrome)
-Week 02: Eye-Tracking
-Week 03: Microsoft Kinect
-Week 05: Google Glass
-Week 06: Digital Pen and Paper
-Week 07: Smart Home and Smart Buildings 
-Week 08: SenseCam
-Week 09: Privacy and Security

Every Monday we will introduce a new ubiquitous technology (with the exception of week 1, when we will introduce Ubicomp and the Locked-in Syndrome ). All students will be assigned 2-3 papers on the topic of the week and they will be required to read them. Readings are key to be able to participate in discussion.

We will divide the discussion in two moments.

1) Initial presentation of the topic of the week (2 x 15min or 1x20min). Two pairs of students will present the weekly topic from a technological perspective (what is the technology, how does it work) and from a research perspective (how has this been used in research, what results have been achieved). In case only one presentation is given, this should combine technology and research. Every student will be asked to present one topic (either technology or research) throughout the quarter in collaboration with another student. 

--> 15/20min. oral presentations (both students will be required to present) will have to be prepared either using MS Powerpoint or Apple Keynote.

--> Every pair of student will be required to hand-in a 10-pages written report that will summarize the specific topic (technology or research). Student pairs are expected to read more than the 2-3 papers assigned to the whole class in order to be able to create a complete and cohesive argument. We will use the SIGCHI LaTeX template available here (a template w/o the copyright block is available here: http://ubicomp.ucsd.edu/cse218/docs/sigchi_notemplate.cls)and reports are due one week after the presentation (Monday of the next week). Upload reports here: http://ubicomp.ucsd.edu/cse218/topic-report/ 

2) Panel Discussion (30-40min). Four students (different than the presenters) will be staged on a panel-like discussion. The panel will be moderated by the Professor and the 4 panelist will have to answer questions and discuss their point-of view in turn. Participation of the rest of the students will be required. All students will be on the panel for one discussion throughout the quarter.

Students will be able to choose who to pair with and the topic they want to present, as well as the topic for which they want to be on the panel, however presentations and panels must be on different topics. Slots can be booked at this link (please enter your name and student #, and do not change any other details): http://goo.gl/nwyorQ

02 - 10/13Eye-TrackingTechnology: Pavan Kumar Pavagada Nagaraja & Sean Thomas Burke 

Research: Sneha Venkatesh Yelimeli & Brian Anderson
01: Patrick Phaneuf
02: Joey Ni
Sneha Yelimeli
 Sean Burke
03 - 10/20Kinect and Depth CamerasTechnology+Research: Patrick Phaneuf & Kristen Wetts
01: Amine Boumnade
Vincent Chan,
Sree Katamreddy
 Pavan Pavagada 
05: Thalley Gydesen
05 - 11/03Google Glass and Augmented RealityTechnology: Manindra Moharana & Joey Ni

Ryan Kral & Ailie Fraser
01: Brian Anderson
Narendran Thangarajan
Joey Ni
Soham Shah
Kristen Wetts
06 - 11/10Digital Pen and PaperTechnology+Research: Guo Li & Amine Boumnade
01: Sneha Yelimeli
02: Ailie Fraser 
Patrick Phaneuf
Manindra Moharana
Ryan Kral
07 - 11/17Smart Home and Smart BuildingsTechnology+Research: Soham Shah & Narendran Thangarajan
01: Amine Boumnade
Sree Katamreddy
Ryan Kral
04: Guo Li
Thalley Gydesen
08 - 11/24SenseCamTechnology+ResearchSree Katamreddy & Vincent Chan
01: Ailie Fraser 
Pavan Pavagada 
Narendran Thangarajan
Manindra Moharana
Brian Anderson
09 - 12/01Privacy and SecurityResearch: Thalley Gydesen & TBD01: Vincent Chan
Guo Li
Soham Shah
04: Kar Anita
Sean Burke

Every student will be expected to participate actively in the discussion and will be asked to self-evaluate his/her participation at the end of the discussion through a short online form available here: http://ubicomp.ucsd.edu/cse218/discussion/selfevaluation/
. Students in the audience will also have to evaluate the presenters through a short online form available here: http://ubicomp.ucsd.edu/cse218/presentation/evaluation/

Students will be required to hand-in a 1-page summary on the topic of the week, including references to research or technology (the 1 page excludes the space used for the bibliography). Please use the
 SIGCHI LaTeX template available here. Deadline for the 1-page summary is Friday of the same week. Upload your weekly summary here: http://ubicomp.ucsd.edu/cse218/weekly-summary/

Wednesday's will be dedicated to discuss the project and the team dynamics. Initially we will brainstorm in terms of possible approaches, but starting with Week 4 students will have to report on the progress of the team and on issues/problems with the team or project.

At the end of Week 3 every team will have to hand-in a project proposal that describes the approach that the team wants to take to solve the problem.

We will form 8 teams composed by 6-7 undergrad students (CSE 118) and 2-3 graduate students (CSE 218). Every team will receive for the duration of the quarter following equipment:

1x Kinect for Windows (we will work with version 1 instead of version 2)

Equipment has been generously sponsored by the Moxie Foundation. THANKS!

Teams should be assembled by the students depending on expertise and potential to work together. The instructors can help assembling the teams. We highly advise students to use the common Piazza page available here: http://piazza.com/ucsd/fall2014/cse118cse218.

All teams will have the same goal: develop new assisting technology based on one or a combination of the available devices to enable individuals affected by the Locked-in-syndrome to better communicate.

Students from both 118 and 218 will work together, but graduate students from CSE 218 will take a leadership and project management role and report to the instructors on a weekly basis on the progresses of the project. Every team will have to meet at least once a week in CSE. We have CSE rooms 2109, 2217, 3109, 3217, 4109, 4217 available on Mon/Wed/Thu and every team will be assigned a specific time. TAs will be popping in the meet-ups to check-in and see if everything works well.

Once you are set on a team, please submit the required team information here: http://goo.gl/BWb7Gt

The complete overview of all videos of the project is available here: Youtube Playlist

Team No.Team NameTeam MembersBitbucket & Home Page + Final VideoWeekly Meet-upsPrimary TA
01Mye PlayCSE 218: Pavan Kumar & Sean Burke

CSE 118: Crystal Kwok, Danny Zhang, Andrew Wang, 
Alex Yang, Kane Chong, Hyung-ook Kim, Samuel Suen

Youtube Video
Thu 6.30pm- 9pm
CSE 2217
Sachin Kantipudi
02Team SpaghettiCSE 218: Amine Boumnade & Joey Ni

CSE 118: Karen Lo, Justin Hung,  Angie Nguyen, Ryan Liao, Taylor Fah, Sean Rowan, Alvin Portillo

Youtube Video
Thu 6.30pm- 9pm
CSE 2109
Sachin Kantipudi
03OcuHubCSE 218: Sneha Yelimeli & Brian Anderson

CSE 118: 
Hyunwoo Cho, Liew Ching,  Delia Doe, 
Ronghuan Zhang, Yip Ming Wong, Yevgeniy Galipchak

Youtube Video
Mon 6.30-9pm
CSE 2109
Abhishek Ray
04The Speedy Dragons CSE 218: Ryan Kral & Ailie Fraser

CSE 118: Christine Pham, Darren Syu, Duwei Wang, Kristina Do, Jon Ho

Youtube Video
Wed 6.30pm - 9pm
CSE 2109
Abhishek Ray
05Ubiquitous CompadresCSE 218: Patrick Phaneuf & Kristen Wetts

CSE 118: Jason Chen, Frank Bogart, Ian Rajczi, Mike Lara, Dylan Phan

Youtube Video
Mon 6.30pm-9pm
CSE 3217
Abhishek Ray
06POLCACSE 218: Guo Li & Thalley Gydesen

CSE 118: Monish Ratanji, Theresa Danh, Daniel LeVine, 
Elliot Humphrey

Youtube Video
Fri 3.30pm - 6pm
CSE 3217
Sachin Kantipudi
07EyeTalkCSE 218: Soham Shah, Narendran Thangarajan & Manindra Moharana

CSE 118: Joann Kim, Koa Nies, Cary Cheng, Luke Picket, Jessica Cho, Christine He

Youtube Video
Thu 5pm-7.30pm 
CSE 3217
Sachin Kantipudi
08EyelluminatiCSE 218: Vincent Chan & Sree Katamreddy

CSE 118: Samuel Vange, Shawn Chen, Daniel Loza, Saif Chaudhry, Jennifer Lu, Joshua Toenyes

Youtube Video
Wed 6.30pm - 9pm
CSE 3217
Abhishek Ray

Two presentations are scheduled for each team to present their projects: a mid-term presentation on week 5 and a final presentation on week 10. The whole team should participate in preparing the presentation, but the projects will be presented in the CSE 118 classes. A demo/reception evening will be organized during finals week to present the outcomes of the project to interested faculty and students from within and outside the CSE department.

A final project report is due at the end of Week 10, on Sunday December 14th. Very promising projects will be selected for further research and will be presented outside UCSD. Students will be offered the possibility to continue research on the selected project as a CSE 198: Directed study group. The outcome of this work will be submitted as a research paper to a premiere conference in HCI/Ubicomp.

This course is graded on three elements: discussion, preparation and participation (20%), presentation/report/panel (30%), and project (50%).

Discussion, Preparation and Participation (20%)
This class cannot "run" unless you come to class thoroughly prepared. You will be doing the discussing, not me. Your preparation for class, and your active engagement during class are essential to the success of the course, your learning, and your grade.
We will be judging your participation based on what happens in class during the discussion and your weekly 1-page summaries (20%). Class participation records will be created during class by yourself, your peers and the instructors using a short online form. 

Relevant posts in the 
class forum will be used to increase your participation grade. The topics allowed here are broad, such as: continuing class discussion, forwarding relevant news items, and reporting your own ubicomp experiences.

Presentation/Report/Panel (30%)

We will assess the research/technical presentation based on the engagement, the effectiveness in presenting the technical content and the research challenges, as well as the completeness of the information presented in the audio-visual presentation (10%)

We will assess the presentation's report based on the completeness of the background information, the technical description of the technology or the relevant research approaches. We will also look into the relevance for ubiquitous computing and HCI and the language used (10%)

Your participation in the panel will be assessed by both your peers and the instructors and will be based on your demonstrated competences, the ability to argument and to respond to the moderator's query, as well as your ability to intervene on other panleists' points and argument with them. (10%)

Project, (50%)

The project will be graded on the following elements: final report (15%), final presentation (15%), final demonstration (10%) and peer evaluation (10%).
We will assess the final report based on the completeness of the background information, the technical description of the developed application or prototype, the relevance for ubiquitous computing and HCI, and the novelty of the approach or the developed system.
We will assess the final presentation based on the engagement, the effectiveness in presenting the project itself and the results of your implementation, as well as the completeness of the information presented in the audio-visual presentation. 
The demonstration will also be assessed in terms of the presented prototype, the interest raised, and its actual "working state".

We will be using peer evaluations to help with project grading. For each project team member and yourself, you will be asked to assign a few grades in a small number of categories (e.g., effort and team player). These grades may affect your project grade up to 1 letter grade in either direction, up or down.


I will allow for 2 class absences (or non-preparations) over the quarter (e.g., for sickness, job interviews). The first week of class does not count. In other words, I will drop the two lowest participation grades. Showing up ready to participate counts for a lot, even if you don't say much. I cannot accept the turn-in of a marked-up paper in lieu of coming to class; they are a package. 



You are to do your own work in this course. Each student is responsible for knowing and abiding by UCSD's policies on Academic Dishonesty and on Student Conduct. Any student violating UCSD's Academic Integrity Policy will be reported to the Academic Integrity Office for administrative processing, and may result in suspension or dismissal from UCSD, as well an an academic sanction that could result in failing the course (e.g., a grade of zero (0) on a compromised assignment). Committing acts that violate the UCSD Student Conduct Code that result in course disruption will be referred to the Office of Student Conduct, and could result in suspension or dismissal.
  • No student shall provide their assignments, in part or in total, to any other student in current or future classes of this course. No student shall procure or accept assignments from any other student from current or prior classes of this course.
  • All programming code and documentation submitted for evaluation or existing inside the student's computer accounts must be the student's original work or material specifically authorized by the instructor. The course accounts are authorized for course work only.
  • Collaborating with other students to develop, complete or correct course work is limited to activities explicitly authorized by the Instructor. Use of other student's course work, in part or in total, to develop, complete or correct course work is unauthorized. However, students may freely discuss their work with others.
  • Each student must retain intermediate work as proof that submitted work is his or her own. A student may be asked to provide these intermediate copies as evidence that the submitted work is the student's.
  • With regards to the above rules, it is understood that project teams will be sharing code among themselves (but not to other teams) to complete their projects.

Course Schedule

Week Date Topic Readings Assignments Notes
1 Mon Oct 06 Introduction to the Course [slides]      
Wed Oct 08 Lecture: Ubiquitous Computing & Accessibility [slides] M. Weiser, "The Computer for the 21st Century". Scientific American, pp. 66-75, September 1991

V. Bush, As We May Think, Atlantic Monthly, July 1945

Smith, Eimear, and Mark Delargy. Locked-in syndrome. Bmj 330.7488 (2005): 406-409.

Critical reading and annotating  
2 Mon Oct 13 Research Discussion: Eye-Tracking A. Duchowski, "A breadth-first survey of eye-tracking applications.
Behavior Research Methods, Instruments, & Computers 34.4 (2002): 455-470.

Roda, Claudia, and Julie Thomas. "Attention aware systems: Theories, applications, and research agenda." Computers in Human Behavior 22.4 (2006): 557-587.

Zhai, Shumin. "What's in the eyes for attentive input.Communications of the ACM 46.3 (2003): 34-39.

BONUS (Not required)
Weibel, N., Fouse, A., Emmenegger, C., Kimmich, S., & Hutchins, E. (2012, March). Let's look at the cockpit: exploring mobile eye-tracking for observational research on the flight deck. In Proceedings of the Symposium on Eye Tracking Research and Applications (pp. 107-114). ACM.
Critical reading and annotating assigned papers.

Research / Technical Presenters: 15min presentation, send slides (PPT/Keynote) to weibel@ucsd.edu by Mon 10/13, 9am. Submit 10-pages paper by Mon 10/20.

Panelists: prepare to answer questions on the topic of the week.

Others: prepare at least 3 questions for discussions.

All but the presenters: submit 1-page summary by Fri 10/17
Wed Oct 15 Projects Brainstorming   Send one slide idea (PDF) to weibel@ucsd.edu by Tue 10/14 9pm.  
3 Mon Oct 20 Research Discussion: Kinect and Depth Cameras
Shotton, Jamie, et al. "Real-time human pose recognition in parts from single depth images." Communications of the ACM 56.1 (2013): 116-124.

A. Wilson, 
"Using a depth camera as a touch sensor", ITS 2010

Critical reading and annotating assigned papers.

Research / Technical Presenters: 15min presentation, send slides (PPT/Keynote) to weibel@ucsd.edu by Mon 10/20, 9am 

Panelists: prepare to answer questions on the topic of the week.

Others: prepare at least 3 questions for discussions.
Wed Oct 22 Team Project Sketching      
4 Mon Oct 27 No Class      
Wed Oct 29 Project Presentations      
5 Mon Nov 03 Research Discussion: Google Glass and Augmented Reality S. Mann, "Through the Glass, Lightly", IEEE Technology and Society, 2012

T. Starner et al. "Augmented reality through wearable computing." Presence: Teleoperators and Virtual Environments 6.4 (1997): 386-398.

Tanuwidjaja, Enrico, et al. "Chroma: a wearable augmented-reality solution for color blindness." Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 2014.
Critical reading and annotating assigned papers.

Research / Technical Presenters: 15min presentation, send slides (PPT/Keynote) to weibel@ucsd.edu by Mon 11/03, 9am 

Panelists: prepare to answer questions on the topic of the week.

Others: prepare at least 3 questions for discussions.
Wed Nov 05 Projects Discussion      
6 Mon Nov 10 Research Discussion: Pen, Paper and Touch M.C. Norrie, B. Signer and N. Weibel, "General Framework for the Rapid Development of Interactive Paper Applications", CoPADD 2006

R. Yeh, C. Liao, S. Klemmer, F. Guimbretière, et al. "ButterflyNet: a mobile capture and access system for field biology research". CHI '06

K. Hinckley, et al."Pen + touch = new tools". UIST '10. 

J Garcia, T Tsandilas, C Agon, WE Mackay, "PaperComposer: Creating Interactive Paper Interfaces for Music Composition", IHM'14
Critical reading and annotating assigned papers.

Research / Technical Presenters: 15min presentation, send slides (PPT/Keynote) to weibel@ucsd.edu by Mon 11/10, 9am 

Panelists: prepare to answer questions on the topic of the week.

Others: prepare at least 3 questions for discussions.
In-depth discussion of related technologies for interactive paper is available here (chapter 2): B. Signer,  "Fundamental concepts for interactive paper and cross-media information spaces" (42 MB)
Wed Nov 12 Research Ethics and Human Subjects Protection [slides]

IRB Application Guidelines:

-Social and Behavioral Sciences,
-Biomedical Sciences

IRB Research plan "Interactive Technology Supporting Communication, Learning and Social Interaction for Individuals and Groups"

--> Consent Forms

Read the IRB documents and sketch and IRB protocol for research with Bob and your technology  
7 Mon Nov 17 Research Discussion: Smart Homes and Smart Buildings C Dixon, R Mahajan, S Agarwal, AJB Brush, B Lee et al, "An Operating System for the Home", NSDI 12

Critical reading and annotating assigned papers.

Research / Technical Presenters: 15min presentation, send slides (PPT/Keynote) to weibel@ucsd.edu by Mon 11/17, 9am 

Panelists: prepare to answer questions on the topic of the week.

Others: prepare at least 3 questions for discussions.
Tue Nov 18 Madness Demos     Moxie Center - EBU2, Room 333

Be there by 1.30pm to setup
Wed Nov 19 No Class      
8 Mon Nov 24 Research Discussion: SenseCam and LifeLogging S Hodges, L Williams, E Berry, S Izadi, J Srinivasan, A Butler, G Smyth, N Kapur and K Wood, SenseCam: A Retrospective Memory Aid, Ubicomp 2006

A J. Sellen and S Whittaker. "Beyond total capture: a constructive critique of lifelogging". Commun. ACM 53, 5 (May 2010)
Critical reading and annotating assigned papers.

Research / Technical Presenters: 15min presentation, send slides (PPT/Keynote) to weibel@ucsd.edu by Mon 11/24, 9am 

Panelists: prepare to answer questions on the topic of the week.

Others: prepare at least 3 questions for discussions.
Wed Nov 26 Final Reports / Final Presentations [slides]
(Powerful Presentations [slides])
9 Mon Dec 01 Research Discussion: Privacy and Security M. Langheinrich, "Privacy by design—principles of privacy-aware ubiquitous systems", UbiComp 2001

K. Koscher, A. Czeskis, F. Roesner, S. Patel, T. Kohno, S. Checkoway, DaD.on McCoy, B. Kantor, D. Anderson, H. Shacham, S. Savage, "Experimental Security Analysis of a Modern Automobile". IEEE Symposium on Security and Privacy, 2010. 

P. Dourish and G. Bell, "Rethinking Privacy", in "Divining a Digital Future:Mess and Mythology in Ubiquitous Computing" MIT Press, 2011. [only the Privacy chapter is required, but the whole book is highly recommended]

Critical reading and annotating assigned papers.

Research / Technical Presenters: 15min presentation, send slides (PPT/Keynote) to weibel@ucsd.edu by Mon 12/01, 9am 

Panelists: prepare to answer questions on the topic of the week.

Others: prepare at least 3 questions for discussions.
Wed Dec 03 No class: troubleshooting      
10 Mon Dec 08 Final Project Presentations (Group 1-4)    Prepare final project presentation [rubric]  
Wed Dec 10 Final Project Presentations (Group 5-8)   Prepare final project presentation [rubric]  
11 Tue Dec 16 Final Demos   Prepare project for final demonstrations Demos will be in CSE 1202 2pm-4pm. Setup time starts at 1pm, cleanup will be 4pm-5pm.