CSE 118: Applications in Ubiquitous Computing (Fall 2014)

Lecture (Research topics) [required]: 
Tuesdays, 2:00pm-3:20pm, 
EBU3B 2154 (CSE Building)

Discussion: (Paper discussions in groups) [required]
Thursday, 2:00pm-3:20pm,
EBU3B (CSE Building) 2217, 3109, 3217 (see below for group assignments). First class (10/2) is in 2154

Lab Home Base (Space Available for experimenting): 
EBU3B B260 Computer Lab
-> TAs will be available at specific times: Mon: 6:30pm - 8:30 pm; Wed: 6:30pm - 8:30 pm

Teams meet-ups [required]:
Mon/Wed/Thu 6.30pm-9.00pm,
EBU3B (CSE Building) 2109, 2217, 3217 (see below for group assignments)

CSE 118/218 Piazza page:

Course website: http://thiscourse.com/ucsd/cse118/fa14/


Nadir Weibel (Professor)


Office Hours: By appointment in CSE 3224

Sachin Kantipudi (TA)

Office Hours: Monday 9-10am in B275

Abhishek Ray (TA)

Office Hours: Wed 4-5pm in B250A

Azeem Ghumman (Tutor)

Office Hours: Mon: 6:30pm - 8:30 pm; Wed: 6:30pm - 8:30 pm in B260

Course Description

The advent of affordable sensors and interaction devices (e.g., web cams, mobile phone based sensors, digital pensMicrosoft SenseCamMicrosoft KinectGoogle glasses, portable eye-tracking, etc.) and wireless mobile computing devices (e.g., mobile smart phones, Arduino boards with 802.11b wireless connectivity, etc.) has created boundless opportunities for in-the-world computing applications that can transform our lives. This course explores these opportunities in the form of both a project-based class and a preparatory course for graduate school. On the one hand we will focus on the development of specific applications and interaction techniques based on those devices. On the other hand, we will learn how to read, present, and discuss research papers from the literature of ubiquitous computing, pervasive computing, and human-computer interaction. 

Every week a new ubiquitous computing device will be introduced and we will discuss the technology behind it, and how it has been used in research (i.e. reading and discussing technical and research papers). In addition we will form teams to undertake small research projects. The projects will involve the design and implementation of a ubiquitous computing application, based on one of the devices presented in class. We will focus on three technologies: Google Glass, Microsoft Kinect, and the EyeTribe eyetracking. Teams will span CSE 218 graduate students and CSE 118 undergraduates.Graduate students will take a leadership and management role in the project.

--> This year students will all work on solving one specific problem, i.e. communication for people affected by the Locked-In Syndrome.

On Tuesdays we will introduce new ubiquitous technology, learn about how it works and what can be done with it. On Thursdays we will discuss research literature in HCI and Ubicomp. Students will be assigned 2-3 papers to read and annotate, and they will have to pick one to hand-in every week. Students will be divided in different groups and rooms to discuss the specific research topics, and will be engaged in continuous self and peer evaluations.

 Home Base Labs are an opportunity to exchange ideas with your peers in your and other groups and get a dedicated space in the lab in the basement. A TA will be present in the Computer Lab on XXXX 

every team will be required to meet on a regular base every week in one of the CSE-assigned rooms between 6.30pm-9pm. Work should be done also in other locations and at other times, but the instructors team will be popping into the rooms during the evening time to check on progress and offer advices and help.

The course will culminate in team presentations of the applications created and a final demo event for interested students and faculty.

Students will be graded based on their participation in the weekly paper discussion (reading and discussing), as well as their performance in the research project. Additionally, we will test the Tuesday's lecture material and the content of the assigned papers at the beginning of the following week's Lecture. See Details and Policies for a breakdown and an explanation of the grading. 

Being a class on Ubiquitous computing, all the students will be required to have a laptop, tablet, smart phone, etc. for both lectures (Tuesdays and Thursdays). It will be used to participate in the short quizzes and the student evaluations. See below for details.

Course Details and Policies

-Week 01: Introduction to Ubicomp and Accessibility (Locked-in Syndrome)
-Week 02: Eye-Tracking
-Week 03: Microsoft Kinect
-Week 04: Google Glass
-Week 06: Digital Pen and Paper
-Week 07: Smart Homes and Intelligent Buildings
-Week 08: SenseCam
-Week 09: Privacy and Security

Every Tuesdays we will introduce a new ubiquitous technology (with the exception of week 1, when we will introduce Ubicomp and the Locked-in Syndrome). The setting will be a standard lecture setting, but we will encourage active participation. We will also demo the specific technology that we will be presenting that week. The content of the lecture will be tested through a mini quiz at the beginning of the following week Tuesday's class. 

Thursdays will be the most interactive part of the class. Students will be assigned 2-3 papers to read and annotate and they will have to  pick one to hand in at the beginning of the lecture. Students will be divided in 3 groups and assigned to different rooms. Every group will be further split in an inner circle and an outer circle. The inner circle will be discussing the assigned papers, while the outer circle will be observing the discussion and taking notes on the dynamics of the group discussion.

Prior to the discussion, you will be required to complete a reading-summary form and submit your annotated paper. Please annotate all papers (this is the point of the class), but submit the reading summary and the annotations for just one paper by Thursday at 3pm here: http://ubicomp.ucsd.edu/cse118/reading-summary.

-Discussion Group A - CSE 2217: 

A10280682, A09161951, A10246975, A09295408, A08885859, A10666923, A09599375, A09555706, A09673105, A09497071, A09575443, A10267333, A09433915, A09479894, A10258425

-Discussion Group B - CSE 3217: 

A09307269, A09560760, A09594647, A09431130, A09989144, A10261206, A09926147, A09585235, A98420970, A09994512, A10145027, A09922648, A10095800, A10232938, A09278283, A10133533

-Discussion Group C - CSE 3109: 

A09443157, A09469914, A09995322, A10009075, A10410433, A09640447, A09280387, A10967442, A09818450, A08810286, A10169673, A11044483, A09475833, A10095844, A97420200

In every group students will be randomly assigned to the inner or outer circles, but we will ensure that every student will have the same amount of inner and outer circle participation and will be placed in both circles every week. Assignments will not be disclosed until the start of the discussion.

All students (inner+outer) will propose topics to cover in the discussion, and the instructor in the room will manage the discussion. Every student in the inner group will be expected to participate actively in the discussion and will be asked to self-evaluate his/her participation at the end of the discussion through a short online form. Students in the outer circle will have to take note on the overall discussion using the discussion rubric. All students will have to self-evaluate their progress in the discussion using the form available here http://ubicomp.ucsd.edu/cse118/discussion/selfevaluation/. The self-evaluation will be used by the instructions to evaluate the real progresses. The outcome of the discussion sections will be summarized at the beginning of the following Tuesday's lecture.

At the beginning of Tuesday's lecture each student will participate in a required online mini-quiz that will test understanding of the technology presented the week before and the content of the assigned papers. Tests will be delivered online, so every student needs internet access through his/her own device (laptop, tablet, smart phone, etc.).


We will form 8 teams composed by 6-7 undergrad students (CSE 118) and 2-3 graduate students (CSE 218). Every team will receive for the duration of the quarter following equipment:

1x Kinect for Windows (we will work with version 1 instead of version 2)

Equipment has been generously sponsored by the Moxie Foundation. THANKS!

Teams should be assembled by the students depending on expertise and potential to work together. The instructors can help assembling the teams. We highly advise students to use the common Piazza page available here: http://piazza.com/ucsd/fall2014/cse118cse218.

All teams will have the same goal: develop new assisting technology based on one or a combination of the available devices to enable individuals affected by the Locked-in-syndrome to better communicate.

Students from both 118 and 218 will work together, but graduate students from CSE 218 will take a leadership and project management role and report to the instructors on a weekly basis on the progresses of the project. Every team will have to meet at least once a week in CSE. We have CSE rooms 2109, 2217, 3109, 3217, 4109, 4217 available on Mon/Wed/Thu and every team will be assigned a specific time. TAs will be popping in the meet-ups to check-in and see if everything works well.

The complete overview of all videos of the project is available here: Youtube Playlist

Team No.Team NameTeam MembersBitbucket & Home Page + Final VideoWeekly Meet-upsPrimary TA
01Mye PlayCSE 218: Pavan Kumar & Sean Burke

CSE 118: Crystal Kwok, Danny Zhang, Andrew Wang, 
Alex Yang, Kane Chong, Hyung-ook Kim, Samuel Suen

Youtube Video
Thu 6.30pm- 9pm
CSE 2217
Sachin Kantipudi
02Team SpaghettiCSE 218: Amine Boumnade & Joey Ni

CSE 118: Karen Lo, Justin Hung,  Angie Nguyen, Ryan Liao, Taylor Fah, Sean Rowan, Alvin Portillo

Youtube Video
Thu 6.30pm- 9pm
CSE 2109
Sachin Kantipudi
03OcuHubCSE 218: Sneha Yelimeli & Brian Anderson

CSE 118: 
Hyunwoo Cho, Liew Ching,  Delia Doe, 
Ronghuan Zhang, Yip Ming Wong, Yevgeniy Galipchak

Youtube Video
Mon 6.30-9pm
CSE 2109
Abhishek Ray
04The Speedy Dragons CSE 218: Ryan Kral & Ailie Fraser

CSE 118: Christine Pham, Darren Syu, Duwei Wang, Kristina Do, Jon Ho

Youtube Video
Wed 6.30pm - 9pm
CSE 2109
Abhishek Ray
05Ubiquitous CompadresCSE 218: Patrick Phaneuf & Kristen Wetts

CSE 118: Jason Chen, Frank Bogart, Ian Rajczi, Mike Lara, Dylan Phan

Youtube Video
Mon 6.30pm-9pm
CSE 3217
Abhishek Ray
06POLCACSE 218: Guo Li & Thalley Gydesen

CSE 118: Monish Ratanji, Theresa Danh, Daniel LeVine, 
Elliot Humphrey

Youtube Video
Fri 3.30pm - 6pm
CSE 3217
Sachin Kantipudi
07EyeTalkCSE 218: Soham Shah, Narendran Thangarajan & Manindra Moharana

CSE 118: Joann Kim, Koa Nies, Cary Cheng, Luke Picket, Jessica Cho, Christine He

Youtube Video
Thu 5pm-7.30pm 
CSE 3217
Sachin Kantipudi
08EyelluminatiCSE 218: Vincent Chan & Sree Katamreddy

CSE 118: Samuel Vange, Shawn Chen, Daniel Loza, Saif Chaudhry, Jennifer Lu, Joshua Toenyes

Youtube Video
Wed 6.30pm - 9pm
CSE 3217
Abhishek Ray

Two presentations are scheduled for each team to present their projects: a mid-term presentation on week 5 and a final presentation on week 10. A demo/reception evening will be organized during finals week to present the outcomes of the project to interested faculty and students from within and outside the CSE department.

A final project report is due at the end of Week 10, on Sunday December 14th. Very promising projects will be selected for further research and will be presented outside UCSD. Students will be offered the possibility to continue research on the selected project as a CSE 198: Directed study group. The outcome of this work will be submitted as a research paper to a premiere conference in HCI/Ubicomp.

This course is graded on three elements: discussion preparation and participation (30%), lecture/paper technical knowledge (20%), and project (50%).

Discussion, Preparation and Participation (30%)
This class cannot "run" unless you come to class thoroughly prepared. You will be doing the discussing, not me. Your preparation for class, and your active engagement during class are essential to the success of the course, your learning, and your grade.
We will be judging your participation based on what happens in class during the discussion (15%). Class participation records will be created during class by your peers and the instructors, marking up the discussion rubric. We will also be collecting your annotated readings in order to assess your preparation skills and give you feedback (15%). Your annotated readings will be graded based on the note taking rubric.

Relevant posts in the class forum will be used to increase your participation grade. The topics allowed here are broad, such as: continuing class discussion, forwarding relevant news items, and reporting your own ubicomp experiences.

The assessments will take into consideration how much you are learning over the course. The fact that you do not know how to read a technical paper or discuss it with peers at the beginning of the course will not impact your final grade. Thus, at the beginning we will be primarily grading effort, but by the end we will also be looking at the results.

Lecture/papers technical knowledge (20%)

In order to effectively develop your project ideas, you should know the underlaying technology very well. We will test your technical knowledge on a weekly basis in the Tuesday's quizzes. Before the discussion there will be a simple quiz to check your understanding and preparation on the content that was covered in class and in the readings. We will drop the lowest 2 quizzes. 

Project, (50%)

The project will be graded on the following elements: final report (15%), mid-term and final presentation (15%), final demonstration (10%) and peer evaluation (10%).
We will assess the final report based on the completeness of the background information, the technical description of the developed application or prototype, the relevance for ubiquitous computing and HCI, and the novelty of the approach or the developed system.
We will assess the final presentation based on the engagement, the effectiveness in presenting the project itself and the results of your implementation, as well as the completeness of the information presented in the audio-visual presentation. 
The demonstration will also be assessed in terms of the presented prototype, the interest raised, and its actual "working state".

We will be using peer evaluations to help with project grading. For each project team member and yourself, you will be asked to assign a few grades in a small number of categories (e.g., effort and team player). These grades may affect your project grade up to 1 letter grade in either direction, up or down.


I will allow for 2 class absences (or non-preparations) over the quarter (e.g., for sickness, job interviews). The first week of class does not count. In other words, I will drop the two lowest participation grades. Showing up ready to participate counts for a lot, even if you don't say much. I cannot accept the turn-in of a marked-up paper in lieu of coming to class; they are a package. 



You are to do your own work in this course. Each student is responsible for knowing and abiding by UCSD's policies on Academic Dishonesty and on Student Conduct. Any student violating UCSD's Academic Integrity Policy will be reported to the Academic Integrity Office for administrative processing, and may result in suspension or dismissal from UCSD, as well an an academic sanction that could result in failing the course (e.g., a grade of zero (0) on a compromised assignment). Committing acts that violate the UCSD Student Conduct Code that result in course disruption will be referred to the Office of Student Conduct, and could result in suspension or dismissal.
  • No student shall provide their assignments, in part or in total, to any other student in current or future classes of this course. No student shall procure or accept assignments from any other student from current or prior classes of this course.
  • All programming code and documentation submitted for evaluation or existing inside the student's computer accounts must be the student's original work or material specifically authorized by the instructor. The course accounts are authorized for course work only.
  • Collaborating with other students to develop, complete or correct course work is limited to activities explicitly authorized by the Instructor. Use of other student's course work, in part or in total, to develop, complete or correct course work is unauthorized. However, students may freely discuss their work with others.
  • Each student must retain intermediate work as proof that submitted work is his or her own. A student may be asked to provide these intermediate copies as evidence that the submitted work is the student's.
  • With regards to the above rules, it is understood that project teams will be sharing code among themselves (but not to other teams) to complete their projects.

Course Schedule

Week Date Topic Readings Assignments Notes
0 Thu Oct 02 Introduction to the Course [slides]      
1 Tue Oct 07 Lecture: Ubiquitous Computing & Accessibility [slides]      
Thu Oct 09 Group Discussion; Ubiquitous Computing and Locked-in Syndrome M. Weiser, "The Computer for the 21st Century". Scientific American, pp. 66-75, September 1991

V. Bush, As We May Think, Atlantic Monthly, July 1945

Smith, Eimear, and Mark Delargy. Locked-in syndrome. Bmj 330.7488 (2005): 406-409.

  Group A - CSE 2217: Sachin Kantipudi

Group B - CSE 3217: Nadir Weibel

Group C - CSE 3109: Abishek Ray
2 Tue Oct 14 Lecture: EyeTracking [slides]     Mini-Quiz on Week01
Thu Oct 16 Group Discussion: Eye-Tracking A. Duchowski, "A breadth-first survey of eye-tracking applications.
Behavior Research Methods, Instruments, & Computers 34.4 (2002): 455-470.

Roda, Claudia, and Julie Thomas. "Attention aware systems: Theories, applications, and research agenda." Computers in Human Behavior 22.4 (2006): 557-587.

Zhai, Shumin. "What's in the eyes for attentive input.Communications of the ACM 46.3 (2003): 34-39.

BONUS (Not required)
Weibel, N., Fouse, A., Emmenegger, C., Kimmich, S., & Hutchins, E. (2012, March). Let's look at the cockpit: exploring mobile eye-tracking for observational research on the flight deck. In Proceedings of the Symposium on Eye Tracking Research and Applications (pp. 107-114). ACM.
Submit your reading-summary and annotations here:  Group A - CSE 2217: Abishek Ray

Group B - CSE 3217: Sachin Kantipudi

Group C - CSE 3109: Nadir Weibel
3 Tue Oct 21 Lecture: Kinect and Depth Cameras [slides]     Mini-Quiz on Week02
Thu Oct 23 Group Discussion: Kinect and Depth Cameras
Shotton, Jamie, et al. "Real-time human pose recognition in parts from single depth images." Communications of the ACM 56.1 (2013): 116-124.

A. Wilson, 
"Using a depth camera as a touch sensor", ITS 2010

Submit your reading-summary and annotations here:  Group A - CSE 2217: Nadir Weibel

Group B - CSE 3217: Abishek Ray

Group C - CSE 3109: Sachin Kantipudi
4 Tue Oct 28 Lecture: Google Glass and Augmented Reality [slides]     Mini-Quiz on Week03
Thu Oct 30
Preparing for mid-term presentations [slides]
Group Discussion: Glass and Augmented Reality
S. Mann, "Through the Glass, Lightly", IEEE Technology and Society, 2012

T. Starner et al. "Augmented reality through wearable computing." Presence: Teleoperators and Virtual Environments 6.4 (1997): 386-398.

Tanuwidjaja, Enrico, et al. "Chroma: a wearable augmented-reality solution for color blindness." Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 2014.
Submit your reading-summary and annotations here:  Group A - CSE 2217: Sachin Kantipudi

Group B - CSE 3217: Nadir Weibel

Group C - CSE 3109: Abishek Ray
5 Tue Nov 04 Mid-Term Presentations     Mini-Quiz on Week04
Thu Nov 06 Mid-Term Presentations      
6 Tue Nov 11 Veterans Day - No Class      
Thu Nov 13 Group Discussion: SenseCam S Hodges, L Williams, E Berry, S Izadi, J Srinivasan, A Butler, G Smyth, N Kapur and K Wood, SenseCam: A Retrospective Memory Aid, Ubicomp 2006

A J. Sellen and S Whittaker. "Beyond total capture: a constructive critique of lifelogging". Commun. ACM 53, 5 (May 2010)
Submit your reading-summary and annotations here:  Group A - CSE 2217: Abishek Ray

Group B - CSE 3217: Sachin Kantipudi

Group C -> Groups A+B (see Piazza)
7 Tue Nov 18 Madness Demos   2min interactive presentation/animation for each team and project + Booth for demoing current status

Email by Monday night (11/17) 9pm to weibel@ucsd.edu
Moxie Center - EBU2, Room 333

Be there by 1.30pm to setup
Thu Nov 20 Group Discussion: Smart Homes and Intelligent Buildings C Dixon, R Mahajan, S Agarwal, AJB Brush, B Lee et al, "An Operating System for the Home", NSDI 12

Submit your reading-summary and annotations here: 
Meet in CSE 2154 for a 15min presentation on Smart Buildings and Intelligent Homes.

Then move to the discussion rooms.

Group A - CSE 2217: 
Nadir Weibel

Group B - CSE 3217: Abishek Ray

Group C - CSE 3109: Sachin Kantipudi
8 Tue Nov 25 Lecture: Pen and Paper and Touch (+ final presentations/final reports) [slides]     Mini-Quiz on Week 06 and Week 07
Thu Nov 27 Thanksgiving - No Class M.C. Norrie, B. Signer and N. Weibel, "General Framework for the Rapid Development of Interactive Paper Applications", CoPADD 2006

R. Yeh, C. Liao, S. Klemmer, F. Guimbretière, et al. "ButterflyNet: a mobile capture and access system for field biology research". CHI '06

K. Hinckley, et al."Pen + touch = new tools". UIST '10. 

Submit your reading-summary and annotations here:  No discussion, but readings and annotations must be submitted electronically. If you want to hand in your printed papers, please go to the TAs office hours or bring them to lecture on Tuesday.
9 Tue Dec 02 Lecture: Privacy and Security     Mini-Quiz on Week08
Thu Dec 04 Group Discussion: Privacy and Security M. Langheinrich, "Privacy by design—principles of privacy-aware ubiquitous systems", UbiComp 2001

K. Koscher, A. Czeskis, F. Roesner, S. Patel, T. Kohno, S. Checkoway, DaD.on McCoy, B. Kantor, D. Anderson, H. Shacham, S. Savage, "Experimental Security Analysis of a Modern Automobile". IEEE Symposium on Security and Privacy, 2010. 

P. Dourish and G. Bell, "Rethinking Privacy", in "Divining a Digital Future:Mess and Mythology in Ubiquitous Computing" MIT Press, 2011. [only the Privacy chapter is required, but the whole book is highly recommended]

Submit your reading-summary and annotations here: Group A - CSE 2217: Sachin Kantipudi

Group B - CSE 3217: Nadir Weibel

Group C - CSE 3109: Abishek Ray
10 Tue Dec 09 Final Project Presentations (Group 1-4) [rubric]   Prepare final project presentation [rubric] Mini Quiz on Week 09
Thu Dec 11 Final Project Presentations (Group 5-8) [rubric]   Prepare final project presentation [rubric]  
11 Tue Dec 16 Final Demos   Prepare project for final demonstrations Demos will be in CSE 1202 2pm-4pm. Setup time starts at 1pm, cleanup will be 4pm-5pm.