Augmented And Virtual Reality Headsets (FULL FOR SEMESTER 1/2019 apart from Honours/Phd))

Description

In collaboration with the CSIRO Virtual Environments laboratory, I will be offering a number of projects to do with augmented and virtual reality headsets such as the Microsoft Hololens and the HTC Vive. Some of these projects involve development using extra cameras. Students will be expected to have very good coding skills and a good knowledge of human computer interaction.  As such, any students who are eligible for these project courses and who have already taken at least two programming courses at ANU and who have also taken COMP3900 or COMP6390 "Human Computer Interaction" may request to take these projects.

Please note the restrictions on the following project types in the following list; when I say "application projects" I am referring to single or double semester, undergraduate or masters projects in computer science with a maximum weighting of 12 units for the entire project. I also refer to "CS Honours" being computer science honours projects with a weighting of 24 units. PhD projects are for PhDs in computer science. "Engineering" refers to ENGN4200 projects.

Note that these projects are primarily intended for computer science students unless I particularly flag them as being engineering. Engineering students interested in these projects need to have very good coding experience and to have studied computer vision. There may be restrictions on the number of students accepted into these projects in Semester 1 of 2019 because this is the first time that we are working with headsets; we may need to keep student numbers a bit low until we are confident with the technology.

1) Moving in Movies: VR-Movies are captured using an array of cameras mounted over a 3D object such as a sphere. This project examines how captured VR-movie video can be manipulated to simulate changing camera viewpoints. The idea is to be able to edit VR-movie video perhaps automatically and then to play this video in a headset where users are able to walk around rather than just sitting and moving their heads. This project will be offered together with Hongdong Li from RS Engineering. (two-semester application projects only,  engineering, significant computer vision expertise needed, FULL FOR SEMESTER 1/2019)

2) Headsets with extra cameras: This project will look at ways of incorporating additional streaming video together with VR and AR headsets. A number of interesting application areas are envisioned. (application projects, engineering, Honours, FULL FOR SEMESTER 1/2019)

3) Self Empathy: This project relates to the capturing of past experiences in virtual environments with the objective of developing applications for enjoyment and, particularly, for therapy for elderly people suffering memory loss. This is a human computer interaction project. (Honours, PhD)

4) Stuff Empathy: This project relates to capturing people's interactions with their "stuff" when they want to store it in a storage locker. The project will attempt to capture and tag episodic interactions with "stuff". These recorded interactions will then form the basis of human computer interfaces that will help people keep in touch with their stored stuff. (Honours, PhD)

5) Virtual Sydney Rocks in a Headset: This project relates to the Virtual Sydney Rocks (VSR) world that has been built by Kit Devine from the ANU Institute of Arts and Design. This virtual world is a simulation of the area of Sydney where Europeans first settled some 230 years ago. The simulation tracks day-by-day history of the area from just before settlement until (almost) the present day with an emphasis on the early 19th century. This project will extend a previous Honours project that built a role-playing game into this environment; it will extend the game itself and some of the "fantasy elements" in one version of the game and it will study the effectiveness of learning historical facts by school children who play the game. (two-semester application project, Honours)

6) Augmented reality and music performance: Can augmented reality be used together with performing musicians to enable enhanced communication and collaboration? This project will examine the way that musicians collaborate and then design, develop and test augmented reality applications to improve this collaboration (Honours, PhD)

7) Musical scores in augmented reality headsets: This project will examine how musical scores can be displayed in augmented reality and how this display might be modified in real time. (two-semester application projects, engineering, FULL FOR SEMESTER 1/2019)

8) Augmented reality and walking for the elderly: This project will examine how elderly people of low mobility might take advantage of augmented reality technology. (Honours, PhD)

9) Write your own VR/AR Headset project. Please write to me below if you have your own project. Clearly describe your project and make a case why your project would be a good one for the project course that you want to take. (FULL FOR SEMESTER 1/2019)

Contact Henry.Gardner@anu.edu.au for more details. I am happy to discuss these and other projects with students before the beginning of term but allocations of people to them will be only provisional at this stage. Confirmed allocations to project topics will be made after the beginning of orientation week (Monday 18 February). See also other projects linked to my home page:
https://cecs.anu.edu.au/people/henry-gardner
Please note that I will be away from the university from Monday 21 January until Monday 4 February 2019.

Updated:  1 June 2019/Responsible Officer:  Dean, CECS/Page Contact:  CECS Marketing