Abstract
Communication and Processing Architecture
Human Tracking and Identification
The MyView Video Browser
Contributors
Funding
Publications
Contact Information
MyView is a system for the capture, processing, and playback of
multiple streams of context aware video data. Three components of this
system are being developed in parallel: a communication and processing
architecture to support multi-camera capture and both online and
offline processing services, human tracking and identification
as an example service, and an interface for browsing in the
resulting context aware video space. MyView is currently in the
prototype stage and does simple human tracking in a lab environment.
It is intended for initial deployment at the 2010 Olympics in
Vancouver, where it will be used to record hockey games.
Communication and Processing Architecture
The MyView system is intended to be used with anywhere from a few to hundreds of cameras. To facilitate
interoperability between different types of cameras and processing units,
devices on the network are required to advertise the services that they offer.
Clients can then connect to a specific device like a processing unit, and register to receive information
such as tracking data, or an image stream. The communication and services layer is built with Python, which
allows for fast and flexible prototyping of high level services that interface with native application code.
Currently all of the image processing is done online, but in the future there will be an offline processing
component as well. The offline processing will utilize available resources to refine the accuracy of metadata
gathered from the video streams. This process will be non-realtime and employ better quality versions of the
computer vision algorithms used during online processing. Offline processing will also allow for better
correlation of data from different camera views, which is difficult to do within the constraints of real-time
video processing.
Human Tracking and Identification
The prototype MyView system offers a human tracking service. Using the service in capture
mode allows for real-time recording of multi-camera image streams, which include metadata giving the identification and
location of the people in each stream. The data can later be reviewed using the MyView Video Browser.
In the first prototype system users were required to have a pulse coded IR marker on them so that they
could be uniquely identified. The marker only needed to be active to initialize the system, and could
be turned off once the user was identified.
The current prototype has moved away from using active markers for identification. Instead face detection
is used. Users can initialize their face into a face database and then when the system is run they will
be tracked and identified appropriately. Face detection is done in the background, and
whenever a match is found a full body colour histogram of the user is built. The histogram is used for
per frame human tracking, and is updated as often as possible.
The MyView Video Browser
We are developing a video browser for the exploration and viewing of
an augmented video space using a mobile device. The augmented video
space includes video and metadata captured by the MyView system, as well as additional content
based on the MyView metadata.
In our first phases of development we have been exploring new models
of video space structure and corresponding interfaces for the
following types of navigation in the video space:
Spatial: with sources from multiple cameras, a user may change viewing
position, angle, and zoom.
Personalized: a user may browse and view video according to
preferences and interests, supported by automated video clip selecting
functions.
Content-based: new object and event recognition as well as video
annotation and hyper-linking allow for content-based viewing and
browsing of complex video spaces.
Contributors
Active:
Dr. Gregor Miller, ECE, UBC
Dr. Sidney Fels, ECE and MAGIC, UBC
Dr. Jim Little, CS, UBC
Dr. David Lowe, CS, UBC
Abir Al Hajri, ECE, UBC
Matthew Fong, ECE, UBC
Zoltan Foley-Fisher, ECE, UBC
Dr. Daesik Jang, Kunsan National University
Constant Thomas, Télécom Saint-Etienne
Alumni:
Manuel Fernandez, Ludwig-Maximilians-Universitaet
Loic Duron, Télécom Saint-Etienne
Nicolas Pajnic, Télécom Saint-Etienne
Clemens Weidenhiller, Ludwig-Maximilians-Universitaet
Conny Spanner, Ludwig-Maximilians-Universitaet
Stefanie Mueller,Hochschule Harz, University of Applied Sciences
Michael Ilich, ECE, UBC
Kenji Okuma, CS, UBC
Robin Roy, ECE, UBC
Amir Afrah, ECE, UBC
Dr. Matthias Finke, MAGIC, UBC
Morgan Hibbert, ECE, UBC
Ryleigh Kostash, ECE, UBC
Clement Leung, ECE, UBC
Thomas Bauer, Ludwig-Maximilians-Universitaet
Wesley Chan, CS, UBC
Donovan Parks, ECE, UBC
Samir Gupta, ECE, UBC
Kiky Tangerine, ECE, UBC
Evelyn Tsai, ECE, UBC
Onn Tai Yong, ECE, UBC
Amy Wei You, ECE, UBC
Dr. Sung-Bae Cho, Yonsei University, Korea
Will Motz, ECE, UBC
Chris Eagleston, ECE, UBC
Walker Eagleston, ECE, UBC
Lan Wu, CS, UBC
Meghan Deutscher, ECE, UBC
Tricia Pang, ECE, UBC
Justine Lu, ECE, UBC
Erik Kremers, Technical University of Eindhoven
Hao Jiang, Boston College
Jing Chen, Hunan University, China
Troy Therrien, ECE, UBC
Dr. Chris Zhang, ECE, UBC
Changsong Shen, ECE, UBC
Affiliates:
Steve Oldridge, ECE, UBC
Dr. Rodger Lea, MAGIC, UBC
Funding
We gratefully acknowledge our funding support from:
Publications
| PDF | bibtex | Gregor Miller and Sidney Fels. Developer-Centred Interface Design for Computer Vision. Proceedings of the 6th International Workshop on Human-Computer Interaction. ICCV'11.
Pages 437--444. IEEE. New York City, New York, U.S.A.. November. 2011. |
| PDF | bibtex | Gregor Miller and Sidney Fels and Michael Ilich and Martin M. Finke and Thomas Bauer and Kelvie Wong and Stefanie Müller. An End-to-End Framework for Multi-View Video Content: Creating Multiple-Perspective Hypervideo to View on Mobile Platforms. Proceedings of the 10th International Conference on Entertainment Computing (ICEC).
Pages 337--342.
Volume 6972. Lecture Notes in Computer Science.
Pages 337--342. Springer. IFIP. Berlin / Heidelberg, Germany. October. 2011. |
| PDF | bibtex | Gregor Miller and Steve Oldridge and Sidney Fels. Towards a General Abstraction Through Sequences of Conceptual Operations. Proceedings of the 8th International Conference on Computer Vision Systems (ICVS).
Pages 183--192.
Volume 6962. Lecture Notes in Computer Science.
Pages 183--192. Springer. Berlin / Heidelberg, Germany. September. 2011. |
| PDF | bibtex | Abir Al Hajri and Sidney Fels and Gregor Miller and Michael Ilich. Moving Target Selection in 2D Graphical User Interfaces. Proceedings of the 13th Conference on Human-Computer Interaction (INTERACT).
Pages 141--161.
Volume 6947. Lecture Notes in Computer Science.
Pages 141--161. Springer. IFIP. Berlin / Heidelberg, Germany. September. 2011. |
| PDF | bibtex | Gregor Miller and Steve Oldridge and Sidney Fels. Towards a Computer Vision Shader Language. Proceedings of the 38th Conference on Computer Graphics and Interactive Techniques Posters. SIGGRAPH'11.
Pages 40:1. ACM. New York City, New York, U.S.A.. August. 2011. |
| PDF | bibtex | Gregor Miller and Sidney Fels and Steve Oldridge. A Conceptual Structure for Computer Vision. Proceedings of the 8th Canadian Conference on Computer and Robot Vision. CRV'11.
Pages 168--174. IEEE. CIPPRS. New York City, New York, U.S.A.. May. 2011. |
| PDF | bibtex | Steve Oldridge and Gregor Miller and Sidney Fels. Mapping the Problem Space of Image Registration. Proceedings of the 8th Canadian Conference on Computer and Robot Vision. CRV'11.
Pages 309--315. IEEE. CIPPRS. New York City, New York, U.S.A.. May. 2011. |
| PDF | bibtex | Gregor Miller and Sidney Fels and Abir Al Hajri and Michael Ilich and Zoltan Foley-Fisher and Manuel Fernandez and Daesik Jang. MediaDiver: Viewing and Annotating Multi-View Video. Proceedings of the 30th Conference on Human Factors in Computing Systems Extended Abstracts. CHI EA'11.
Pages 1141--1146. ACM. New York City, New York, U.S.A.. May. 2011. |
| PDF | bibtex | Daesik Jang and Gregor Miller and Sidney Fels and Steve Oldridge. User Oriented Language Model for Face Detection. Proceedings of the 1st Workshop on Person-Oriented Vision (POV). WVM'11.
Pages 21--26. IEEE. New York City, New York, U.S.A.. January. 2011. |
| PDF | bibtex | Steve Oldridge and Sidney Fels and Gregor Miller. Classification of Image Registration Problems Using Support Vector Machines. Proceedings of the 11th Workshop on the Applications of Computer Vision (WACV). WVM'11.
Pages 360--366. IEEE. New York City, New York, U.S.A.. January. 2011. |
| PDF | bibtex | Stefanie Müller and Gregor Miller and Sidney Fels. Using Temporal Video Annotation as a Navigational Aid for Video Browsing. Adjunct proceedings of the 23rd Symposium on User Interface Software and Technology. UIST'10.
Pages 445--446. ACM. New York City, New York, U.S.A.. October. 2010. |
| PDF | bibtex | Gregor Miller and Sidney Fels. Uniform Access to the Cameraverse. Proceedings of the 4th Conference on Distributed Smart Cameras. ICDSC'10.
Pages 214--220. ACM. New York City, New York, U.S.A.. September. 2010. |
| PDF | bibtex | Amir Afrah and Gregor Miller and Sidney Fels. Vision System Development Through Separation of Management and Processing. Proceedings of the 11th International Symposium on Multimedia. ISM'09.
Pages 612--617. IEEE Computer Society. Los Alamitos, California, U.S.A.. December. 2009. |
| PDF | bibtex | Gregor Miller and Sidney Fels. Uniform Image and Camera Access. Proceedings of the 10th Workshop on the Applications of Computer Vision (WACV). WVM'09.
Pages 1--6. IEEE. New York City, New York, U.S.A.. December. 2009. |
| PDF | bibtex | Steve Oldridge and Gregor Miller and Sidney Fels. Automatic Classification of Image Registration Problems. Proceedings of the 7th International Conference on Computer Vision Systems (ICVS).
Volume 5815. Lecture Notes in Computer Science.
Pages 215--224. Springer. Berlin / Heidelberg, Germany. October. 2009. |
| PDF | bibtex | Gregor Miller and Sidney Fels and Matthias Finke and Will Motz and Walker Eagleston and Chris Eagleston. MiniDiver: A Novel Mobile Media Playback Interface for Rich Video Content on an iPhone. Proceedings of the 8th International Conference on Entertainment Computing (ICEC).
Volume 5709. Lecture Notes in Computer Science.
Pages 98--109. Springer. Berlin / Heidelberg, Germany. September. 2009. |
| PDF | bibtex | Gregor Miller and Amir Afrah and Sidney Fels. Rapid Vision Application Development using Hive. Proceedings of the 4th International Conference on Computer Vision Theory and Applications (VISAPP).
Volume 1. VISIGRAPP'09.
Pages 101--108. INSTICC Press. Setubal, Portugal. February. 2009. |
| PDF | bibtex | Amir Afrah and Gregor Miller and Donovan Parks and Matthias Finke and Sidney Fels. Hive: A Distributed System for Vision Processing. Proceedings of the 2nd International Conference on Distributed Smart Cameras. ICDSC'08.
Pages 1--9. IEEE. New York City, New York, U.S.A.. September. 2008. |
Contact Information
Gregor Miller
Sidney Fels
|
