Mobile Experience Lab at OCAD

Research

Projects
cicada







People

Partners

Publications

Resources

Contact

Home

P r o j e c t s :  I   S p y

A twist on the roles of surveillance (and its citizen-based inversion, sousveillance) in urban cultures. Specially installed Wi-Fi cameras transmit images to large display screens at street level and passersby are invited to control, manipulate and record the images of themselves (either for future users to stumble upon or as a take-away downloaded to their phones). The always-on nature of the surveillance apparatus provides a further introduction to users to move from passive to active participants. In this case they are able to combine the image of themselves with images of other locations along the street through keystrokes and the actual movement of their bodies within the frame. Current images can be blended with past images, highlighting for example the contrast and tension between daytime use of this street and its transformation after hours into the most tensely packed nightclub district in North America.

i spy

In rapid prototyping sessions, or charettes, we erased the thematic of surveillance and highlighted the technological possibilities. By removing the context of surveillance –which our project team was deeply committed to understanding in relationship to social surveillance context of city life and users of mobile phones—our team (led by designers engineering on open source platforms) created an imaginative and playful re-purposing of the surveillance camera as one leg in a system of linked screens, cameras and phones. By playing with these items, we came to understand surveillance cameras as something that can be reimagined as other types of devices with roles that differ from the standard practices of and dynamics produced by photographic cameras. 

In one instance, for example, we, critically, turned the camera on itself, making it a tool that allows one to consciously insert herself into a social narrative of her own making.  More, we repurposed the cameras to overlay or fill the surveilled image. As such, users approaching surveillance cameras can control – not the angle, or focal point of the camera but instead, the actual image. As such, the surveilled subject is no longer subjected in the usual case of photographic images.  This image, instead, can be entirely distorted by the image of the user approaching the camera, making the surveillance camera something that subjects the conscious user, by choice, rather than the unsuspecting passerby who is unintentionally caught on camera.  The surveilled subject views this manipulation either through the public screen or via her cellphone. 

What is surprising and exciting about this new technology is not that erasing the context creates innovation. Rather, the inherent bias of the technology – that surveillance cameras surveil – was not eliminated. Rather, it is maintained and repurposed in a manner that reveals and critiques the notion of surveillance. This illustrates the difference “between the practice of data processing and its narrative”. (Castells) Phenomenologically there is something very interesting that occurs here, because the experience is inherently both playful and irreverent.  To erase another subject with one’s self, and to supplant pieces of their image with one’s self is an act of power – that is simultaneously playful and teasing, even as it is willful and manipulative.

More importantly, this experience occurs in a different context that is both mobile and urban. Were game producers to place screens and cameras in the street for play, the experience would be akin to a simple movie set, where the film created was live and interactive, and where camera movement and control is replaced by users who manipulate the image via the movement of their bodies through space.  While anyone in the public space can view the experience on the public screen, the mobile user, who is actually surveilled can view herself as the subject of her phone, as she moves in real time, or on the public screen, as the subject of what can be termed a public film. 

Overall Architecture:

Network-enabled camera streams captured video footage constantly to control server

Server performs post-processing on video stream (e.g. image blending and filtering), and sends it to user’s mobile device

User receives video on his mobile device (which is updated in real-time)

Communication Schemes:

Wifi Version: Users with Wifi phones can access the video streams using Wifi connections to Ontario Hydro One-Zone hotspots

GPRS Version: Users with non-Wifi phones can retrieve the video streams over their cellular network via GPRS

Types of Video Streaming:

Still Image Sequences: Server sends camera footage to phone using a constantly updated sequence of still images (result will resemble a flip-book)

Real-time video: Real-time video streaming using a Java or Processing interface, via RTSP protocol. A streaming server is required for this configuration

Types of Image Post-Processing:

Image filters:

Desaturation (color to black & white)

Image Grain

Color Adjustments/ Manipulation

Blending two videos/image by varying alpha levels (transparency)

Isolating components of one video (e.g. a human form) and inserting them into a second video

Technologies/ tools to be used for image processing:

ImageMagick, NetBPM, Processing

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Ontario College of Art & Design