***

Interactive film: 360, interactive, 3D, 4D.

 

Problematic elements in crafting an immersive, interactive film.

• lack of agency, the viewer is positioned as a character within the film, yet has no or limited agency over the action.
• inability for film to adapt to the individual viewer
• usual cinematic techniques (close ups, scene cuts etc), do not work in this type of film, as they remove the viewer from immersion because of their implausible nature. Such films necessitate realism in order to be believable – as is the intention.
• action on screen does not correlate with the action of the individual in interactive film – e.g. when running in the film, the viewer themselves does not move, hence it is immersive as it is not believable movement (interestingly, when the vehicle of acton – eg car, bike, elevator – is evident on screen, the movement is more believable, and thus more immersive).
• live action film is not reactive enough to be believable, whilst generated images are not visually realistic enough to be believable.

 

3 Key areas

1. the poetic space of sensory denial v the potential introduction of newly constructed uncanny valley

2. the questionable efficacy of a sound design approach to motion-coding.

• sound provides a snapshot of the world around
• sound affirms action
• sound manipulates to evoke emotion
• sound acts upon physical, psychological and structural levels

SD vs MFX

two problems

1. sensory fidelity and temporal acuity
   – segregate / integrate          resolution       – sound functions at a higher level than vision
2. you pay attention to physical movement – if something suddenly changes, you pay attention to it – in 4D, chairs providing movement have the ability to enhance the film if movement is clear and
3. the unintended effects of the inevitable compromises to retrofitting.
   – low level
   • sudden attention at re-activication of the chair – immersion break
   • chair resetting position at sequence shifts / scene changes.

 

Film, unlike rides (agency free), or games (agency) are not built for interactivity – instead it is an add on, and this is why it often remains unconvincing.