Narrative structure
Something else I’d like to discuss in at least preliminary fashion is the narrative structure of the video slideshows (indicated by Rose as potentially useful in analysing composition of videos and video games at the site of production), particularly its temporal and spatial aspects (Kress, 2005).
Temporality
In all three of them, the story unfolds itself in time on screen in front of the viewer’s eyes so the temporal aspect of the interpretation wins over the spatial components, particularly in Assignments 1 and 3, in which the subsequent slides of the visual narrative consist of single images only. This is strengthened by the linearity-oriented voiceover that accompanies the slideshows.
Spatiality
Video 2 is slightly different as here the single frames are composed of visual and textual elements and so their spatial arrangement can be analysed to shed light on the interpretation. Because of my interest in the synergistic interaction, it is vital that I explore the relationships between the text, either in its inscribed or performed form and the visual. What seems interesting is when I freeze the frame which includes inscribed textual elements I can analyse them in reference to the images in the frame; they are made permanent for that particular moment in place and time. When the voiceover is present, when I stop, I'm left with the images in front of me and whatever I remember from the recorded narration. This soon drifts away as speech is transient not permanent.
Question?
What do these two alternate methods of remediation of a verbal mode (is this a correct term here?) mean for the multimodal interaction? Which one is privileging or deprivileging language/visuals?
In all three of them, the story unfolds itself in time on screen in front of the viewer’s eyes so the temporal aspect of the interpretation wins over the spatial components, particularly in Assignments 1 and 3, in which the subsequent slides of the visual narrative consist of single images only. This is strengthened by the linearity-oriented voiceover that accompanies the slideshows.
Spatiality
Video 2 is slightly different as here the single frames are composed of visual and textual elements and so their spatial arrangement can be analysed to shed light on the interpretation. Because of my interest in the synergistic interaction, it is vital that I explore the relationships between the text, either in its inscribed or performed form and the visual. What seems interesting is when I freeze the frame which includes inscribed textual elements I can analyse them in reference to the images in the frame; they are made permanent for that particular moment in place and time. When the voiceover is present, when I stop, I'm left with the images in front of me and whatever I remember from the recorded narration. This soon drifts away as speech is transient not permanent.
Question?
What do these two alternate methods of remediation of a verbal mode (is this a correct term here?) mean for the multimodal interaction? Which one is privileging or deprivileging language/visuals?