Monday, 30 September 2019

Geographies of Interactive Digital Narratives


This post provides an account of the Geographies of Interactive Digital Narratives session that took place at the Royal Geographical Society (with Institute of British Geographers) Annual International Conference on 29th August 2019. The session was co-organised by myself and Dr. Scott Palmer from the University of Leeds, and was gratefully sponsored by the Digital Geographies Research Group of the RGS-IBG.

____________________________


Introduction

The turn towards the digital within the humanities and social sciences over the past couple of decades, recognising the increasing pervasiveness of computational hardware and software in everyday life and societal organisation, has brought together scholars and creative practitioners from a wide range of disciplines, seeking to investigate and codify exactly what is distinct about the ways in which digital technologies mediate our lives.

Yet it is apparent that event amidst the diversity of digital communication tools in use today, humans still rely on one of the oldest and most widespread methods for sharing information and experiences: storytelling.

Not only do digital media provide platforms for communicating existing narrative forms, such as e-books for novels and online video streaming sites for film, but they enable new methods of storytelling through their computational affordances. While video games have proved the most influential of these computational narrative media in popular culture, comprising an industry in which 2.5 billion players now spend a total of $152.1 billion on games globally, digital storytelling has embraced a wide range of forms. These have included hypertexts – branching narratives communicated through the user’s navigation of hyperlinks; immersive theatre that uses technology to augment performance spaces; and interactive TV and film – screenplays whose narrative path depends on the inputted choices of the viewer, the most well-known example being last year’s Black Mirror episode Bandersnatch.

Even within the area of ‘games’ itself there is a huge amount of diversity, particularly as the internet, mobile and locative technologies have enabled more pervasive forms of play in which game narratives can bleed into our everyday relationships, routines and environments (see, for example, alternate-reality games and location-based games).

With emerging narrative uses of digital technology being recognised by public sector and creative industry members as the driving force behind the so-called ‘immersive economy’, we are also seeing increased investment into the production of creative works that use virtual reality (VR), augmented reality (AR) and mixed-reality (MR) technologies. In the UK, this has filtered through to academic and arts council funding too, as government bodies seek to make the UK ‘world leaders’ in this burgeoning ‘immersive’ sector.

But why should this topic be discussed at a geography conference?

What many narrative theorists working in the area of digital media have observed is that it is digital media’s unique ability to represent navigable space that is essential to the dramatic power that digital narratives have. Whether it is movement through branching links or choices of hypertexts and interactive film, physical environments aided with GPS and digital mapping, or designed 2D and 3D environments, navigation is typically central to the flow of narratives in digitally-represented spaces.

Beyond how digital narratives are experienced, there are also geographies to how these works are produced and consumed, which often differ and compare interestingly to more traditional narrative media. From a scholarly perspective, this digital evolution in narrative form, production and consumption might also point towards new methodological opportunities and challenges in our work as researchers.

Even given these observations, there has been minimal consideration of the narrative significance of digital technologies within geography, despite a long history of geographers engaging with other narrative forms (particularly in the prominent sub-field of literary geographies). At the same time, in other disciplines where research on digital narratives is undertaken, such as game studies, there has been a clear lack of critical engagement with geographical conceptions of space and place.

What this session aimed to do was to fruitfully bring together narrative scholars and practitioners from across the arts and humanities to provoke new directions of scholarship between geography, narratology and the diverse range of related disciplines; to grapple with the implications of interactive digital narratives for how we understand space and place, and discuss the conceptual and methodological opportunities and challenges that are provoked by research and creative practice in this field.


Duncan Speakman – ‘It Must Have Been Dark by Then’: Geographic Narratives and Temporal Composition in an Interactive Mobile Audio Artwork

Our first presenter was Duncan Speakman from the Pervasive Media Studio in Bristol, who discussed his locative audiowalk and companion physical book ‘It Must Have Been Dark By Then’. This work uses evocative music, narration and field recording to communicate stories from environments that are changing – from the swamplands of Louisiana, to empty Latvian villages and the edge of the Tunisian Sahara.

Rather than being a site-specific work with a set route, users are asked to seek out particular types of spaces in their environment, with the software building a unique map for each person’s experience. By choosing their own paths through the city, participants can explore ideas of environmental change in the places they inhabit and consider how they might connect to locations elsewhere in the world.

As well as being directed by where participants choose to walk, the app occasionally asks you to reach a certain nearby location, indicated by the blue dot and basic directional markers on the app’s blank map. Duncan explained that this part of the work aims to draw attention to the material attributes of participants’ surroundings, with any challenges in reaching these locations provoking an acute awareness of the physical, legal and social boundaries that constitute their present environments.         

Once a location is reached, participants read the associated chapter of the book while listening to the atmospheric sound and field recording from the location the story derives from. Here, Duncan’s work seeks to draw on the immersive capacity of audio and books to mentally transport you to different locations, despite being very much embedded in a particular place and time at the moment of listening and reading.

Throughout the walk, the app tracks the locations the user visited. Then, in the second half, participants are invited to walk back through the sites they visited previously, listening to narration that continues the stories that were read about in their specific locations. As participants remember reading about individual experiences of environmental change at the sites they visited, the route of their walk becomes a kind of physical sculpture of memory that draws together near and far, past, present and future in the singular moment of inhabiting a particular place at a particular time.

Indeed, temporality was central to Duncan’s thinking when designing It Must Have Been Dark By Then. While most locative media involve participants heading to particular locations to receive content, Duncan believes that the gap between these points is often more important to the composition of the story. By purposely cultivating slow and absorbing methods of communicating the stories, Duncan aimed to create impressions of environmental change that move beyond paradigms of the ‘eco-sublime’ perpetuated, for example, by images of collapsing glaciers and ice sheets. Instead, Duncan argues, we need to look at the everyday environments around us and think about their timelines.

Ultimately, It Must Have Been Dark By Then seeks to use a unique form of interactive storytelling to develop new forms of attention towards the environments we live in – beyond pervasive and simplified divisions between subject and object, human and nature – to articulate methods of witnessing that trace these entanglements; imagining the world not as for humans, but with humans.


Jonathan Barbara – Narratively Consistent Virtual Reality Interactive Narratives in Cultural Heritage Experiences

Our second presenter was Jonathan Barbara from the Saint Martin’s Institute of Higher Education in Malta, who discussed the potential of interactive digital narratives for telling stories of life at cultural heritage sites; bridging between tangible cultural heritage (artefacts with a physical presence) and intangible cultural heritage (cultural practices, traditions and representations that have no lasting physical presence).

Jonathan began by outlining the importance of digital technology for cultural heritage today. While the promotion of digital cultural heritage is certainly not new, particularly in museum spaces where technologies such as touchscreens are now prevalent, VR and other immersive media formats have the potential to expand accessibility while improving the safety of historic artefacts and enabling engaging and sensual forms of learning. The significance that digital manifestations of heritage assets can have today was illustrated by the example of how models of Notre Dame from the Assassin’s Creed video games have been used to help guide the Paris cathedral’s reconstruction effort, following the fire that took place there earlier this year.

What Jonathan is particularly keen to explore is how the mechanics of interaction with digitally-mediated cultural heritage might be informed by the specific geographies of historic sites – the built environment and cultural practices that occur there today and have occurred there in the past.

With this aim in mind, Jonathan ran a workshop for students that asked them to design ideas for a casual game relating to the Hypogeum in Malta, a prehistoric subterranean site thought to be a sanctuary and later a burial site. The workshop participants were given a map of the Hypogeum, alongside basic textual and visual prompts such as photographs and detailed descriptions relating to life at the site. No guidance was given to the students as to what kind of interactive experience to create.

Interestingly, Jonathan found that his students’ game designs consistently returned to tried-and-tested interaction mechanics from popular culture; notably escape rooms, Pokémon GO and treasure hunts. This is despite there being a wealth of behaviours, rituals and systems associated with the site upon which interaction mechanics could potentially be based, including acts of digging, burial rites, and the unique social fabrics that were present at the site.

Jonathan concluded by suggesting that interactive storytelling mechanics that are more deliberately inspired by the specific geographies of heritage sites might help visitors to better make sense of their repositories of tangible and intangible heritage, and called on those in the session to consider and discuss how this might be achieved.


Lissa Holloway-Attaway – Play, Place, and Telling Micro-Histories through AR Storytelling Experiences for Children

Our third speaker was Lissa Holloway-Attaway, an Associate Professor of Media Arts, Aesthetics and Narration from the University of Skövde in Sweden. Lissa’s presentation discussed the AR playable book series called KLUB (Kira and Luppe’s Beastiarium) that her and university colleagues have created to engage children with folklore from the Skaraborg region of Sweden.

The KLUB series revolves around the characters Kira and Luppe, a young werewolf and vampire, and their struggle against a ringleader character who attempts to make them perform in a travelling circus. It is in Kira and Luppe’s journeys with the circus where they encounter fantastical beasts, with each book in the series telling an individual story based on folklore from one county in Skaraborg. When children, accompanied by their parents, read the books and scan certain images within them using the KLUB app, the characters portrayed in the images appear as 2D and 3D visualisations that are then collected in the app’s ‘beastiarium’.

This form of interactive storytelling is further reinforced by other methods of cultural engagement that Lissa’s team have developed. Having formed partnerships with a range of local, national and international collaborators, characters from the KLUB books are now appearing in numerous local museums in Skaraborg as part of playable and augmented-reality exhibition experiences. Through this broad range of interactive and site-specific activities, the creators are aiming to use technology to foster connections between tangible and intangible heritage, employing the fantastical themes of the stories to encourage families to explore the diverse landscapes of the Skaraborg region in person. Working further towards this aim, the team plans to extend the KLUB universe into other media forms, including board games and guidebooks.

Beyond the KLUB project, Lissa is interested in how geographers and artists might work together to find ways of re-imagining landscapes through the medium of maps. To this end, Lissa has been involved in a recent project that engages children with their local cultural heritage sites by asking participants to map these places in the game world of Minecraft. Given the representational and abstract qualities of maps, Lissa made the point that this type of exercise benefits from being both creative and actively informed by the geographies of these individual sites. Indeed, these examples, Lissa suggested, point towards a wider trend of using the interactive possibilities of digital technology to enable experiential engagement with place.

It must be noted that, during the session, we discovered that one of our audience members was from Sweden, and that her family have actively used the KLUB books to teach the children about their heritage in Skaraborg since moving away from the region. Lissa explained that she has heard of many similar experiences, and that one of the aims of the project was to create a fairytale for whole families to explore together, connecting local heritage to the personal ties of ancestry and memory.


Jack Lowe – Environmental Storytelling: A Digital Frontier for Narrative Geography

I was the final presenter in our session, exploring the relationship between navigation and narrative in exploration-based video games by discussing a set of game design practices known as environmental storytelling. I went on to consider what potential environmental storytelling might have for interactive digital narratives that operate in physical settings using locative, mobile and ‘immersive’ media, explaining how environmental storytelling can provide a conceptual and practical toolkit for making sense of relationships between geography, narratives and digital technology. (A full written version of this presentation is available here).

I began my presentation by outlining how the ways that we interact with digital media are characteristically navigational – whether it’s in our use of hyperlinks to travel between websites, use of geolocation to traverse physical space, or deliberate movement through the rendered worlds of video games. What is distinct about interactive digital narratives is how these processes of navigation are shaped into the dramatic enactment of plots.

In the case of environmental storytelling in video games, developers use evocative narrative elements in the form of in-game objects (e.g. written notes and artefacts), sounds (e.g. music, ambient sound), haptic feedback (e.g. how the avatar moves) and more to embed story information into their worlds for players to find. This distributed composition of the storyworld – as opposed to a consistent narration – not only allows for the  communication of a range of character viewpoints (multi-vocality), but also means that players can direct where to focus their attention in the world, and the extent to which they do so (dynamic focalization). The result is a highly personalised account that is closely tied to the player’s own interpretations and domains of meaning-making.                                  

Nonetheless, game developers can also employ subtle design techniques to guide the player’s navigation. These are gating, in which entry and exit points are coordinated to structure the player’s exposure to information; signposting, in which light and sound directs the player’s attention towards significant narrative elements; and pacing, in which the spacing between narrative information is managed to elicit dramatic tension and mood. Taken altogether, environmental storytelling operates through the curation of a mise-en-sensibilité of player sensibilities, material hardware and aesthetic representations, through which players assemble meaningful experiences within a flexible structure that enables their navigation through the game world to unfold in dramatic and emotionally engaging ways.

With the advent of more widespread adoption of locative media, 360° video and AR/MR technologies, artists are increasingly invoking navigation in ‘real world’ places as the basis of interactive storytelling. Yet many of these hybrid ‘immersive’ media present challenges that aren’t typically faced by video game designers, particularly concerning the contingency of embedding narrative elements in living, changing environments; the often uncomfortable intersection of the gameplay with existing material processes, histories and socio-legal norms; and retaining dramatic agency when the boundaries between the storyworld and everyday life are less clearly defined.

Particularly when these challenges and affordances are confronted through practice-based research, as part of a creative process, this is why I concluded my presentation by arguing that environmental storytelling as a concept can be useful for scholarship beyond just video game design, providing opportunities for apprehending the broader ecology of materials, bodies, social norms and physical processes that shape how digital narratives are produced. In so doing, environmental storytelling can potentially offer an important frontier for interdisciplinary research across the digital humanities into how the relationship between navigation and narrative plays out across a range of contexts.              


Panel discussion

The first main topic deliberated in the panel discussion concerned the relationships between physical objects and digital representations in interactive digital narratives, and what the materiality of objects used in these storytelling media adds or takes away from participants’ experiences. One common theme across all the responses was the power that material culture can have for transmitting stories across spaces and times. Duncan notably emphasised that his decision to include a physical book as part of It Must Have Been Dark By Then was to incorporate the stories’ words into the processes of aging and decay being experienced by the environments that are both represented in the text, and in the physical sites that participants travel through. Later, Lissa reiterated that Skaraborg’s physical environment was always one of the starting points for her team’s work, and the fictional frame offered by the KLUB books is aiming to heighten engagement with the material culture and built environments that people can interact with in person.

Another key pivot of our discussion centred on how design processes for interactive digital narratives are managed. The questioner was considering the predicament Jonathan described in his presentation, regarding how the mechanics of interactive digital narratives might be informed by the geographies of their sites, and suggested that part of problem may have been that people think about digital media such as games in terms of genres rather than affordances. Consequently, perhaps there is a need to embrace a more bottom-up design process as opposed to a top-down implementation.

In response to this comment, Duncan made the point that allowing large numbers of voices into a creative discussion can sometimes hinder innovation. All of the presenters concurred that focus groups in particular can be difficult spaces to enable creativity due to the saturation of diverse viewpoints, and the groupthink that can ultimately occur when certain voices are heard and others are silenced.

Our final question asked all of the presenters to consider what is left out of the various narrative media we discussed in the session. In my response, I explained how many exploration-based video games are based on worlds that are devoid of characters you can interact with directly. Instead, the narrative structure of these games often follows a treasure-hunting or evidence-gathering theme in which the player is able to travel and search almost unhindered through the world. Not only does this format lend itself to particular types of stories at the expense of others (e.g. detective narratives) but it can represent an uncomplicated portrayal of the power relations that condition our capacities to navigate through environments in everyday life.

In Jonathan’s answer to this question, he highlighted the challenges of adequately replicating the specific lighting and sound conditions during rituals in places like the Hypogeum, thousands of years in the past. While having no description or depictions of these prehistoric rituals leaves much to the imagination, it is possible to simulate the entry of sunlight and capture the sound profile of underground cave reverberations, which may reflect some of the ambiance of the site. Nonetheless, even with the technology available today, this task remains a computational challenge.

______________________________


As one of the session organisers, I would like to thank everybody who attended Geographies of Interactive Digital Narratives and contributed so thoughtfully to the panel discussion. I’m particularly grateful to Scott Palmer for his support in convening this session with me, the RGS-IBG for their help and quick responses when administering the session, and the Digital Geographies Research Group for their sponsorship. Lastly, I want to thank my fellow presenters Duncan Speakman, Jonathan Barbara and Lissa Holloway-Attaway for sharing work that engaged so insightfully with the session theme, alongside everybody who responded to the original call for papers. I hope the topics and debates explored in this session will continue to remain on the agenda in Geography and across related disciplines, in line with the increasing influence of digital narratives across our societies and cultures.


Saturday, 31 August 2019

RGS-IBG Annual International Conference 2019: Environmental Storytelling: A Digital Frontier for Narrative Geography


--------------------------
Below is the written component of the paper I presented in the Geographies of Interactive Digital Narratives session – which I also co-convened – at the Royal Geographical Society (with Institute of British Geographers) Annual International Conference on 29th August 2019. The superscript numbers in the text indicate the number of the corresponding slide you should view in the embedded Powerpoint above (you can access the slides separately as a PDF here).
I’d like to thank Scott Palmer for his efforts in convening this session with me, particularly when deciding how to frame the session, what papers to include, and what kind of format the session would take. I’m also grateful to the Digital Geographies Research Group for sponsoring Geographies of Interactive Digital Narratives, alongside an impressive number of other sessions on digital themes throughout the conference. Lastly, I want to thank my fellow presenters in this session, Duncan Speakman, Jonathan Barbara and Lissa Holloway-Attaway. As the session chair, I was delighted with the quality of the papers and how well they spoke to each other throughout the session, despite covering diverse digital narrative forms. A post giving an account of the overall session will be posted on this blog soon.        
--------------------------

Today1 I’m going to talk about the ways that stories can be told using a person’s environment with interactive digital media. I’ll be drawing on the example2 of exploration-based video games, explaining how a set of design techniques known as ‘environmental storytelling’ works to produce narrative experiences for players in their fictional worlds. This is based on autoethnographic research on 12 ‘walking simulator’ games and interviews with their designers.

In particular, I want to outline why I think environmental storytelling can provide a useful concept beyond just video games3, for thinking about the ways that navigational practices are meaningfully evoked in a range of digital narrative forms. I’ll ultimately be suggesting that this concept could be a starting point for new and fruitful directions of research at the intersection of geography, narrative studies and the digital humanities, especially given the heightened importance attributed to the ‘immersive’ sector of the creative industries today.

But first, why the focus on digital ‘environments’? It’s evident4 that the ways in which we interact with digital technology are characteristically navigational; whether it’s in our use of links to move between sites on the internet, the ways mobile and locative tech guides our movements in physical space, or the rendering of 2D and 3D worlds that we traverse in video games. Consequently, one5 of the qualities that makes digital storytelling unique is how these kinds of navigational interaction with virtual space are shaped into the dramatic enactment of plots.

This process is perhaps demonstrated most clearly by the game design practices known as ‘environmental storytelling’6. In game development, this term typically refers to methods developers use to embed narrative information in the worlds they design. As this information is discovered by players7 when they move through the spaces represented onscreen, they’ll come to perceive a sequence of events that has taken place in the world – a narrative. To quote Henry Jenkins8, who first popularised the ‘environmental storytelling’ term, video games displaying these techniques are not designed as pre-authored narratives, but “spaces ripe with narrative possibility”.

Accordingly, what I’m going to focus on in this presentation9 is, firstly, how narrative information is embedded or ‘emplaced’ in video game environments; and then how players navigate these storyworlds through the information they encounter. I’ll then use these observations to discuss why I think this concept of environmental storytelling is helpful for interactive media scholarship beyond video games.

So10, as a method of narrative communication that requires navigation, we can say that environmental storytelling entails the distribution of narrative information across the realm of play. Michael Nitsche calls these pieces of information ‘evocative narrative elements’ – details11 that don’t necessarily represent recognisable narratives in themselves, but require movement and interpretive work from the player to be understood as part of a wider story. These evocative elements can take a variety of forms, from detailed written artefacts like letters, diaries or newspaper clippings to objects, signs, and music.

But what qualities do these evocative narrative elements possess that enable players to construct meaningful stories from them?

Firstly12, the diversity and distribution of these elements enables a multi-vocality of information transmission, whereby each object can have its own voice and perspective, rather than being filtered by a narrator. This means that the narratives emerging from discovered artefacts always reflect the value judgements of those doing the interpreting – in this case, the player.

In the game Gone Home13, the player-character returns from holiday to an apparently empty house, and can explore the rooms and belongings of her family members to make sense of events that unfolded since she has been away. By giving players deep access to the thoughts, motivations and personalities of a range of story characters, players can engage with an intricate exploration of family dynamics and belonging in a middle-class American household, but in a way that allows them to interpret the events for themselves.

Importantly, though, environmental storytelling relies on players to find these narrative elements in the game world by exploring their surroundings. In narratology14, the relationship between the unfolding action of a story and what’s actually observed by the recipient is known as a story’s focalization. But what Michael Nitsche argues is that video games enable ‘dynamic focalization’, through which players can choose where to point the camera, which directions to move in, and what to focus on in their surroundings.

This has some important consequences for narrative communication. The possibility15 of ignoring information means that players can choose how they want to invest in the world, but also rely on their own observational skills to discover information rather than being ‘told’ or deliberately exposed to it. The player experience deriving from the emplaced narrative elements is tailored to the player’s own affective and emotional sensibilities. Indeed16, many developers choose to actively hide impactful pieces of narrative detail in the world, knowing they’ll provide a significant emotional payoff when found by those looking for secrets.

Dynamic focalization demonstrates how the communication of visible and audible narrative information is closely entwined with the player’s haptic control of an avatar as they explore game environments. And indeed17, the emplacement of narrative elements is as multisensory as the practice of game playing itself. Shibolet’s paper on the avatar’s movement in Journey describes how the ‘story’ of the experience comes into being almost solely through the shifts in movement dynamics you embody as you move across the world, each ingrained with a kinaesthetic significance that echoes the game’s wider metaphor of the path of life.

It’s an example that reminds us that game worlds are not just a mise-en-scene, but what Andy Lavender calls a mise-en-sensibilité. The interplay between diverse player sensibilities, material hardware and aesthetic representations assembles to generate events of narrative meaning-making.

What’s notable18, then, about environmental storytelling is how the stories that derive from the evocative narrative elements emplaced in the world become personalised to the player. The affects and perceptions that players chart become closely mapped onto internal topographies of the self, providing opportunities for players to engage on their own terms with aesthetic and kinaesthetic possibilities in the world. It’s this highly personal quality of player interaction that can make game environments “a place for dwelling rather than merely a territory”.

All this said19, the evocative narrative elements in themselves aren’t narratives. It’s the player’s navigation across environments populated by these pieces of information that leads to the development of stories. But how does this navigational process work?

When speaking to developers of the games I played, it became apparent that, even in worlds that seem to let you explore more or less ‘freely’, behind the scenes there are devices encoded into the world to subtly guide the player’s navigation. In the games I played, there were three main techniques developers used. The first20 is gating, in which entry and exit points in the world are carefully coordinated to structure the flow of information the player is exposed to. The most common method is to require that the player has found a particular object or piece of information in order to advance to the next area, such as locked doors that require keys or passcodes to open. The second is signposting21, in which light and sound directs the player’s attention towards certain significant elements in their surroundings. And the final method is pacing22, in which the spacing between narrative information is carefully managed to elicit dramatic tension and mood.

Together, these three techniques help to negotiate one of the key ‘perils’ of interactive storytelling – retaining drama when the interactor can determine which information they encounter and the context in which they encounter it. These techniques23 provide a basic framework that subtly shapes how players ‘join the dots’ between the world’s dispersed narrative information, preserving the intended affective qualities of the story, while still enabling the sense of thrill and intimacy that comes with encountering and interpreting this information for yourself.

Nonetheless, this balance between dramatic emplotment and player agency emerged from my interviews with developers most often in the notion of ‘believability24. The developers wanted to spin worlds that players could ‘imagine themselves into’, but recognised that achieving this aim meant purposely ‘leaving room’ for the player’s imagination. That’s why many exploration-based game design teams actively imbue depth and ambiguity into their worlds25, using juxtaposition, symbolism or even contradiction to invite players to formulate their own beliefs about what any arrangement of narrative elements ‘means’.

At the same time, designers need to reinforce the idea that each individual narrative element logically belongs to the wider fictional universe. For game environments based on real-world sites, this might entail quite extensive research – such as this26 example, where the developers used academic articles about farming practices to learn whether hay bales were wrapped in 1980s rural Shropshire. More generally, games testing27 is crucial, as developers of these games use player feedback to carefully manoeuvre the spatiotemporal attributes players interact with to achieve “positively affective” outcomes, with believability being one of these key objectives.

So by manipulating how narrative information is exposed to players as they traverse game worlds, developers create the conditions for players to draw meaningful associations between the evocative narrative elements. They calibrate player perception to ensure that dramatic agency is retained and believability is maximised, while also inviting personal interpretation to enable intimate narrative world construction by the player. The navigational process of enacting environmental storytelling isn’t a process of narrating events in sequence, but enabling dwelling in a storyworld that spills out of the screen, whose narratives are intimately tied to player dispositions, sensibilities and real-world contexts.

Everything28 I’ve said so far about environmental storytelling is based upon the findings of my research into video games. But today, particularly with the increasingly hyped ‘immersive media’ paradigm that’s shaping the future of work in the creative industries, we’re seeing an ever greater number of narrative works being produced that use locative media, 360° video, sound, AR, VR and MR technologies. Like video games, these are interactive and often involve some form of spatial navigation by the user. But to what extent can the game design techniques falling under the banner of ‘environmental storytelling’ be of relevance to these emerging media forms?

Well, the informational environments29 that users engage with in these immersive media arts often differ quite considerably from video games. Johann Huizinga famously described playful activity as something that takes place in a ‘magic circle’ – a sphere of activity separate from the spaces and times of everyday life that participants enter voluntarily. Yet for many of these emerging storytelling media, this magic circle is forced to expand in some way, whether spatially, temporally, or socially. The affordances of immersive technologies increasingly enable the blurring of fictional environments with the environments30 of everyday life.

This presents some important questions. How would a storyteller go about embedding narrative elements in changing, off-screen environments? In turn31, how would the gameplay interact with existing material processes, histories and social norms? And lastly, when the boundaries of the storyworld are less clearly defined, how can narrative designers ensure that participants continue engaging meaningfully with the narrative architecture they’ve designed?

It's evident that, if the ideas and practices associated with environmental storytelling are to be useful in these contexts, the informational ‘environment’ we engage with needs to be expanded too. In video game development32, environmental design currently refers to a very specific set of practices – such as modelling and texturing, lighting scenes, and creating concept art. Yet narrative world-building in hybrid ‘immersive’ storytelling forms often relies on a much broader ecology of human and non-human agents – intersecting with processes and phenomena we study across geography as a holistic discipline.

By adapting the environmental storytelling concept to encompass the array of materials, bodies, social norms and physical processes through which digital narratives of all types are produced, we can work towards understanding the significance of space and place in communicating stories across a range of digital media and contexts.

I also33 want to emphasise the importance of practice-based methodologies for answering these questions. From my own experiences so far in my practice-based PhD, being involved in the iterative process of game development reveals the myriad challenges and affordances that designers inevitably negotiate when working with environmental storytelling techniques, which can easily be missed after the creative process has taken place. Yet it’s often ‘interesting failures’ that offer the best opportunities for learning, and could address important questions here, such as: what kinds of story are most appropriate to tell using environmental storytelling techniques? What are the possibilities and limitations of this storytelling method in different contexts? And what implications are there for the experiences of creative practitioners involved?

All these questions would appear to suggest that there’s not only mileage in environmental storytelling as a conceptual framework through which research can be conducted, but more broadly that there are ample avenues for potential future study by those working across disciplines, and between theory and practice.

To finish34, I would argue that it’s no coincidence that scholars have observed a ‘spatial turn’ in the humanities and social sciences at the same time as a ‘digital turn’. Digital media have not only impacted the geographies of how societies operate and organise themselves, but the distinctly navigational qualities of how we interact with media generally. Both in how spaces are represented and negotiated, and how information itself is spatialized, digital media have influenced our understandings of dwelling in the world as humans.

Digital35 narrative forms such as video games are at the forefront of research into the relationship between ‘place’ and the digital because these media actively seek to create believable worlds that we can dwell in. Their storyworlds hinge on the sense of place curated by players as they encounter, associate and interpret information through navigation.

I’m contending36, therefore, that environmental storytelling can be an important frontier for future research at the intersection between digital geographies and narratology. Understanding how these storyworlds are crafted and inhabited can help to reveal and dissect the meaningful interrelationships of technologies, bodies and social norms that unfold when we engage with interactive media forms.

In particular37, I’m proposing that the environmental storytelling toolkit has mileage beyond its current limited use in games studies and game design circles. By expanding our conception of the informational ‘environment’ that participants in interactive digital narratives engage with, it can help us think about how the interaction between navigation and narrative plays out across a range of ‘immersive’ media, and not only in playful contexts38.


Wednesday, 31 July 2019

Wandering Games Conference 2019: Theorising wandering game experiences: post-phenomenology, navigation and narrative


--------------------------
Below is the written component of the paper I presented at the Wandering Games Conference on the 12th July 2019. The superscript numbers in the text indicate the number of the corresponding slide you should view in the embedded Powerpoint above (you can access the slides separately as a PDF here).
I’d like to thank Melissa Kagen, Eben Muse and all the staff and student helpers at Bangor University that made such an endlessly inspiring conference happen. It was probably my favourite academic event of all time in how it brought together such a warm and passionate group of people over shared interests and loves, and I really hope Wandering Games returns for another conference next year.         
--------------------------

When1 we talk about the unique qualities of games in which we wander – whether we’re traversing virtual or physical worlds – what do we refer to? We might describe the rules2 (or lack thereof) that determine how we wander; what roles we play in the world of the game. We might describe the process3 of navigating – how the ways we wander the game environments impact our relationships with them. And we might talk about the outcomes4 of playing these games – we might describe events and encounters that occurred as we wandered, and how the journey made us feel.

Essentially, with wandering games we distinguish something unique in the relationships between players and their environment, which differs5 from other types of games where one’s surroundings might be seen more as a backdrop to the gameplay, or a territory upon which gameplay unfolds. Rather, the environment, and how we traverse it, is central to the meaning-making process that occurs during wandering games. In geographical terms6, we could say that we’re distinguishing between game spaces and game places.

In this presentation, I want to demonstrate the usefulness of geographical approaches for making sense of the meaning-making process that takes place in wandering games. By understanding their unfolding interrelationships of bodies, social relationships and technologies as a form of dwelling in place, we can not only better understand the ways that players play and experience wandering games, but think about their potential for enabling practices of design and play that articulate different ways of being in the world.

To do this, I’m going to draw on research involving both video games and physical location-based games. The first is a study7 of walking simulator video games, in which I carried out autoethnographic playing of 12 walking sims and interviewed their developers. The second8 is a long-term study of the GPS-based treasure-hunting game Geocaching, for which I’ve also used autoethnography, as well as analysing geocache descriptions9 and the logs other players have left after finding the hidden containers.

I’m going to talk about two key aspects of the place-making process that occurs in these games: emplacement10 – how information is positioned in the game’s world to elicit certain kinds of responses, and what kinds of information; and enaction11 – how players engage with and make sense of this information as they wander, and the situated acts and inconsistencies these forms of wandering might entail.

Together12, this discussion will point towards experiences of dwelling in the worlds of wandering games as something assembled contingently, between connections and disconnections of human and non-human agents that unfold through the navigational gameplay. I’ll finish by explaining how this way of thinking can help us get to grips with what these games do, and what they can allow us to do as designers and players.

As13 we wander through the environment of a game, our feelings and perceptions will be shaped by what we encounter and the information we glean from the world, whether it was put there intentionally or not.

In walking simulator games, developers aim to qualify these experiences through environmental storytelling – whereby the construction of a narrative relies on the player’s navigation between pieces of information purposefully embedded across the game’s environment, and the interpretations they make from these evocative narrative elements.

In Geocaching14, we might say that this informational ‘environment’ is expanded to include all the materials players can use to find a geocache: the description and hints available on the cache webpage, curated by its owner, and past activity logs. Players then determine how this information corresponds to what they encounter physically.

But what does this distribution of information across the environments of these games achieve?

Most notably15, it allows players to choose what they focus on – a function Michael Nitsche calls ‘dynamic focalization’. The meanings that players derive from the distributed information are determined by what they notice in the world; and what their inclinations and motivations are as they explore. The possibility of ignoring16 certain pieces of embedded information means that players can decide the manner in which they want to invest in the world – whether to look in one place as opposed to another; whether to spend a long time piecing together details of what they encounter, or simply find what they need and leave.

By positioning this moment of focalization right at the heart of the game space, the player experience is tailored to their own affective and emotional sensibilities. Navigating17 the world becomes a personalised event in which the significance of locations in the game environment becomes tied to the interests and urges of the individual player.

Furthermore, many developers seek to invite individual interpretation18 through the content of these narrative elements themselves, which is often deliberately ambiguous and multi-vocal.

In walking sims, this might come across in the use of symbolism, or artefacts that are written or spoken by multiple characters. While these aesthetic elements have their own voice and perspective, there’s no singular trustworthy narrator to filter what’s meaningful. Players have to decide what’s significant for themselves.

In Geocaching19, this active encouragement of interpretation is most apparent in the use of hints, which ask the player to apply their interpretation of the words to their surroundings. One of my favourite examples is a geocache I found where the hint was ‘I don’t ever want to feel like I did that day’. At first the phrase seemed to bear no relation whatsoever to my location, until it suddenly clicked that those words are the lyrics to the Red Hot Chili Peppers song ‘Under the Bridge’. Sure enough20, that’s where the cache was located. But I’m also aware of the degree of personalisation that this method provokes, because every time I walk past that particular bridge, I think about that moment of discovery, and often the song comes into my head too!        

I want to emphasise that the relationship between navigation and narrative in games where we wander can be more structured than it appears. Developers typically make their games with the aim of achieving particular emotional effects – effects that can make use of the personal focalization that wandering entails.

For walking simulators21, developers use three main methods to achieve this. The first is gating, in which entry and exit points in the world are carefully coordinated to structure the flow of information the player is exposed to. The second22 is signposting, in which light and sound directs the player’s attention towards certain significant elements in their surroundings. And the final23 method is pacing, in which the spacing between narrative information is carefully managed to elicit dramatic tension and mood.

As you can see, this level of authorship by developers often simply comes down to how players are able to move and act in the game world. Shibolet’s24 excellent paper on the avatar’s movement in Journey, which describes how the ‘story’ of the experience comes into being almost solely through the sense of trajectory you embody as you move across the world, reminds us that game worlds in which we wander are not just a mise-en-scene, but what Andy Lavender calls a mise-en-sensibilité. The emplacement of information is as multimedia as the practice of game playing itself.

Indeed, in Geocaching25, alongside the text we see on the webpage, the way geocaches are hidden is geared towards players sensually engaging with the world through touch; using embodied experience to engage with what the abstract view of GPS coordinates fails to see.

What’s notable, then, about the navigational qualities of wandering games is how the stories that derive from these experiences become personalised to the player26. The constellations of affects and perceptions that players chart become closely mapped onto internal topographies of the self as much as information represented digitally. And this is often deliberate. The designed structure of wandering games can provide opportunities for players to engage on their own terms with aesthetic and kinaesthetic possibilities in the world. They can become gatekeepers to “intimate spatial knowledge”, to quote urban explorer Bradley Garrett, turning the game space into “a place for dwelling rather than merely a territory”.

However27, understanding how this relationship between navigation and narrative plays out in practice is crucial, because games are evental media. Whether you’re loading up software in the case of video games, or heading out for a playful wander in a physical environment, the emplaced information of the game, without input from players, is just static architecture. As Alexander Galloway puts it, games only “exist when enacted”.

So what does enaction mean in the context of wandering games? How do our actions as players lead us to have meaningful experiences?

Let’s start with Geocaching28. When geocachers head out in search for a cache, they travel to the treasure’s listed coordinates on the Geocaching website. While reaching the given coordinates will bring the player within close proximity to the geocache, GPS technology itself is only accurate within a 10-metre radius, and is degraded further by factors such as tree cover.

Yet rather than fostering a detachment from the corporeal game environment, these affordances force you to look up from your device and interact sensually with your physical surroundings to find the hidden container. The limitations of the technology are what provokes this sensual engagement.

In turn29, other players have the agency to hide geocaches in creative or elaborate ways, such as the one shown here. A geocache’s coordinates are there for anyone to see; it’s by engaging sensually with the unique materialities of cache locations that geocachers can feel the sense of empowerment, excitement and intimacy that the treasure-hunting gameplay aims to provoke.

Furthermore, over time many geocachers30, myself included, become more adept at this practice of finding geocaches, learning to recognise signs of disturbed ground, the sensitivity of the app’s GPS compass, and common hiding techniques. Often referred to as the player’s ‘geosenses’ or ‘cacher’s eye’, navigating to geocaches for regular players becomes a process of attunement, whereby technology, gameplay and material environment combine to re-orient bodily senses, and intensify the player’s relationship with their surroundings.

We might liken this process to cognitive mapping31 – the performative act of making connections between places and meaningful information, whereby, to quote Lynch32, “nothing is experienced by itself, but always in relation to its surroundings, the sequences of events leading up to it, the memory of past experiences.” And this can be found in the gameplay of walking sims too, as we navigate the mise-en-sensibilité that developers curate.

The issue with fictional worlds, however, is that the believability of the world – which you could say is the extent to which players are able to form coherent mental maps of it – is potentially more fragile33 and subjective. Not only are digital games susceptible to technical glitches, such as the problems I discovered in Firewatch with the rendering of textures in certain areas, but also there’s a fine balance for developers to negotiate in terms of exposing information34. They want to do so in a way that elicits emotional engagement, while also leaving enough room for players to stitch together a model of the world that make sense to them.

For example, during my autoethnography of walking sims, in some games I’d question how I discovered narrative information such as diary entries and graffiti that was somehow perfectly positioned to continue a linear story. As my navigation of the world began to feel more authored, the world no longer felt believable as a place, but felt more like a game level, where my own interpretation of events was seemingly less important. At those moments, it didn’t feel like a world I could imagine myself into.

The designers of walking sims aim to manage some of this inconsistency through testing. While many of the technical problems have technical solutions, for walking sims testing also exists to find inconsistencies in how people engage with the world subjectively35. For example, The Chinese Room re-made the world of Everybody’s Gone to the Rapture from scratch four or five times, simply because testing revealed that it didn’t ‘feel’ right to people as a Shropshire village. As James Ash observes36, testing is a process that enables developers to “render contingency visible” with the aim that these relationships between technologies, bodies and represented worlds can be re-attuned towards more “positively affective” outcomes.

We’re beginning to see that the relationship between navigation and narrative that develops when we wander in games, which I’m calling a place-making practice, is closely connected to personal embodied37 responses and their social and cultural associations. Only last week, I ran a workshop introducing academics to walking simulators, and some of the people in the room had never even picked up a games console controller before. It was a stark reminder that experiences of playing these games always intersect with age, disability, gender, ethnicity and many other facets of society and culture, whether this is in the playing of the game, or even being able to access and participate in the activity in the first place.

In Geocaching38, we’ve seen this intersection with social and cultural norms play out quite prominently on a larger scale in the public eye, where the gameplay has prompted legal action and security alerts, for example. And though I didn’t experience any barriers to playing the game based on embodied factors alone, as a white, able-bodied male, my participation at times has been restricted in other ways.                          

In the nerve-wracking39 example pictured here, I wasn’t willing to climb to the top of this tree to grab the geocache hidden there as the weather was windy, and I knew I wouldn’t be able to make three points of contact on trunk, contravening the social standards of climbing safety I once learnt. By abandoning my retrieval of the cache, my experience was characterised by situated articulations of material conditions, social norms and bodily capacities which weren’t simply playful or serendipitous, but actively restrictive.

These examples remind us that practices of place-making40, and the links we develop between navigation and narrative, aren’t ideologically neutral. As geographer Tim Cresswell has noted in his seminal work In Place / Out of Place, the link between place and ‘belonging’ is central to many relationships of power in societies, particularly when we label certain acts or bodies as being ‘out of place’. Place becomes not just a domain of community or attunement, but also of ‘geographical deviance’ and disconnection.

By recognising the potential of ‘geographical deviance’, however, I want to finish by highlighting how acts of wandering also provide opportunities for transgression. It’s a fairly tame example41 that I came across during my research, but in the game Gone Home, which allows players to pick up objects and place them wherever they want, some players decided to collect all the items you can pick up in the game and put them in one room; while others curated shrines to the individual characters, rather than leaving the items as they were found. It’s just a small example of the potential of navigation as a transgressive act in wandering games, which can re-write stories of engagement with game places that disrupt established norms and make some of these underlying rules newly visible.

As digital technology42 has come to influence the ways we encounter and make sense of the worlds we inhabit, critical thinkers across the arts and humanities have sought to chart the factors that shape our place in the world as humans.

As a distinctly interactive medium, with associated concepts of agency and immersion, for example, games are a particularly useful area of study for getting to grips with our being in the world, and how interrelationships of human and non-human components influence this.

The conception of place43 I’ve been using today is born out of post-phenomenological approaches in Geography, which understand our experiences of being in the world as less about ‘being there’, but more about ‘being with’ – being part of an unfolding ecology of human and non-human agents that assemble contingently and in situ; not solely centred in the human mind.

What I hope to have demonstrated today is that, in the unique ways that wandering in games develops meaningful relationships between individuals and environments, we are talking about practices of place-making. And by understanding44 what we mean when we talk about dwelling in place – as something highly personal, sensual, contingent, performative, and potentially transgressive – we can better recognise both the opportunities and limitations that arise from these articulations of bodies, technologies, materials and social norms.

I’m arguing that if we’re going to make games in which the kinds of experiences we want players to have result from developing meaningful relationships with the environment, we need to consider what we mean when we say things like we want to create ‘believable’ or ‘emotionally-engaging’ worlds with a ‘sense of place’.

As a final touchstone45 for my presentation, I want to highlight the work of people in games such as Kate Edwards, a high-profile member of the games industry who is employed specifically as a geographical consultant by games companies to critique and help develop their world-building. If you listen to her talks, you’ll find that she has lots of anecdotes about games companies that have wanted to effectively re-write geopolitical history to appeal to certain market, and how she has had to negotiate the impacts and ethics of these kinds of decisions.

As a way of thinking about experience that is highly attuned to materialities, the body, society, culture, geopolitics, and increasingly digital technology, it’s evidence that geographical approaches are well-placed for thinking about the interconnected factors that shape how our experiences of game environments are enacted46.


Wednesday, 24 July 2019

Walking Simulators: An Introductory Workshop


Earlier this month at the Digital Geographies Research Group Annual Symposium, whose theme this year was ‘Geographies of Gaming and VR’, I ran a workshop introducing those attending the event to the group of video games known as ‘walking simulators’. This was an opportunity for the academics to try a type of game that they were less likely to be familiar with, making use of six PCs/consoles in the room with the games Dear Esther, Gone Home, The Stanley Parable, Everybody’s Gone to the Rapture, Firewatch and What Remains of Edith Finch installed. The workshop then prompted participants to think about what significance walking simulators might have when we think about the geographies of video games and digital media more broadly.

Overall, I was pleased with how those who attended engaged with the material I’d provided. It was my first experience running a workshop of this kind, and I’m now more conscious of the kinds of considerations I’d need to make when running a similar event in the future.

As expected for any workshop involving computer equipment, there were some technical hitches involving the hardware provided by the university hosting the symposium. In particular, I became aware just how important functioning sound equipment is for the experience of playing walking sims – e.g. listening to voice acting for communicating character, ambient sound for its atmospheric, transportative qualities, and music for emotion / mood / thematic cues. Earphones were provided by the university (admittedly not high-quality) but on a couple of the machines we were unable to get the sound to work properly at all.

Technical issues aside, however, I was happy with how the workshop gave participants an understanding of what these games are, how they are different from the AAA titles we so often see advertised and discussed publicly, what their evolution has meant for the video games medium, and why they offer some interesting vantage points for geographers thinking about games using geographical concepts, including (sense of) place, landscape, interfaces, post-phenomenology, and more.

Below is my presentation material. It starts with an 8-minute clip from a play-through of the game Everybody’s Gone to the Rapture, alongside the text and slides from my introduction to the workshop. This is followed by links to a list of popular walking simulator games and brief reading list that were provided as handouts on the day.

------------------------------------------



Walking simulators could be described as video games in which the gameplay is based on purposefully exploring the environments represented onscreen to experience their affective power, rather than their landscapes being backdrops to the gameplay. Often avoiding many mechanics typically associated with the video game medium, such as those involving skill in button-pushing, win and loss conditions, combat systems and player death, walking simulator games invite players to explore rich virtual environments as an end in itself – to be immersed into the affectively and emotionally impactful scenarios that are present in their worlds.


One of the immediate questions you might have, though, is ‘why are they called walking simulators’? Well, the term has actually been quite a controversial one. It began in online video gaming communities as a derogatory term, signalling that these types of games offered limited possibilities for player interaction, compared to games with complex mechanics that might require skill, dexterity or effort to master. The only mechanical input from the player seemed to involve moving between different points of interest in the environment and exploring what’s there, rather than having any observable agency in shaping the game world. Because of this, some have questioned whether walking sims can even really be considered ‘games’ at all.


Despite its negative connotations, however, the ‘walking simulator’ term has largely been reclaimed by those who make, support and enjoy these kinds of games. On Steam, the leading platform for PC gaming, you can browse games tagged as ‘walking simulators’ alongside those tagged as ‘action’, ‘adventure’, ‘horror’ and so on. As they’ve become easier to find, buy, discuss and share, whole communities of people have been built around games in the walking simulator ‘genre’. Even for those who dislike the label, use of the term has become so pervasive that it’s become almost universal in the games community.


Indeed, some would actually argue that the ‘walking simulator’ term is an appropriate one for understanding the kinds of experiences these games enable players to have. Games scholar Rosa Carbó-Mascarell, for example, has argued that walking simulators represent a digitisation of earlier Romantic and psychogeographical traditions of exploration, in which walking is said to induce a mindful connection with the spirit or sense of a place.


In drawing together the series of events you encounter as you slowly navigate through the world, the gameplay of walking simulators would also appear to enact well-established conceptions of walking as a narrativizing practice that draws situated events into sequences.   


It’s important to remember, though, that in nearly all cases these games involve more than just walking, particularly when you consider how players encounter information in the game world. In a paper published online earlier this year, Melissa Kagen describes the mechanic of ‘archival adventuring’ that’s used in many walking simulators, in which players piece together a version of events by navigating between carefully arranged materials in the game world, and forming their own interpretations of them. An archival perspective recognises how the player’s experience will necessarily be conditioned by how the information is organised by the game’s developers, the gaps that are intentionally left by designers for players to fill, and the game’s user interface, and not just how the player ‘walks’.


Before I finish, I want to briefly address the influence these games have had in both the games industry and wider sector of interactive digital media. What’s especially interesting is that the vast majority of these games have been made by indie games developers. Without the same costs as most AAA games in terms of animation, voice acting, and complex UI systems, it turns out that the types of game that often fall under the ‘walking simulator’ label can be relatively inexpensive to create. However, they’re still able to reach a wide audience through popular platforms such as the Steam store that sell content made by a broad range of developers.


Yet despite the limitations their developers have to work with, games tagged as walking simulators have been winning some of the biggest prizes in gaming. The wider industry has been forced to take note. Particularly for AAA titles that aspire to tell some kind of story, the bar’s been raised, as walking simulators have showed it’s possible to tell stories in a highly emotionally engaging way without resorting to cutscenes or series of objectives, which distance the player from the actual storytelling process.


As a result, in recent years relationships between mechanics and narrative have been at the forefront of game design thinking and discussion, and this has led to some highly innovative examples of interactive storytelling that work with the affordances of digital technology in newly compelling and meaningful ways.


------------------------------------------

Brief reading list introducing walking simulators and their possibilities/controversies.

List of suggested games labelled as 'walking simulators'.


Tuesday, 4 June 2019

Landscape Surgery: GeoHumanities Creative Commissions 2018

This post was originally published on the Landscape Surgery blog of the Social, Cultural and Historical Geography Research Group in the Department of Geography at Royal Holloway, University of London. Landscape Surgery is a fortnightly seminar series that the SCHG hosts during term-time. Sessions are typically organised around a theme for which speakers (including external invitees) talk about their research, followed by questions/general discussion on the topic; though it can also include workshops and research training sessions. I attend the sessions as part of my PhD activities, and am one of four editors of the Landscape Surgery blog.

The session discussed in this post featured the Royal Holloway Centre for the GeoHumanities Creative Commissions from 2018. I co-wrote and edited this piece with Alice Reynolds, another PhD student in the Department of Geography at RHUL.

--------------------------------

For the penultimate Landscape Surgery of the academic year, we were delighted to be joined by two guest speakers. Jol Thomson (PhD student at the University of Westminster) and Dr. Julian Brigstocke (Lecturer in Human Geography in the School of Geography and Planning at Cardiff University) joined us to discuss their work as part of Royal Holloway’s Centre for the GeoHumanities Creative Commissions, funded by the Leverhulme Trust and AHRC, and last year organised around the theme of ‘Creating Earth Futures’. Five works were selected for the 2018 programme, three of which we were introduced to in the session. Full details about all of the selected works are available on the Centre for the GeoHumanities’ blog.

First up to present was Jol Thomson discussing ‘In the Future Perfect’, the commissioned work he developed alongside Julian Weaver, an artist at Finetuned Ltd. Jol and Julian’s project seeks to interrogate the imaginaries and implications of scientific work operating in the realm of pataphysics: that which examines imaginary phenomena existing in a world beyond metaphysics; outside the basic principles of existence. In this regard, their work explores the discourses and materialities of nuclear fusion and its implications for energy provision and climate change.

Jol explained that the cultural imaginary around this branch of scientific experimentation and technological development has so far only existed in the future perfect, with fusion consistently projected over the past century to be ‘30 years away’ from being a viable power source. Decades of fusion experiments have faced continued difficulties in containing the reaction in a manner requiring less energy than the amount that can be extracted.

To develop their creative research, Jol and Julian sought to gain access to The Culham Centre for Fusion Energy, the UK’s national nuclear fusion research laboratory located in Oxfordshire, as well as visiting the ITER Centre in Marseille, an internationally-recognised experimental site for nuclear fusion. One of the most significant observations the pair have made during their research at both sites is the scale of infrastructure needed to make fusion reactions possible. Jol illustrated using maps and photographs how the UK’s Culham Centre is situated close to both a power station and solar field, and also draws on sources of energy from further afield to function. Meanwhile, it was explained by Jol that for fusion to be viable as a source of energy, research has shown that humans would need to mine off-world to recover the minerals needed to create adequate conditions for fusion to occur, which are rare to find on earth.

Even aside from these very practical limitations to the fusion process, Jol hypothesised what would happen if humans could harness the unlimited, self-sustaining energy that nuclear fusion promises. It has been projected that population levels could eventually become so high that our impacts as humans would become devastating to the earth’s ecosystem and ultimately be unsustainable, undermining the ‘green’ credentials of fusion as a method of energy production. In considering what the legacy of fusion energy could look like millennia into the future, Jol and Julian have been inspired by the film Into Eternity, which explores ideas about how a nuclear waste site in Finland could be marked as hazardous for future inhabitants of Earth, who are unlikely to communicate using the same languages we do today.

Both film and sound recording have been employed by the pair to interrogate the atmospheres and energies that permeate today’s nuclear fusion testing sites. In the session, Jol played sound files that audibly represented what takes place inside a tokamak test reactor, where a magnetic field confines the heated plasma used in nuclear fusion experiments, suggesting that him and Julian could eventually score this sonic output for a choir as a performative piece. Through the process of transforming these scientific operations into visual and sonic outputs, their work demonstrates both the elusive and ethereal qualities of current fusion experiments, and the level of imagination necessary to make nuclear fusion as a power source a tangible reality.

Following Jol, Dr. Julian Brigstocke gave a presentation titled ‘Thinking in Suspension: The Geoaesthetics of Sand’. His presentation introduced his collaborative project ‘Harena’, which he works on alongside Victoria Jones, an installation artist exploring the ways humans use their senses to connect with and create a sense of place. Their creative collaboration investigates the contemporary politics of sand mining through a series of experiments with the material properties and cultural experiences of sand.

For Julian, sand is both a vital substance and display of power. It connects the elemental to the global; marks time, decay and death; and as the primary component of concrete, cement, glass, fibreglass, asphalt, microchips and more, is the most important constituent material of our urban landscapes. Despite being a finite natural resource which takes centuries to form, it is the world’s most consumed resource after air and water, and humans are using it at accelerating rates, particularly in construction (Morrow, 2018). In 2014, the UN Environmental Program declared that sand mining was causing “unequivocal” environmental problems (ibid).

In this regard, Julian made particular reference to Hong Kong, where sand extracted from seabeds has provided the material for land reclamation, at the cost of catastrophic damage to marine ecosystems. While land reclamation projects appear to promise a quick fix to endemic housing shortages in one of the world’s most densely populated urban areas, political debates rage around how far these projects go towards reducing Hong Kong’s vast inequalities in wealth; where the sand itself comes from; why existing brownfield sites are not used instead; and government collusion with private property owners and developers.

As well as carrying out fieldwork in Hong Kong and visiting sand mines in the UK, Julian and Victoria’s work has delved into the sensual and material properties of sand through a series of ‘experiments’ that explore its qualities of suspension. Julian recounted his unsettling experience of a sensory deprivation tank, where participants lie face up on a pool of water warmed to body temperature and containing a high proportion of salt in suspension, enabling them to lose all sense of the body’s external boundaries. Elsewhere, him and Victoria visited an anechoic chamber, which prevents users from hearing anything inside it, as an exploration of the silence that suspension in air entails; while indoor skydiving allowed them to perceive how tiny adjustments in bodily weight can cause significant directional movements when bodies are suspended in air. In thinking about these processes of attunement with various environmental and atmospheric conditions – of drifting, disorientation and movement across earth, water and air – Julian was reminded of a quotation from Michel Serres (1982: 83): “nothing distinguishes me ontologically from a crystal”.

Julian ended his presentation with a provocation central to the joint political and cultural territory of his and Victoria’s project. He asked: how might the granular thinking necessary to understand the properties of sand pollute the contemporary noisy landscapes of consumerism, for example in the concrete, glass and asphalt landscapes of Hong Kong?

To conclude the session, we were presented with a film by Matterlurgy (Helena Hunter and Mark Peter Wright) made in collaboration with filmmaker Daniel Beck, entitled ‘Rehearsals for Uncertain Futures’. Featuring Royal Holloway’s Department of Geology’s Sea Ice Simulator (SIS), used in climate science to predict and model the impact of black carbon on ice reflectivity, the film emphasises the create commission project’s broader emphasis on noticing (Tsing, 2015). Focusing on the polyphonic dimensions of environmental processes and methods of observing them, “[s]uch an inquiry finds its roots through interleaved theories of listening […] and the practices of performance and fictioning. It considers the vibratory, affective and speculative forms of agency bound within the technologies and practices produced by GEC [Global Environmental Change]” (Hall, 2018).

Heavily featuring the work and daily practices of Professor Martin King (Professor in Environmental Geoscience in the Department of Earth Sciences at RHUL), the film never once features Professor King’s full body or face, but instead focuses on the materiality of the shipping containers situated in the woodland where the SIS is stored, the bird song in the background and the diverse sounds produced by the SIS machinery.

“The film focuses on the interconnections between the lab and field amplifying physical and material production practices behind climate simulation and predictive data modelling. How does data become data, where exactly is the field, what practices of maintenance and care does simulation require?” (Helena Hunter, no date).

The film is just one part of a broader project which seeks to produce a series of artworks which “challenge and re-imagine how GEC is both sensed and non sensed, signalled and signed, heard and unheard” (Hall, 2018).

We would like to extend our thanks to Jol and Julian for joining us in the session, and to Helena and Mark for allowing us to view their film. We look forward to seeing how the projects develop.


Bibiography

Hall, L. (2018) Matterlurgy selected for the Creating Earth Futures Commissions. Available at: https://www.crisap.org/2018/01/22/matterlurgy-creating-earth-futures-commissions-2018/ (Accessed: 14 May 2019)

Hunter, H. (no date) Rehearsals for Uncertain Futures. Available at: http://www.helenahunter.net/rehearsals-for-uncertain-futures (Accessed: 27 May 2019)

Morrow, S. (2018) 20 Things You Didn’t Know About… Sand. Available at: http://discovermagazine.com/2018/jun/20-things-you-didnt-know-about–sand (Accessed: 27 May 2019)

Serres, M. (1982) Hermes: Literature, Science, Philosophy. Baltimore, MD: The John Hopkins University Press.

Tsing, A. (2015) The mushroom at the end of the world: On the possibility of life in capitalist ruins. Princeton: Princeton University Press.