Augmented Reality – Vital North Partnership

Magical reality: digitally augmenting David Almond’s archive

How can cultural organisations collaboratively develop immersive digital experiences? And how can ideas about space and place in magical realism inform more creative approaches to designing augmented reality technologies?

In this blog post, find out about the Magical Reality project and app, available to download on Google Play (Android) and App Store (iPhone), how Newcastle University and Seven Stories: The National Centre for Children’s Books worked with children, young people and digital designers to develop it, and what we’re doing next…

Many organisations in the cultural sector recognise that expanding digital capacity is a priority, but they are limited by funding, time and staff expertise to support this. The #CultureIsDigital 2018 report advocates for design-orientated digital thinking ‘to unleash the creative potential of technology’ and collaborating with technology partners is often seen as a solution for a lack of in-house resources.

But what types of approaches and models can support this kind of thinking? This was a question posted by the Arts and Humanities Research Council (AHRC) and the Engineering and Physical Sciences Research Council (EPSRC). Through their Research and Partnership Development Call for the Next Generation of Immersive Experiences, they wanted to explore how arts and humanities knowledge could inform the development of new immersive technologies, and how this might inform the work of cultural organisations.

Dr Tom Schofield at Newcastle University’s Culture Lab, Professor Kim Reynolds in the School of English Literature, Language and Linguistics and Seven Stories successfully applied for a seven-month research project responding to this call, Children’s Magical Realism for New Spatial Interactions: AR and Archives.

Dr Tom Schofield leads an event in the Ouseburn Valley as part of the Being Human Festival 2018. Image: Newcastle University

In late 2017, Google and Apple had released new augmented reality features that allowed much more complicated interactions with real space on mobile phones. We wanted to explore whether magical realism, a literary genre that plays with the boundaries between real and imaginary spaces, could inspire new creative approaches to these new technical developments.

Seven Stories had recently acquired David Almond’s literary archive. An award-winning author of children’s and young adult books, David’s work explores ambiguous and confusing crossovers between worlds; past and present, everyday and mythical. We used this as our starting point to explore how researchers, museum professionals, digital designers, children and young people could inform new kinds of spatial interactions for AR. We wanted to experiment with a sustainable and collaborative approach to digital R&D in the context of cultural organisations.

From June to December 2018, Tom and Kim worked with Diego Trujillo Pisanty, a researcher and media artist, and Seven Stories. We led six creative workshops, some as part of the 2018 Great Exhibition of the North programme, engaging around 80 participants. During the Great Exhibition, Seven Stories delivered an artistic trail around the Ouseburn Valley featuring new writing by David Almond, and a major exhibition, ‘Where Your Wings Were’ focusing on his archive.

Families explore the Magical Reality app in the Ouseburn Valley, Newcastle. Image: Newcastle University

In the workshops, we wanted to create open environments where people could explore experimental ideas. Each workshop had a separate focus, but aimed to explore creative analogies to immersive technology – ideas of other worlds, magic, the fantastic and interdimensional – to inform the design of the app, and enhance our understanding of the value of spaces and places within David Almond’s work.

From the creative ideas generated in the workshops, we designed and built a smartphone app, Magical Reality, which leads you on a trail to find AR objects around the Ouseburn Valley, Newcastle. Research Associate Diego led the technical development and it’s now available on Android and iOS platforms. The app uses AR technology to embed digital artefacts, developed from archive materials held at Seven Stories. We used an experimental and collaborative design approach to see how the knowledge and imaginative ideas of the different parties involved in the project could inform the development.

Here’s a video of the app in action:

There were many interesting things we learnt from evaluating this project, which was supported by Research Associate Dr Gabi Arrigoni; not least that the stakeholders involved consider innovation very differently. For the research team, the creative process informing the app was seen as the most significant contribution to the field; Seven Stories valued new ways of engaging with their audiences and connecting archive material to places; whereas digital professionals were interested in digital innovation around the app’s use of AR.

As Vital North Partnership Manager, one of the things I found most fascinating was seeing different kinds of knowledge and experience being brought together through the four workshops I took part in, and the way in which the research team created open spaces for knowledge exchange. I also really valued the way that this project moved beyond transactional digital commissioning and towards more experimental and open-ended R&D within a museum setting, which mirrors some of the processes Seven Stories uses as we develop our programmes and exhibitions.

You can read more about the workshops, the evaluation and the avenues for future research we identified in our report, Not Just Digital Knowledge: Collaboratively Developing Immersive Experiences in Cultural Organisations.

Since we finished our work on Children’s Magical Realism for New Spatial Interactions: AR and Archives in December, we’ve been busy! Firstly, Dr Tom Schofield and Professor Kim Reynolds have been busy working on academic outputs. Kim has given a paper on ‘Augmenting Almond’ at the University of Western Australia, and will be presenting this project in June in Berlin, and October at the University of Buckingham. Tom will be presenting a paper as part of Designing Interactive Systems 2019 in June in San Diego – as one of the most prestigious conferences for interaction design in the world, we’re very excited!

Secondly, Tom and Seven Stories were successful in a bid for AHRC Follow on Funding for an extension project, Embedding Magic: AR and Outreach. This will extend the work we began our original workshops by developing these into a programme that Seven Stories’ Creative Learning and Engagement team will be delivering with Research Associate Dr Miranda Iossifidis in the East End of Newcastle, empowering children and young people to connect with the places and spaces within their community. We’re also planning a short series of workshops for cultural and digital organisations to present this collaborative process in early summer. Watch this space!

To explore the Magical Reality app, visit Google Play or the App Store and for more information about our Magical Reality project, visit the Digital Cultures in Culture Lab website.

From the Source to the Sea: Being Human Festival 2018

This November, Newcastle University and Seven Stories: The National Centre for Children’s Books are busy preparing for an amazing programme of free events as part of the Being Human Festival 2018. Find out more in this blog post…

Two years ago, we dipped our toes in the waters of the Being Human Festival, a national festival of the humanities. And this year, Newcastle University’s Humanities Research Institute is one of the national festival hubs! So, I’m currently immersed in planning five events in partnership with Seven Stories… all inspired by our hub’s theme, From the Source to the Sea!

On Saturday 17th November, there are two opportunities for all the family to explore the rivers, seas and oceans in the Seven Stories Collection in a special hands-on experience, Once Upon a Tyne. Led by staff and research postgraduates from Newcastle University’s Children’s Literature Unit and the Seven Stories Collection team, see original manuscripts by Robert Westall, and illustrations by Judith Kerr and Polly Dunbar…

David Almond's notebooks, on display in the Where Your Wings Were exhibition. Image: Seven Stories, The National Centre for Children's Books — David Almond’s notebooks, on display in the Where Your Wings Were exhibition. Image: Seven Stories, The National Centre for Children’s Books

Later that afternoon, join author and Lecturer in Creative Writing, Ann Coburn, for our creative writing workshop for adults, Undiscovered Land: Write Like David Almond. Start your own story incorporating elements of memory, history, magic and transformation. I can’t wait to see what our writers come up with!

On Sunday 18th November, come and take part in our Wavering Boundaries walking tour, led by Dr Tom Schofield from Digital Cultures in Culture Lab. Magical realism, augmented reality and literary archives come together in this guided walk around the Ouseburn Valley, and you’ll be one of the very first to try out our Magical Reality app.

“My work explores the frontier between rationalism and superstition and the wavering boundary between the two.” David Almond

Dr Tom Schofield leads a guided tour. Image: Newcastle University

And, if you want to find out more about David Almond’s stories of the North East, come to Dr Lucy Pearson’s Tales of the Tyne talk and tour of the Seven Stories Where Your Wings Were exhibition later that afternoon!

Seven Stories are also supporting Newcastle University’s final festival event, Songs from the Dam, with Kathryn Tickell, David Almond and Amy Thatcher. This special musical performance will present local songs and folk tales, and celebrates David Almond’s new book The Dam, beautifully illustrated by Levi Pinfold, which tells the story of the flooding of Kielder Water.

Amy Thatcher, David Almond and Kathryn Tickell will perform as part of the festival. Photograph by Georgia Claire

And that’s not all: there are lots of other fascinating events as part of Newcastle University’s Being Human Festival hub – from foodbank histories, to quantum tunnelling… and from the source to the sea!

Being Human is the UK’s only national festival of the humanities and took place this year between 15^th – 24^th November 2018. The festival is led by the School of Advanced Study, University of London, in partnership with the Arts and Humanities Research Council and the British Academy. Visit the Humanities Research Institute website for full details of Newcastle University’s events and to book: www.ncl.ac.uk/nuhri/events

Northern Bridge and Ecologies of Knowledge

Seven Stories: The National Centre for Children’s Books is a strategic partner to the Northern Bridge Doctoral Training Partnership, funded by the Arts and Humanities Research Council. In May, I joined staff from Newcastle University, Durham University and Queen’s University Belfast, as well as colleagues from Northern Bridge’s strategic partners, for Ecologies of Knowledge, a seminar held at the Public Record Office of Northern Ireland in Belfast.

The seminar was suggested by Sage Gateshead’s Dave Camlin. It gave us the chance to reflect on our time working together on Northern Bridge so far, and “to explore some of the tensions and opportunities inherent in collaborative approaches to the generation of new knowledge.”

Newcastle University's Professor Mike Rossington addresses the Northern Bridge Ecologies of Knowledge seminar. Image courtesy of the Public Record Office of Northern Ireland. — Newcastle University’s Professor Mike Rossington addresses the Northern Bridge Ecologies of Knowledge seminar. Image courtesy of the Public Record Office of Northern Ireland.

Of course, there are tensions; when you bring together any group of academic institutions, or cultural organisations, there is competition – for students, for audiences, for funding. And although learning is at the heart of what both universities and cultural venues do, the processes through which we generate knowledge are quite different. We speak different languages. We have different drivers. Working in collaboration requires negotiating all of these factors.

Another tension which formed a focus of conversation during the day was the inequality of engagement with the arts. The Warwick Commission’s Enriching Britain, Culture, Creative and Growth Report states that “the wealthiest, better educated and least ethnically diverse 8% of the population forms the most culturally active segment of all”. How to reach those beyond that 8% is certainly a challenge.

But democratising culture and knowledge is becoming increasingly important in both the higher education and cultural sectors. The Research Excellence Framework emphasises the impact of research ‘beyond academia’; Arts Council England encourages the organisations they fund to reach more demographically diverse audiences.

Dave Camlin (Sage Gateshead) opens the seminar. Image courtesy of the Public Record Office of Northern Ireland.

From my experience of working on the Vital North Partnership between Newcastle University and Seven Stories, collaboration holds exciting opportunities. Partnership helps to make our activities more interesting and diverse. At the intersections between universities, cultural organisations and communities, we can draw on our collective expertise to create new kinds of shared knowledge. And with increasing pressure on arts budgets, we can pool our resources and become more efficient.

I explored the Vital North Partnership’s unique ecology at the seminar, giving a Pecha Kucha presentation:

It was also interesting to reflect on what role Northern Bridge, as a Doctoral Training Partnership, has as part of our shared ecology. I think the ways in which universities and arts organisations collaborate is changing. We are asking different questions, and having new conversations. I work at this boundary – and I’m interested to see where we’re headed next.

For more information about the Northern Bridge Doctoral Training Consortium, visit: http://www.northernbridge.ac.uk/

The Vital North Partnership Pecha Kucha

New year, new blog post. And for my first post of 2017, I thought I’d bring you something a little different – a video! Here it is:

The Vital North Partnership (+19 other ways Newcastle University and Seven Stories are collaborating)

In 2016, I presented this Pecha Kucha about the Vital North Partnership between Newcastle University and Seven Stories: The National Centre for Children’s Books at two events; the Arts and Humanities Research Council’s Common Ground event in June, and Newcastle University’s Working Together: Bringing About Change event in November. Both events explored collaborations and engagement in the humanities.

Pecha Kuchas are short, visual presentations. As you talk, you show 20 images, each for 20 seconds. Your slides change automatically. And they’re more than a little tricky to deliver…

The Vital North Partnership (+ 19 other ways Newcastle University and Seven Stories are collaborating) is exactly what the title suggests: a presentation about 20 current Partnership projects. And what are those projects? Well, watch the video and find out!

With thanks to Jeff Wilson from the School of English Literature, Language and Linguistics, who produced this video.

The Catherine Storr Experience: From Collection to Cardboard

This digital age of ours poses a challenge to both museums and higher education. How can museums present physical collections digitally? And how can academic research into these collections engage the Google Cardboard generation?

The Catherine Storr Experience, a new augmented reality exhibition based on the work of author Catherine Storr, launched by Newcastle University and Seven Stories: the National Centre for Children’s Books, attempts to meet that challenge.

The content for the experience was provided by Kim Reynolds, Professor of Children’s Literature in the School of English Literature, Language and Linguistics. Kim wanted to produce a digital exhibition based on her research into Seven Stories’ Catherine Storr archive. Discussing this with the Seven Stories Collections Team, it quickly became apparent that Kim’s ambitions for the project were to do something really new.

So I put Kim in touch with Dr Tom Schofield in Digital Cultures in Culture Lab at Newcastle University to see if they could help. Tom worked with developer Dan Foster Smith, Seven Stories’ Archivist Kris McKie, and Kim to put The Catherine Storr Experience together.

The Mirror Image Ghost. Image: Newcastle University

The result? The Catherine Storr Experience explores the unsettling novel of Storr’s Marianne Dreams (1958), and the house that Marianne draws. Using the context of Marianne’s room, the augmented reality experience introduces a number of Storr’s books and illustrators, as well as some aspects of her life. The experience allows you to explore different objects, characters and settings by moving your smartphone or cursor.

It uses the very latest in WebVR technology. I haven’t seen anything like this yet in digital collections, so I asked Dan about the technological innovation:

“This is new and experimental technology, which is on the edge of a breakthrough into the mainstream. It has the ability to take information that has traditionally been displayed in a flat, 2D way and literally add another dimension to it!

Websites have the great advantage of allowing the viewer to navigate the information at their own pace. Video and TV captivate and engage the viewer. This sort of experience combines the best of both; I like to think of it as a guided tour with the ability for you to ‘ask’ questions along the way.”

Inside the house of Marianne Dreams. Image: Newcastle University

Throughout The Catherine Storr Experience you can spot illustrations, photographs and other items from the Seven Stories Collection. Some of the materials included in the experience also relate to Storr’s personal life and were kindly loaned by her family, extending the Seven Stories material. The project has also enabled Seven Stories to digitise all of their Storr holdings so this is available to readers and researchers around the world.

From Seven Stories’ perspective, Kris commented that this partnership had brought a new dimension to their digital collections:

“It was interesting to see how a group of talented people from outside the museums and heritage sector were able to respond to the challenge of representing an archive in a new way; Kim was able to bring her expertise to write the content, and Dan and Tom were able to envision a unique platform to present it. It will be intriguing to see what people make of The Catherine Storr Experience and the additional content on our website.”

'Marianne draws a house, and the house is Marianne.' Image: Newcastle University — ‘Marianne draws a house, and the house is Marianne.’ Image: Newcastle University

And I’ll leave it to Kim to have the final word:

“Working with colleagues in Culture Lab and Seven Stories made it possible to experiment with new ways of presenting archival mterial and reaching out to audiences all over the world. It required new ways of writing, and Dan and Tom approached the task in adventurous ways that re-engaged me with the material. It was an exciting and challenging – in the best possible ways – collaboration.”

http://digitalcultures.ncl.ac.uk/Catherine-Storr/