Thesis report: Poetry & VR

Screenshot 2019-12-20 at 15.31.44

Screenshot 2019-12-20 at 15.31.54

Did you just read the first two sentences? Was it hard? I manipulated them by using different fonts and font sizes, which can affect the way our brain deals with this cognitive task. Cognitive scientists refer to fluency and disfluency in this respect, to indicate how easy (fluent) or difficult (disfluent) it is to process a cognitive task. My name is Nancy Coster, and for my NMD master’s thesis, I studied the effect of Virtual Reality (VR) on fluency and poetry appreciation.

Fluency theory and previous research suggests that we like easy-to-process stimuli better than stimuli that are difficult to process. Such stimuli can be all sorts of things such as faces, texts, or images. Thus, fluency comes in all shapes and sizes. In my master’s thesis, I focused on both perceptual fluency (e.g. visual/structural aspects of stimuli) and conceptual fluency (e.g. the meaning of stimuli).

IMG-20190610-WA0001Although appreciation of poetry has been studied before, VR is a relatively new medium in this type of research. It is an interesting research medium in poetry research as poets are exploring new ways to showcase their work. Today, poetry is not only consumed by reading a poem printed in a book, but you can attend poetry slams, listen to poets, or hear a poem and simultaneously experience visual effects in a multimedia environment. VR offers interesting new ways to experience poetry. For instance, VR could make difficult poems easier either to understand by enhancing the perceptual characteristics or visualizing what the poem is about.

In my experiment, participants experienced poems in either a VR environment or an audio environment. In the VR environment, poems were manipulated in two ways. In the perceptual manipulation, the participants would see a color that would emphasize the structure or rhyme within the poem. In the conceptual manipulation, participants would see the poem depicted. Afterwards they would rate their general appreciation of the poem, as well as its flow, structure, topic clarity, and difficulty.

IMG-20190619-WA0015Thanks in part to several newspapers picking up on my research, I was able to conduct my experiment with 800 participants. The results showed that participants generally appreciated easy stimuli better than difficult stimuli. Interestingly, the results showed that participants preferred audio poems over VR poems. Several participants mentioned that this experiment was their first VR experience however, which could have affected these results. I also found an interaction effect for topic clarity in the conceptual poem manipulation; ratings for the easy poem were higher in the audio condition, whereas ratings for the difficult poem were higher in the VR condition. So VR seems to support experiencing a difficult conceptual poem and resulted in a higher rating on topic clarity.

The interaction effect I found for topic clarity in a difficult poem experienced in VR is very promising for future poetry applications. Just imagine: making difficult poetry easier for students when experiencing it in VR could perhaps help in a learning environment. Also, it could positively affect understanding and appreciation of poetry. And if Virtual Reality can be applied to the field of poetry, perhaps it could help in making other types of difficult content easier to understand as well.

Nancy Coster

Under construction: the Media Design Lab

Early 2020 the Media Design Lab will be opened. Currently, the lab is being built and we are busy selecting hardware, software and decoration. Here’s a sneak peak of (a selection of) the color palette. We promise it will be a colourful and awesome design space. Please find a description of the lab below the image.

20191026_152710

The Media Design Lab is tied to the research and teaching of our New Media Design program at Tilburg University. New media innovations shape our everyday lives, ranging from well-established media like websites and (smartphone) apps /eHealth to social robots, tangible interfaces, physiological interfaces and virtual and augmented reality. The lab enables researchers, designers, teachers, and students to do research and teach in a creative and innovative setting. With this we aim to (i) contribute to (and go beyond) the existing understanding of the usability and user experience (UX) of new media products, and (ii) use and develop methods and tools that are used by researchers and designers while actively engaging users in the design process of new media products, and (iii) test the impact of new media products on scientifically relevant outcomes like persuasion, behavior change and learning.

The Media Design Lab facilitates the different phases of the design and research process:

● Contextual analysis: Understanding the users’ needs and requirements
● Ideation & conceptualisation: Concept development and planning
● Iterative development: Prototyping and making
● Evaluation: Testing (e.g., sensing, tracking, observing) user-media and user-media-user interactions in individual and group settings

A sneak peak of the facilities that we will have in the lab can be found below:
Sublabs:
VR lab
Observation room
Living room lab
Sound-isolated individual cubicle
Flexible creative design space
FABLAB

Hardware:
Motion capture
Activity tracker
Virtual reality (HTC Vive Pro Eye)
Leap motion
Augmented reality (Hololens)
Mobile VR
Eye-tracking
functional EMG
skin conductance
EEG
3D printer
Materials and tools for paper, coded prototypes

NMD @ DDW

This week is the Dutch Design Week, the biggest design event in Northern Europe.

Nynke van der Laan (associate professor) of the New Media Design lecturer team, gave a talk at the Design Research and Innovation Festival, which is part of the scientific program of the Dutch Design week. She gave a talk about the potential of virtual reality as a scientific measurement tool and as an intervention tool to change eating behavior. The event was well attended by representatives from creative companies, knowledge institutions and (local) governments.
DriveFestival

Congratulations to our NMD graduates!

IMG_20190925_110718Last week, 23 NMD students received their master’s degrees! We are very proud of the diverse and relevant research that these students have carried out for their masters’ theses.

Just to name a few research topics that were presented during the graduation ceremonies: the effects of robot gestures on children’s learning engagement, the role of intuition in the creative design process, 3D printing for occupational therapists, establishing understanding of complex issues by means of interactive narratives, and the effect of feedback on intrinsic motivation in virtual reality games.

Congratulations to all NMD masters! We are looking forward to following your careers in the NMD field!

3D printing for occupational therapy – a master’s thesis

Occupational therapists (ergotherapeuten in Dutch) are health professionals who help people with physical or mental health problems to participate in the things they want and need to do in everyday life. For instance, they help their clients to find suitable assistive devices to perform activities of daily living, like customized cooking utensils, pen/pencil grips, or hand/grab rails to get out of bed.

In the past, occupational therapists were trained to make such assistive devices themselves. Nowadays, however, most assistive devices are selected from manufacturers’ catalogs. Unfortunately, such off-the-shelf assistive devices are very generic, and options to foto blog 3dprintcustomize these devices to an individual client are limited. This is where 3D printing comes in. What if occupational therapists would have a 3D printer at their disposal? This may allow them to make their own assistive devices again, and to realise tailor-made solutions for their clients.

This was the starting point for the master’s thesis research of NMD student Tereza Loučová. Her aim was to study occupational therapists’ willingness to adopt 3D printing technology. More specifically, she studied how hands-on experience with an important aspect of 3D printing, 3D modelling, affects occupational therapists’ attitudes.

In her thesis project, Tereza was very lucky to get in touch with a Kaatsheuvel-based company CADdesign CAD trainingen. The CEO of this company, Harold Weistra, is an avid proponent of the pay-it-forward principle. As he was helped by many people in establishing his own company, he was actively looking for societally relevant projects that he could help. He offered to help Tereza by organizing a full-day workshop in 3D modelling to a group of occupational therapists free of charge! This allowed Tereza to assess and compare the therapists’ attitudes towards 3D printing both before and after the workshop. The occupational therapists, in turn, were able to experience hands-on what it is like to design their own 3D printable assistive devices.

3d ergo combi

Tereza’s research showed that after participating in the workshop occupational therapists had more positive perceptions of the usefulness of 3D printing, especially due to the possibilities this technology offers for customizing assistive devices. However, hands-on experience with creating 3D models also made occupational therapists aware of the fact that learning to use 3D printing technology requires even more time and effort on their behalf than they initially expected. As such, they developed a preference to set up collaborations with 3D printing experts rather than to engage in 3D printing on their own.

We are very grateful for Harold’s offer and think this is a wonderful example of a valuable collaboration between design research and design practice!

Interactive story “A Father’s Rights”

In the Master course Interactive Storytelling, taught by Renske van Enschot, our students learn all about what interactive stories entail, how these stories are experienced, and how they can be used strategically, for instance for learning and behavior change. As a group assignment, the students create their own interactive journalistic story. The story below is a wonderful example of the stories created by the students in the fall semester of 2018. Arold, Carmen, Laura and Wesley designed and developed the story called “A Father’s Rights”, which raises awareness of the sensitive and difficult topic of unwanted pregnancy and abortion by inviting the reader to explore the perspectives of all parties involved.

Please click the image to experience A Father’s Rights yourself!


Screenshot 2019-06-17 at 13.55.09