Archives: 15th May 2023

AIM students to join the Alan Turing Institute in 2023/24

Two AIM PhD students have been given enrichment awards by the Alan Turing Institute, the UK’s national institute in artificial intelligence and data science, enabling them to join and interact with institute researchers and its community in the 2023/24 academic year.

Specifically, AIM PhD student Teresa Pelinski has been offered an Enrichment Placement Award for the project “Sensor mesh as performance interface” and AIM PhD student Shubhr Singh has been offered an Enrichment Placement Award for the project “Deep learning with graphs for multivariate time series data”.

Congratulations to both!


HiTAR bags third prize at 25th Guthman Musical Instrument Competition

AIM student Andrea Martelloni won third prize at the 25th Guthman Musical Instrument Competition held at Georgia Tech, Atlanta on 11th March 2023!

Andrea presented the HITar, an augmented guitar supporting percussive playing with the help of a DNN gesture classifier and physical modelling synthesis provided by PRISM Labs’s MetaSynth. The project was supervised by Dr Mathieu Barthet and Prof Andrew McPherson. The HiTAR is an augmented instrument that uses an acoustic guitar as its base and has embedded sensors to capture a performer’s gestures and hits. The body of the guitar and the captured gestures of the player are connected using machine learning, and the sound from striking the body is transformed to resemble sounds on different surfaces like metal or glass. This allows the performer to organically explore additional gestures and sounds to accompany the traditional guitar performance.

Also present at the competition finals was C4DM’s Lia Mice with her Chaos Bells, a large instrument she designed with Andrew McPherson during her Media and Arts Technology PhD.

The Guthman Musical Instrument Competition was initially designed to identify the next generation of musical instrumentalists, It has turned into one of the only competitions and events dedicated to identifying next-generation musical instruments and the best new ideas in musicality, design, and engineering. It is hosted by the School of Music at Georgia Tech, Atlanta-USA. This year’s Guthman Musical Instrument Competition featured nine finalists from six countries and the result is an event that exposes new technologies and novel ideas to a community of musicians who are natural experimenters.

You can see the video presentation of the HITar here, and you can watch the public performance of all the contestants on Georgia Tech’s YouTube channel.


Exploring Reflection in Creative Experiences

Author: Corey John Ford

Reflection is crucial in any creative practice – as you experiment with your materials, each tweak will pose a question. Has this improved my work? Does this meet my artistic intentions? What might others think of this decision? For instance, a composer will continually adjust notes until they decide on their final melodies. An author will ponder over individual sentences. A dancer will refine and select their movements when creating a dance routine. In this blog post, I will describe how reflection can be characterised in creative user experiences, based on my upcoming research paper1 to be presented at ACM CHI 2023 – the top conference in the field of Human-Computer Interaction! CHI brings together researchers and practitioners from various disciplines to explore the latest advances in human-computer interaction, and I’m excited to share my findings with this community. Whether you’re working in the music industry, academia, or any other creative field, this research paper will help you to gain deeper insights into the reflective processes driving innovation and creativity.

In my PhD research, I am exploring the role of reflection in creative experiences, with a particular focus on the use of music software that incorporates generative AI. These types of systems have been in the news lately, for example, ChatGPT demonstrating the potential of AI to generate novel and creative output. My goal is to investigate whether the use of such software can support and enhance reflection in music creation, and if so, what types of reflection are most effective. In this way, my research follows a human-centred approach towards designing an AI tool which amplifies, augments and enhances human creativity rather than trying to automate it2.

Studying reflection in people’s use of music software is a challenging task requiring research with human participants and necessitating careful research design. If you ask people the wrong questions, you may get misleading results that do not accurately reflect their true reflective processes. Also, open-ended questions do not provide a quantifiable measure of reflection, making it difficult to compare results across different studies or to make recommendations to research teams or businesses on how to design more reflective systems.

I realised that there was no existing questionnaire that could effectively measure reflection in creative experiences. This gap in the literature inspired me to develop the Reflection in Creative Experience Questionnaire (RiCE). As people use technology to be creative, RiCE helps us to identify reflection in their creative user experiences. With RiCE, I hope to support not only my own research on AI and Music, but also that of other creative technology researchers looking to support reflection in the creative process. 

After consulting with experts on creativity (including AIM PhD students), crowdsourcing feedback from 300+ users of creative tools, and conducting statistical analysis of this data, RiCE includes questions for four types of reflection which might occur in creative practice:

  • Reflection on Current Process. Do people reflect on their creative process? RiCE asks users: i) “Whilst being creative, I liked to think about my actions to find alternative ways of doing them”; and ii) “I often re-examined things I’d already learnt”.
  • Reflection on Self. Do people reflect on themselves and their personal experience? RiCE asks users: i) “I learned many new things about myself during the experience”; and ii) “I pondered over the meaning of what I was doing in relation to my personal experiences.”
  • Reflection on Past Experience. Do people look back on their past experiences: RiCE asks users: i) “I explored my past experiences as a way of understanding new ideas”; and ii) “Whilst creating, I thought back on some of my past experiences.”
  • Reflection through Experimentation. Do people reflect on ideas tested when using technology? RiCE asks users: i) “I made comparisons within the system to consider alternative ways of doing things”; and ii) “I often generated, tested and revised ideas.”

Figure 1: The types of reflection which might occur in creative practice.

RiCE might be a valuable tool as it can help to identify reflection in creative user experiences and support the design of reflective tools. This could benefit people interested in studying creative user experiences, designing creative user experiences, and even in designing AI systems which support reflection. If you’re interested in testing RiCE in your own work, please don’t hesitate to contact me at c.j.ford@qmul.ac.uk. It’d be fantastic to collaborate with other researchers and explore new avenues for studying reflection in creative experiences.

1 = Corey Ford and Nick Bryan-Kinns. 2023. Towards a Refection in Creative Experience Questionnaire. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM, New York, NY, USA, 16 pages. https://doi.org/10.1145/ 3544548.3581077. Pre-print: https://qmro.qmul.ac.uk/xmlui/handle/123456789/84900

2 = Ben Shneiderman. 2022. Human-Centered AI. Oxford University Press, UK.