Soundscapes in Our Hands

MSc Thesis:

Designing an Interactive Tool for Non-Experts to Shape a Virtual Soundscape

I built an interactive soundscape in Unity where users can explore a virtual grocery store and shape the audio in real time using a MIDI controller. This project is a real-time audio prototype that lets users both experience and modify a complex sound environment.

The system combines:

  • First-person navigation in a virtual space

  • Adaptive audio implemented in FMOD

  • Physical interaction through a MIDI controller

The goal was to make sound design more intuitive, interactive, and explorable, especially for non-audio specialists.

Key Features

  • Real-time audio control: Users can adjust multiple sound layers live using a MIDI controllerUsers can adjust multiple sound layers live using a MIDI controller

  • Spatial sound design: Environment built using ambisonic recordings for immersion

  • Interactive mixing system: Sound elements respond dynamically to user input

  • First-person exploration: Users move through the space while shaping the soundscape

What I did

  • Built the application in Unity (C#)

  • Implemented adaptive audio systems in FMOD

  • Designed and mixed the full soundscape

  • Recorded and edited ambisonic audio (Reaper)

  • Mapped MIDI input to audio parameters (e.g. filtering, levels, transitions)

  • Designed interaction logic for real-time sound manipulation

Process

  • Conducted field recordings and soundwalks in grocery stores

  • Analyzed how real-world soundscapes are structured and experienced

  • Ran a co-design workshop to explore how users describe soundscapes

  • Iterated on sound design and interaction mapping

  • Designed and conducted a user study

Outcome

  • Users were able to intuitively explore and manipulate the soundscape

  • The system supported reflection on how audio affects experience

  • User testing showed strong usability and engagement

Developed as my Master’s thesis at KTH, as part of a research project on soundscapes in retail environments.

Click HERE to read my thesis.