Container · 2 items
Audio Development: My Story
The first movement of Song Without Words plays around with captioning and a couple levels of sound perception. For example, there’s a voiceover of me reading my story, but that voiceover weaves in and out with a recording of this Piano Scribe app that transforms that same voiceover into pitches on a piano. So you're hearing the pitches, but you cannot understand because there's just not enough information to pull words out of it. I used to get asked so many times when I put on a hearing aid, “Well, you put on your hearing aid—why couldn't you understand me?” It is not that simple. Maybe people have this idea that you just flip on a hearing aid and it's like a caption; you turn on the caption and I get it. So I thought of captions. I took the captions of my voiceover, but I fuzzified and degraded the text to correlate that idea of you are seeing it, but that doesn't mean that you can always understand it. So hearing is one thing, but comprehension is a different thing. This is just two recordings: me reading my story, and that reading transformed into piano pitches by Piano Scribe.
Archive items in Audio Development: My Story
Interactive transcript
Audio · CC-BY (CC-Attribution) · View Item: My Story Piano Scribe (audio)
My Story Piano Scribe (audio)
In “My Story,” Ting describes some elements of her childhood and family. In a companion audio file, Piano Scribe renders Ting’s story as piano notes. Piano Scribe is an app that converts raw audio to MIDI using Onsets and Frames, a neural network trained for polyphonic piano transcription.
Interactive transcript
Audio · CC-BY (CC-Attribution) · View Item: My Story (audio)
My Story (audio)
In “My Story,” Ting describes some elements of her childhood and family. In a companion audio file, Piano Scribe renders Ting’s story as piano notes. Piano Scribe is an app that converts raw audio to MIDI using Onsets and Frames, a neural network trained for polyphonic piano transcription.