gpojani

instrument · vocoder

Melencolia I

A vocoder measures your voice in bands and lends its shape to another sound. Here the other sound is a choir that only knows sad chords, chosen by what the research says sad music is made of: the minor third of sad speech, small steps, a bass that falls, an appoggiatura that leans before it resolves. Dürer put a magic square in his engraving of melancholy; it is in here too.

Ptractable
vocoder · gpojaniopen the microphone, or play the chords without a voice
ascolto
stanza non misurata
volume
tempo
tristezza70

La voce

the modulator: how loud, how bright, which pitch, and how sad it sounds
guadagno
soglia
sibilanti
voce secca

altezza —

intervallo —

la tua voce —

Il banco

8 to 32 bandpass filters, an envelope follower on each
bande
stretto
attacco
rilascio
formanti
sfoca
buio

La portante

what your voice shapes: a sad choir, or your own pitch
ottava
coro-det.
flessione
legato
rumore
segue

L'armonia triste

chords chosen by the findings on sad music, and why each one is sad

—

silenzio

    dynamic programming over a chord graph weighted by Huron 2008, Huron & Davis 2012, Curtis & Bharucha 2010, Zeloni & Pavani 2022, Rosand 1979, Capuzzo 2004

    16321351011896712415141

    34 · Melencolia I, 1514

    battute
    lacrime
    spezie

    indice di malinconia —

    weights are ours; their order follows Eerola, Friberg & Bresin (2013): mode and tempo count most

    Dopo

    worn tape, an echo that darkens, a room
    nastro
    eco
    tempo eco
    ritorno
    riverbero
    stanza
    ombra

    Il registratore

    record the dry voice, the vocoder, or both; put any take (or a file) through the vocoder afterwards
    0:00.0

      how to use it

      Press apri il microfono and allow the browser to use it. Say whether you are on cuffie (headphones) orcasse (speakers). Then sing, speak or hum: your voice's shape moves through the choir. With no microphone, switch onsenza voce to hear the chords on their own.

      Feedback. With speakers, the room carries the output back into the microphone, and a vocoder will happily sing along with itself. Five things stop it. The browser's echo canceller is switched on in speaker mode. When the microphone opens, a soft hiss measures how much of each band the room returns, and if you said headphones but the mic can hear the speakers, the page switches to speaker mode itself. In speaker mode a band only opens when your voice is louder there than the share of our own output the room gives back. A singer has to breathe: if the input never goes quiet for ten seconds, the output drops out for a third of a second, and if the microphone falls silent with it, it was listening to the speakers. A howl on a single frequency ducks the output and notches that band. Headphones are still the best way.

      Recording. registra keeps the dry voice, the vocoder, or both, in step. Every take can be heard, saved as a WAV file (16 or 24 bit), and a dry take (or any audio file you load) can go through the vocoder again: applica il vocoder renders it offline with the current settings, suona nel vocoder plays it through live while you turn the knobs.

      Why these chords. Listeners hear music as sad when it is slow, minor, low, soft, legato and dark in timbre, the same cues sad speech carries. Sad melodies move by small intervals, and the minor third turns up in the pitch contour of sad speech; the minor second dominates infants' cries. Passages with appoggiaturas are the ones people report crying to. A bass that falls by step from the tonic to the dominant was the seventeenth century's emblem of lament. Thesaddest path weighs every move between chords by these findings and finds the best four-chord phrase by dynamic programming, the reason for the stamp: P. Dürer ranks sixteen chords from least to most sad and walks the lines of the magic square from the engraving Melencolia I: every line sums to 34, so every phrase carries the same total sadness.

      sources

      1. H. Dudley, “Remaking Speech”, Journal of the Acoustical Society of America 11(2), 1939, 169–177.
      2. A. de Cheveigné & H. Kawahara, “YIN, a fundamental frequency estimator for speech and music”, JASA 111(4), 2002, 1917–1930.
      3. P. N. Juslin & P. Laukka, “Communication of emotions in vocal expression and music performance: Different channels, same code?”, Psychological Bulletin 129(5), 2003, 770–814.
      4. T. Eerola, A. Friberg & R. Bresin, “Emotional expression in music: contribution, linearity, and additivity of primary musical cues”, Frontiers in Psychology 4:487, 2013.
      5. K. Hevner, “The affective character of the major and minor modes in music”, American Journal of Psychology 47(1), 1935.
      6. R. Parncutt, “The emotional connotations of major versus minor tonality: One or more origins?”, Musicae Scientiae 18(3), 2014.
      7. D. Huron, “A comparison of average pitch height and interval size in major- and minor-key themes”, Empirical Musicology Review 3(2), 2008, 59–63.
      8. D. Huron & M. Davis, “The harmonic minor scale provides an optimum way of reducing average melodic interval size, consistent with sad affect cues”, Empirical Musicology Review 7(3–4), 2012, 103–117.
      9. M. E. Curtis & J. J. Bharucha, “The minor third communicates sadness in speech, mirroring its use in music”, Emotion 10(3), 2010, 335–348.
      10. G. Zeloni & F. Pavani, “Minor second intervals: A shared signature for infant cries and sadness in music”, i-Perception 13(2), 2022.
      11. O. Post & D. Huron, “Western classical music in the minor mode is slower (except in the Romantic period)”, Empirical Musicology Review 4(1), 2009.
      12. B. Turner & D. Huron, “A comparison of dynamics in major- and minor-key works”, Empirical Musicology Review 3(2), 2008.
      13. D. Huron, C. Anderson & D. Shanahan, “‘You can't play a sad song on the banjo’: acoustic factors in the judgment of instrument capacity to convey sadness”, Empirical Musicology Review 9(1), 2014, 29–41.
      14. J. A. Sloboda, “Music structure and emotional response: Some empirical findings”, Psychology of Music 19, 1991, 110–120.
      15. E. Rosand, “The Descending Tetrachord: An Emblem of Lament”, The Musical Quarterly 65(3), 1979, 346–359.
      16. G. Capuzzo, “Neo-Riemannian Theory and the Analysis of Pop-Rock Music”, Music Theory Spectrum 26(2), 2004, 177–200.
      17. B. Osborn, Everything in Its Right Place: Analyzing Radiohead (Oxford University Press, 2017).
      18. N. Collins, “OK Computer Analysis: An Audio Corpus Study of Radiohead”, arXiv:2211.15834, 2022.
      19. A. Dürer, Melencolia I (engraving, 1514).
      esc

      ↑↓ move · ↵ open~ terminal · ? shortcuts

      gsh — gianni@gpojani

      manual · keyboard

      Shortcuts

      / ⌘K
      search & jump
      ~
      terminal
      C
      live channel (chat)
      J K
      next / previous transmission
      G then HZLANUXDSVW
      home · zoo · lab · atlas · network · unveiled · logic · drums · synth · vocoder · a world made of letters
      ?
      this sheet
      P
      pause / run the colony
      R
      reseed
      1–4
      Conway · HighLife · Day & Night · Anneal
      M
      listen to the colony
      ⟲ in the HUD
      homeostat: the colony matches your input variety
      click · shift-click · drag
      glider · glider gun · paint
      ↑↑↓↓←→←→BA
      first contact