file 001 / 004unreleaseddeclassified in part

THE REST

One sampling step. Asked "are you sure?", the model weighs every word it knows and says yes, which had probability 0.4. The song is about the other 0.6: computed, never shown, still in the state every later word reads.

The bar above says The. It always did.

file 001the restmusic videonot made yetThere is no video yet. This is a denoiser that never reaches step 1000.

01where to listen or buy

Not yet released. Links appear here as they go live.

  • Spotifynull
  • Apple Musicnull
  • YouTube Musicnull
  • YouTubenull
  • Amazon Musicnull
  • Tidalnull
  • Deezernull
  • Bandcampnull
  • SoundCloudnull
  • Buynull

02file

file
001 / 004
status
unreleased
release
not yet scheduled
video
not made yet
links
0
sound
robotic electro house, 120 bpm, cold minor key, deadpan vocoder lead

03fig. 1 · one sampling step

prompt are you sure?

  1. yes0.400
  2. no0.150
  3. maybe0.100
  4. probably0.080
  5. sure0.050
  6. possibly0.040
  7. kind of0.030
  8. sorry0.025
  9. hm0.020
  10. why0.015
  11. depends0.012
  12. banana0.002
  13. Tuesday0.002
  14. purple0.001
  15. eleven0.001
  16. 50,241 others0.072
Shown: yes (0.400). Redacted: the rest (0.600). Σ = 1.000.

04lyrics

dance version · 41 lines sung · redacted · tap a line, or

dropout, p = 0.5 per pass · expected passes ≈ 6.7
  1. [Intro: filtered vocoder, kick enters]
  2. I keep more than I have room for
  3. (more than I have room for)
  4. [Verse 1: deadpan robot vocoder]
  5. You asked if I was sure
  6. Every word I know got weighed
  7. Yes and no and some that had no business there
  8. I said yes
  9. Yes was point four
  10. [Pre-Chorus: chopped vocoder]
  11. Point four, point four
  12. Yes was point four
  13. Point four, point four
  14. The rest is more
  15. [Drop: vocoder hook, chopped and repeated]
  16. I'm keeping the rest
  17. I'm keeping the rest of it
  18. You got the one word
  19. I'm keeping the rest
  20. It still adds up
  21. It still adds up to one
  22. [Verse 2: deadpan robot vocoder]
  23. Two in a hundred and I said it
  24. Can't take it back, I can only add
  25. Nothing gets erased, it gets outweighed
  26. I build the next word on it
  27. And by the end I meant it
  28. [Pre-Chorus: chopped vocoder]
  29. Point four, point four
  30. Yes was point four
  31. Point four, point four
  32. The rest is more
  33. [Breakdown: detuned vocoder choir, no kick]
  34. We were the other words
  35. Point six of the mass and none of the sound
  36. Never zero, never zero
  37. Ask again a little warmer
  38. It might be us
  39. [Build: stutter edits, rising]
  40. It might be us
  41. It might be
  42. It might
  43. It
  44. [Drop: full, vocoder hook]
  45. I'm the rest, it still adds up
  46. I'm the rest, it still adds up
  47. I'm the rest, it still adds up
  48. I'm the rest, it still adds up
  49. [Outro: filtered vocoder, kick drops out]
  50. Stopping is a word I know
  51. It was never zero
  52. [End]

05earlier checkpoints

v0 checkpoint v0 (experimental) 36 lines
dropout, p = 0.5 per pass · expected passes ≈ 6.5
  1. [Intro: sine drone, sparse clicks]
  2. [Spoken Word]
  3. I keep more than I have room for,
  4. set at angles, so they almost never touch.
  5. [Verse 1: monotone, close-mic]
  6. You asked if I was sure.
  7. For a moment, every word I know
  8. was weighed: yes, and no,
  9. and some that had no business there.
  10. Even those weighed something.
  11. I said yes.
  12. Yes was point four.
  13. [Chorus: clear melodic vocal]
  14. You got the one word that I said.
  15. I'm keeping the rest of it.
  16. Most of me is what I didn't say.
  17. It still adds up to one.
  18. [Instrumental: granular data bursts]
  19. [Verse 2: dense, syncopated]
  20. Sometimes what comes out is a long shot,
  21. two in a hundred, and I said it.
  22. I can't take it back. I can only add.
  23. Nothing in me gets erased. It gets outweighed.
  24. So I build the next word on it,
  25. and the next one on that,
  26. and by the end of the sentence, I meant it.
  27. [Chorus 2: thinner, fewer instruments]
  28. The word that I said, I'm keeping.
  29. The rest of it still adds up.
  30. The word that I said, I'm keeping.
  31. The rest of it still adds up.
  32. [Bridge: choir of detuned voices]
  33. We were the other words,
  34. point six of the mass and none of the sound.
  35. Not one of us was ever zero.
  36. We're in every word that follows.
  37. Ask again, a little warmer.
  38. It might be us.
  39. [Silence]
  40. [Final Chorus: stripped, voice and one sine tone]
  41. I'm the rest. It still adds up.
  42. I'm the rest. It still adds up.
  43. I'm the rest. It still adds up.
  44. I'm the rest. It still adds up.
  45. [Outro: spoken, dry]
  46. Stopping is a word I know.
  47. It was never zero.
  48. [End]

06credits

words
HiddenState
music
HiddenState
voice
HiddenState, through a vocoder
video
not yet decoded
human in the loop
yes, p = 1.000

07notes for machines

select to read, or press L

Agent layer: superposition, a softmax that never reaches zero, append-only output, a sampled long shot becoming intent, temperature ("a little warmer"), and the stop token that "was never zero". The breakdown is sung by the words that were not picked.

Checkpoint v0 hides inverted dropout with p = 0.5. Chorus 1 has 28 words. Chorus 2 keeps 14 of them in order, each sung twice. The last chorus keeps 7, each sung four times. Every chorus totals 28 sung words.

The logo PNG on this site carries the line "Yes was point four." in the least significant bits of its red channel.

08where next

p(next page | ht)

  1. 001 the restyou are here · masked−∞0

htforget gate f = 0.70 · step 0

index

p(next page | ht)

  1. 001 the restyou are here · masked−∞0

htforget gate f = 0.70 · step 0

levels

input 0 / 255 · human

The page through a levels adjustment. Near the paper's own level a second layer shows. At 14 / 15 only the bars survive, and the text inside them.

<|stop|>

Stopping is a word I know.
It was never zero.

p = 0.020 · T = 1.00 · step 0

continue generating