The past few days have seen experiments that continue to inform my work in understanding how visuals can be created with audio synthesis. Ultimately, it will be useful to know what kind of sonic possibilities can alter the visuals and control them, but it is not my intention to merely control the visuals. By practicing difference setups and familiarising myself with pitches, intervals and rhythms that produce reliable images, I can create a palette that can be controlled in real time - hopefully that will sound good - but its not easy.
Pixivisor visual images generally produce a very intense fax-like sound that can be manipulated into interesting sound, but not easily. I’ve started these experiments by isolating various intervals with clean digital and analogue VCOs with only slight morphing. The top gif examples are from using a modular synth I’m using an oscilloscope to compare the waveform to the visual outcome. Essentially, it seems the complexity of the waveform (as opposed to a simple sine/sawtooth/triangle wave) creates contrast gradients, whereas the pitch determines horizontal frequency. Vertical frequency can be created with overtones and FM.
The more complex images (in the red and yellow gif below) are recreated using more complex digital synthesis algorithms from the OP-1 Digital engine, manipulating octaves (-21 detune cents made horizontal), synth perimeters and envelope. Watch the screen recording with sound, FFT and oscilloscope below.