Skip to content

g-l-i-t-c-h-o-r-s-e/SoniFFPy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

37 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Currently Only Setup For Windows 😭

Requirements

pip install -r requirements.txt
(should be all python modules you need afaik)

FFmpeg & FFplay in your PATH environment variable (with libzmq support compiled in)
if you're on windows grab a copy here, otherwise you'll need to compile it.
You could probably modify my colab here to build a linux binary, or copy the settings and do it locally.

loopmidi if you want to use a DAW to control the filters

Documentation

Left/Right Arrow Key Adjust the last clicked slider up or down
Right click Slider Modify min/max/current/increment values of sliders
Shift+Right click Slider Assign MIDI Control to audio filter/slider (values printed in console upon midi usage)

note: make sure Send To ZMQ is toggled.
hint: you can manually start SoniGUI.py too, give it an ffmpeg filter as an argument.

MORE TO COME SOON:tm:

TODO

β€’ Add Linux Support [βœ–]
β€’ Integrate Ecasound [βœ–]
β€’ Optimize UI [βœ–]
β€’ Eliminate FFmpeg Sonification Latency (There is little to none with Ecasound) [βœ–]
β€’ Modify existing FFmpeg filters to support libzmq + Timeline and Command support [βœ–]
β€’ Upload my filter presets [βœ–]
β€’ Add video file input [βœ–] (optionally you can use OBS virtual video device)
β€’ Add option to trigger filter presets via MIDI Notes or CC [βœ–]
β€’ Virtual video output device (so you can use this as a webcam) [βœ–]
β€’ File output (Encode video of the sonification) [βœ–]
β€’ ETC ETC ETC

image

About

Realtime Sonification with FFmpeg, FFplay & Ecasound

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages