Title: One day I was listening to a playlist and wished there could be some cool visuals to go along with it.<p>Blotter is a proof of concept I hacked together that does a bit of audio recognition combined with a few generative AI models (both text and img) to create visuals that are relevant to the song.<p>The video stream is generated in real time at 24fps - you can try it yourself by requesting visuals in the Twitch chat using the &quot;!v&quot; command!<p>Right now it&#x27;s mostly a fun hack project, but I am tinkering with new model architectures for higher fidelity video as well as an interactive tool so people can make videos with their own audio files.<p>I&#x27;d love to hear any feedback or suggestions, thanks!
Upvote: