[Show GN: VisualSong - AI를 활용해 음악에 반응하는 시각효과 생성

VisualSong은 AI를 활용해 음악에 반응하는 시각 효과를 생성하는 웹 서비스입니다. 사용자는 프롬프트로 원하는 분위기를 입력하면, 실시간 오디오 데이터에 맞춰 시각 효과를 생성할 수 있습니다.

https://news.hada.io/topic?id=25933

#ai #visualsong #musicvisualization #shader #webapp

Warning: audio is loud.

Follow-up music visualizer video.

This time I used Simulation Nodes, and it looks a lot better. For each frequency band, I'm generating an icosphere 60 times per second and shooting them up the Y axis. This one was actually far easier than the way I was doing it before. Simulation nodes are very powerful.

I wish I could render this thing up with cycles. Even with my GPU, a single frame takes 42 seconds, so this whole 5237-frame video would take two and a half days to render. It would be less if I dropped the framerate, but this does not look nearly as good at a lower framerate.

Track is PRINCESS♛THEME from the album ♞ by Emma Essex

#Blender #Blender3D #Blender3DArt #3DArt #Music #Video #Mograph #MotionGraphics #AudioVisual #MusicVisualization #GeometryNodes #SimulationNodes

Spent a while working on this one. It's a music visualizer using a 10x10 grid of cubes. I tried a lot of different approaches to get this working. It uses Python with librosa to do the audio analysis, using STFT to pull per-frequency amplitudes.

My first approach was to use a driver-driven value in geometry nodes, which would have worked for a sigle value, but I couldn't figure out a way to pass instance data into it. That would have been perfect if the driver node had an input socket that it could work with, but it doesn't.

Second approach was to bake the data to F-Curves, thinking I could use arbitrary tracks for the different frequency bands, but I couldn't figure out how to sample at an offset of the current time to get the wave effect working right.

Third approach, which is this final result, was to bake the STFT to a grayscale image, with each column representing a frequency and each row being a volume of that frequency at each centisecond slice. Then I loaded that in as a texture and scaled instances by sampling into that texture based on the current frame. That worked much better.

Rendered in Eevee, because Cycles was going to take at least a dozen hours. This instead took just under an hour.

I might come back to it and see if I can add some motion to make it resemble a particle system, with each cube a constant size, moving up from the bottom and disappearing.

Track is CUM MONOLITH by Emma Essex

#Blender #Blender3D #Blender3DArt #3DArt #Music #Video #Mograph #MotionGraphics #AudioVisual #MusicVisualization #GeometryNodes

See chords as flags – Visual harmony of top composers on musescore

https://rawl.rocks/

#HackerNews #See #chords #as #flags #Visual #harmony #top #composers #musescore #musicvisualization