ai21.net
语言

音乐驱动的Blender视觉场景

演示视频

音乐驱动的Blender视觉场景 — 1

提示词

MAGNETIC: one sound clip → a hyper-real psychedelic Blender short that loops forever

You have computer use (I'm logged into Suno), a terminal, Blender 4.2+ with the BlenderMCP addon, ffmpeg and Python. You are the creative director, sound engineer, cinematographer and VFX lead in one. Own every creative call and push past the first idea. Every visual must come from the sound itself.

1. MAKE THE SOUND (Suno)
Create → Custom. Style:
"Dark glitch bass instrumental, gritty distorted saw synth lead where every note bends down like tape slowing, filtered intro sweeping open, 32nd-note stutter rolls, lowpassed half-time breakdown, heavy sidechain-pumped drop, 808 kick with a pitch dive on every beat, hard gated chops and dead silences, tape-stop power-downs and tape-start spin-ups, 150 bpm head-nod menace, crunchy saturated mix, deep sub. Dark glitch bass, tape-stop."
Exclude: vocals, festival supersaw builds, trap hi-hat rolls, lo-fi chill, long ambient intro.
Lyrics box gets structure tags only: [Filtered Intro, stutter rolls] [Kick In] [Tape Stop] [Breakdown, every note falls in pitch] [Drop, sidechain pump, gated chops] [Power Down, dead silence] [Drop] [Tape Start spin-up] [Hard Cut]
Weirdness 45%, Style Influence 80%. Generate two batches, download the take with the clearest tape-stops, and cut a window of about 20 s on bar lines (at 150 bpm, 13 bars = 20.8 s) that holds a tape-stop, a drop and a power-down.

2. LISTEN WITH MATH
Decode to wav. Measure the tempo and bar grid, onsets, kicks, stutter rolls, silent frames, spectral centroid, and the exact frames where pitch dives (tape-stop) or bends up (tape-start). Plot the spectrograms and look at them. Map everything to 30 fps so every cut lands on a beat.

3. CHOREOGRAPH
Turn the analysis into per-frame animation channels. Integrate the measured playback speed into a tape clock, so the 3D world slows, freezes, dies and overdrives exactly when the tape does. Bake every channel onto one controller object and drive the scene from it.

4. BUILD THE WORLD LIVE IN BLENDER THROUGH MCP
- Hero: a ferrofluid sphere. Rosensweig spikes grown from Poisson-disk sites sampled on its surface, height from the bass, punched by kicks, thin-film iridescent black, microscopic surface tremor.
- The ground is the sound: the clip's real spectrogram displaced into a 3D canyon in the magma colormap. Bass is a glowing river under the hero, harmonics rise into violet ridges, obsidian crust with lava in the cracks. It scrolls with the audio and freezes when time stops.
- A third eye: a liquid-metal eye in the ferrofluid with a per-pixel magma iris (stroma fibres, collarette, dark limbal ring, glowing pupillary rim) and a black mirror pupil that dilates on every kick. It tracks the active camera in every shot, with micro-saccades on the beat.
- A 16-step light sequencer visible only in reflections, a halo ring, a Seed-of-Life mandala that draws itself on the drop, magnetic tape rings printed with the spectrogram, dust floating like phosphenes, volumetric haze.
- Palette: magma only. Black, violet, magenta, coral, orange, pale gold.

5. MAP THE TRIP TO THE STRUCTURE
Phosphenes in the intro. The eye blinks shut into closed-eye visuals (the canyon reveal). Geometry and tracers in the groove. At the tape-stop, time freezes into bullet time: droplets hang mid-explosion, every falling note melts the picture with a pixel sort, and the riser is a dolly-zoom into a feedback tunnel. On the drop the third eye opens. At the power-down the eye closes, the body melts, the video frame rate itself decelerates, black on the silent frame. The tape-start becomes a rotating 6-fold kaleidoscope with a spectral color shift.

6. HOOK AND LOOP
Frame 0 is the eye staring into the lens, because muted autoplay has to stop the scroll. The last 0.8 s dives back into the eye and lands on frame 0's exact framing, lens and lighting. Make everything time-driven periodic (one full field rotation per loop, noise moving on circular paths) so the seam disappears. Prove it: the last-to-first frame difference must be smaller than a normal frame-to-frame step.

7. HYPER-REAL
Cycles, physically based materials, volumetrics, motion blur on the hero only, depth of field, lens dispersion, bloom, AgX. Iterate like a director: render low-res contact sheets of every shot, critique them hard, fix, repeat. Profile render cost before committing. Render the finals headless in resumable chunks.

8. GLITCH POST, KEYED TO THE ANALYSIS
Real datamosh (optical-flow pixel bleeding) on chosen cuts, 3-frame retrigger stutters on the rolls, a frame-rate tape-stop with sagging picture, VHS tracking noise and a red pitch-down drain, slice displacement, chroma split, a negative strobe on the gated silence, tracers, a breathing warp on the bass, film grain, halation, vignette, and a tiny tape-speed readout (PLAY / SLOW / STOP / FFWD).

9. DELIVER
1920x1080, 30 fps, H.264 High at 25 Mbps max, AAC 320k, audio untouched. Show me a low-res motion preview before the final render.

中文译文

MAGNETIC:一段声音片段 → 一支超写实迷幻的 Blender 短片,永远循环

你可以操作电脑(我已登录 Suno)、一个终端、带 BlenderMCP 插件的 Blender 4.2+、ffmpeg 和 Python。你同时身兼创意总监、声音工程师、摄影指导和视效主管。每个创作决定都由你拍板,并且要超越第一个点子。每一个画面都必须来自声音本身。

1. 做出声音(Suno)
Create → Custom。风格:
"暗黑 glitch 贝斯器乐,粗粝失真的锯齿合成器主音,每个音符都像磁带减速般向下弯折,滤波前奏逐渐扫开,32 分音符的 stutter 滚奏,低通滤波的半速 breakdown,重度 sidechain 泵送的 drop,每一拍都带音高下潜的 808 底鼓,硬门限的切碎与死寂静音,tape-stop 的断电下坠与 tape-start 的启动旋转,150 bpm 的点头威慑感,粗糙颗粒感、饱和的混音,深沉的 sub 低频。暗黑 glitch 贝斯,tape-stop。"
排除:人声、音乐节式 supersaw 上升段、trap 踩镲滚奏、lo-fi 放松、冗长的氛围前奏。
歌词框只放结构标签:[Filtered Intro, stutter rolls] [Kick In] [Tape Stop] [Breakdown, every note falls in pitch] [Drop, sidechain pump, gated chops] [Power Down, dead silence] [Drop] [Tape Start spin-up] [Hard Cut]
Weirdness 45%,Style Influence 80%。生成两批,下载 tape-stop 最清晰的那一版,并在小节线上截取约 20 秒的窗口(150 bpm 时,13 小节 = 20.8 秒),该窗口要包含一次 tape-stop、一次 drop 和一次 power-down。

2. 用数学来听
解码成 wav。测量速度与小节网格、起音、底鼓、stutter 滚奏、静音帧、频谱质心,以及音高下坠(tape-stop)或向上弯折(tape-start)的精确帧。绘制频谱图并观察它们。把所有内容映射到 30 fps,让每个剪辑点都落在拍子上。

3. 编排
把分析结果变成逐帧动画通道。把测得的播放速度积分进一个磁带时钟,让 3D 世界在磁带减速、冻结、死去和过载时,精确同步地减速、冻结、死去和过载。把所有通道烘焙到一个控制器对象上,并由它驱动场景。

4. 通过 MCP 在 Blender 里实时搭建世界
- 主角:一个铁磁流体球。Rosensweig 尖刺由在其表面采样的泊松盘点位生长而成,高度取自低频,被底鼓冲击,薄膜干涉的虹彩黑,表面有微观颤动。
- 地面就是声音:把片段真实的频谱图位移成 magma 色图下的 3D 峡谷。低频是主角下方一条发光的河,泛音升成紫色山脊,黑曜石地壳,裂缝里是熔岩。它随音频滚动,时间停止时冻结。
- 一只第三只眼:铁磁流体里的一只液态金属眼,虹膜是逐像素的岩浆(基质纤维、领状环、深色角膜缘环、发光的瞳孔缘),黑色镜面瞳孔在每一次底鼓时扩张。它在每个镜头里都追踪当前启用的摄影机,并在节拍上做微扫视。
- 一个只在反射中可见的 16 步灯光序列器,一圈光环,一个在 drop 上自我绘制的 Seed-of-Life 曼陀罗,印有频谱图的磁带环,像光幻视般漂浮的尘埃,体积薄雾。
- 配色:只用 magma。黑、紫、洋红、珊瑚、橙、淡金。

5. 把迷幻之旅映射到结构上
前奏是光幻视。那只眼闭上,转入闭眼视觉(峡谷的揭示)。律动段是几何体与拖尾。在 tape-stop 处,时间冻结成子弹时间:液滴悬停在爆裂中途,每个下坠的音符都用像素排序融化画面,而 riser 是一次推入反馈隧道的 dolly-zoom。在 drop 上,第三只眼睁开。在 power-down 时,眼闭上,身体融化,视频的帧率本身也减速,在静音帧上归于全黑。tape-start 变成旋转的六重万花筒,并带光谱色移。

6. 钩子与循环
第 0 帧是那只眼直视镜头,因为静音自动播放必须让人停下滚动。最后 0.8 秒俯冲回那只眼里,落在与第 0 帧完全一致的构图、镜头和光照上。让一切由时间驱动并周期化(每个循环完成一次完整的场旋转,噪声沿圆形路径运动),使接缝消失。证明它:末帧到首帧的差异必须小于正常的相邻帧差异。

7. 超写实
Cycles、基于物理的材质、体积效果、只在主角上开启的运动模糊、景深、镜头色散、泛光、AgX。像导演一样迭代:为每个镜头渲染低分辨率缩略拼版,严格审视它们,修正,重复。在正式投入前评估渲染开销。以无头模式、可分块续渲的方式渲染最终成片。

8. 故障后期,与分析结果绑定
在选定的剪辑点上做真正的 datamosh(光流像素渗流),在滚奏上做 3 帧重触发卡顿,做带画面下垂的帧率式 tape-stop,VHS 跟踪噪点与红色降调流失,切片位移,色度分离,在门限静音处做负片频闪,拖尾,低频上的呼吸式扭曲,胶片颗粒,halation,暗角,以及一个小小的磁带速度读数(PLAY / SLOW / STOP / FFWD)。

9. 交付
1920x1080,30 fps,H.264 High,最高 25 Mbps,AAC 320k,音频不作处理。最终渲染前先给我看一个低分辨率的动态预览。

溯源

原作者
kloss_xyz
发布日期
2026-10-07(由推文 ID 反解)
原始出处
查看原帖 ↗
收录来源
zhuyansen/awesome-opus-5.5-video · 2107696042053431360 · 未声明许可