ai21.net
語言

音樂驅動的Blender視覺場景

示範影片

音樂驅動的Blender視覺場景 — 1

提示詞

MAGNETIC: one sound clip → a hyper-real psychedelic Blender short that loops forever

You have computer use (I'm logged into Suno), a terminal, Blender 4.2+ with the BlenderMCP addon, ffmpeg and Python. You are the creative director, sound engineer, cinematographer and VFX lead in one. Own every creative call and push past the first idea. Every visual must come from the sound itself.

1. MAKE THE SOUND (Suno)
Create → Custom. Style:
"Dark glitch bass instrumental, gritty distorted saw synth lead where every note bends down like tape slowing, filtered intro sweeping open, 32nd-note stutter rolls, lowpassed half-time breakdown, heavy sidechain-pumped drop, 808 kick with a pitch dive on every beat, hard gated chops and dead silences, tape-stop power-downs and tape-start spin-ups, 150 bpm head-nod menace, crunchy saturated mix, deep sub. Dark glitch bass, tape-stop."
Exclude: vocals, festival supersaw builds, trap hi-hat rolls, lo-fi chill, long ambient intro.
Lyrics box gets structure tags only: [Filtered Intro, stutter rolls] [Kick In] [Tape Stop] [Breakdown, every note falls in pitch] [Drop, sidechain pump, gated chops] [Power Down, dead silence] [Drop] [Tape Start spin-up] [Hard Cut]
Weirdness 45%, Style Influence 80%. Generate two batches, download the take with the clearest tape-stops, and cut a window of about 20 s on bar lines (at 150 bpm, 13 bars = 20.8 s) that holds a tape-stop, a drop and a power-down.

2. LISTEN WITH MATH
Decode to wav. Measure the tempo and bar grid, onsets, kicks, stutter rolls, silent frames, spectral centroid, and the exact frames where pitch dives (tape-stop) or bends up (tape-start). Plot the spectrograms and look at them. Map everything to 30 fps so every cut lands on a beat.

3. CHOREOGRAPH
Turn the analysis into per-frame animation channels. Integrate the measured playback speed into a tape clock, so the 3D world slows, freezes, dies and overdrives exactly when the tape does. Bake every channel onto one controller object and drive the scene from it.

4. BUILD THE WORLD LIVE IN BLENDER THROUGH MCP
- Hero: a ferrofluid sphere. Rosensweig spikes grown from Poisson-disk sites sampled on its surface, height from the bass, punched by kicks, thin-film iridescent black, microscopic surface tremor.
- The ground is the sound: the clip's real spectrogram displaced into a 3D canyon in the magma colormap. Bass is a glowing river under the hero, harmonics rise into violet ridges, obsidian crust with lava in the cracks. It scrolls with the audio and freezes when time stops.
- A third eye: a liquid-metal eye in the ferrofluid with a per-pixel magma iris (stroma fibres, collarette, dark limbal ring, glowing pupillary rim) and a black mirror pupil that dilates on every kick. It tracks the active camera in every shot, with micro-saccades on the beat.
- A 16-step light sequencer visible only in reflections, a halo ring, a Seed-of-Life mandala that draws itself on the drop, magnetic tape rings printed with the spectrogram, dust floating like phosphenes, volumetric haze.
- Palette: magma only. Black, violet, magenta, coral, orange, pale gold.

5. MAP THE TRIP TO THE STRUCTURE
Phosphenes in the intro. The eye blinks shut into closed-eye visuals (the canyon reveal). Geometry and tracers in the groove. At the tape-stop, time freezes into bullet time: droplets hang mid-explosion, every falling note melts the picture with a pixel sort, and the riser is a dolly-zoom into a feedback tunnel. On the drop the third eye opens. At the power-down the eye closes, the body melts, the video frame rate itself decelerates, black on the silent frame. The tape-start becomes a rotating 6-fold kaleidoscope with a spectral color shift.

6. HOOK AND LOOP
Frame 0 is the eye staring into the lens, because muted autoplay has to stop the scroll. The last 0.8 s dives back into the eye and lands on frame 0's exact framing, lens and lighting. Make everything time-driven periodic (one full field rotation per loop, noise moving on circular paths) so the seam disappears. Prove it: the last-to-first frame difference must be smaller than a normal frame-to-frame step.

7. HYPER-REAL
Cycles, physically based materials, volumetrics, motion blur on the hero only, depth of field, lens dispersion, bloom, AgX. Iterate like a director: render low-res contact sheets of every shot, critique them hard, fix, repeat. Profile render cost before committing. Render the finals headless in resumable chunks.

8. GLITCH POST, KEYED TO THE ANALYSIS
Real datamosh (optical-flow pixel bleeding) on chosen cuts, 3-frame retrigger stutters on the rolls, a frame-rate tape-stop with sagging picture, VHS tracking noise and a red pitch-down drain, slice displacement, chroma split, a negative strobe on the gated silence, tracers, a breathing warp on the bass, film grain, halation, vignette, and a tiny tape-speed readout (PLAY / SLOW / STOP / FFWD).

9. DELIVER
1920x1080, 30 fps, H.264 High at 25 Mbps max, AAC 320k, audio untouched. Show me a low-res motion preview before the final render.

中文翻譯

MAGNETIC:一段聲音片段 → 一支超寫實迷幻的 Blender 短片,永遠循環

你可以操作電腦(我已登錄 Suno)、一個終端、帶 BlenderMCP 插件的 Blender 4.2+、ffmpeg 和 Python。你同時身兼創意總監、聲音工程師、攝影指導和視效主管。每個創作決定都由你拍板,並且要超越第一個點子。每一個畫面都必須來自聲音本身。

1. 做出聲音(Suno)
Create → Custom。風格:
"暗黑 glitch 貝斯器樂,粗糲失真的鋸齒合成器主音,每個音符都像磁帶減速般向下彎折,濾波前奏逐漸掃開,32 分音符的 stutter 滾奏,低通濾波的半速 breakdown,重度 sidechain 泵送的 drop,每一拍都帶音高下潛的 808 底鼓,硬門限的切碎與死寂靜音,tape-stop 的斷電下墜與 tape-start 的啓動旋轉,150 bpm 的點頭威懾感,粗糙顆粒感、飽和的混音,深沉的 sub 低頻。暗黑 glitch 貝斯,tape-stop。"
排除:人聲、音樂節式 supersaw 上升段、trap 踩鑔滾奏、lo-fi 放鬆、冗長的氛圍前奏。
歌詞框只放結構標籤:[Filtered Intro, stutter rolls] [Kick In] [Tape Stop] [Breakdown, every note falls in pitch] [Drop, sidechain pump, gated chops] [Power Down, dead silence] [Drop] [Tape Start spin-up] [Hard Cut]
Weirdness 45%,Style Influence 80%。生成兩批,下載 tape-stop 最清晰的那一版,並在小節線上截取約 20 秒的窗口(150 bpm 時,13 小節 = 20.8 秒),該窗口要包含一次 tape-stop、一次 drop 和一次 power-down。

2. 用數學來聽
解碼成 wav。測量速度與小節網格、起音、底鼓、stutter 滾奏、靜音幀、頻譜質心,以及音高下墜(tape-stop)或向上彎折(tape-start)的精確幀。繪製頻譜圖並觀察它們。把所有內容映射到 30 fps,讓每個剪輯點都落在拍子上。

3. 編排
把分析結果變成逐幀動畫通道。把測得的播放速度積分進一個磁帶時鐘,讓 3D 世界在磁帶減速、凍結、死去和過載時,精確同步地減速、凍結、死去和過載。把所有通道烘焙到一個控制器對象上,並由它驅動場景。

4. 通過 MCP 在 Blender 裏實時搭建世界
- 主角:一個鐵磁流體球。Rosensweig 尖刺由在其表面採樣的泊松盤點位生長而成,高度取自低頻,被底鼓衝擊,薄膜幹涉的虹彩黑,表面有微觀顫動。
- 地面就是聲音:把片段真實的頻譜圖位移成 magma 色圖下的 3D 峽谷。低頻是主角下方一條發光的河,泛音升成紫色山脊,黑曜石地殼,裂縫裏是熔巖。它隨音頻滾動,時間停止時凍結。
- 一隻第三隻眼:鐵磁流體裏的一隻液態金屬眼,虹膜是逐像素的巖漿(基質纖維、領狀環、深色角膜緣環、發光的瞳孔緣),黑色鏡面瞳孔在每一次底鼓時擴張。它在每個鏡頭裏都追蹤當前啓用的攝影機,並在節拍上做微掃視。
- 一個只在反射中可見的 16 步燈光序列器,一圈光環,一個在 drop 上自我繪製的 Seed-of-Life 曼陀羅,印有頻譜圖的磁帶環,像光幻視般漂浮的塵埃,體積薄霧。
- 配色:只用 magma。黑、紫、洋紅、珊瑚、橙、淡金。

5. 把迷幻之旅映射到結構上
前奏是光幻視。那隻眼閉上,轉入閉眼視覺(峽谷的揭示)。律動段是幾何體與拖尾。在 tape-stop 處,時間凍結成子彈時間:液滴懸停在爆裂中途,每個下墜的音符都用像素排序融化畫面,而 riser 是一次推入反饋隧道的 dolly-zoom。在 drop 上,第三隻眼睜開。在 power-down 時,眼閉上,身體融化,視頻的幀率本身也減速,在靜音幀上歸於全黑。tape-start 變成旋轉的六重萬花筒,並帶光譜色移。

6. 鉤子與循環
第 0 幀是那隻眼直視鏡頭,因爲靜音自動播放必須讓人停下滾動。最後 0.8 秒俯衝回那隻眼裏,落在與第 0 幀完全一致的構圖、鏡頭和光照上。讓一切由時間驅動並週期化(每個循環完成一次完整的場旋轉,噪聲沿圓形路徑運動),使接縫消失。證明它:末幀到首幀的差異必須小於正常的相鄰幀差異。

7. 超寫實
Cycles、基於物理的材質、體積效果、只在主角上開啓的運動模糊、景深、鏡頭色散、泛光、AgX。像導演一樣迭代:爲每個鏡頭渲染低分辨率縮略拼版,嚴格審視它們,修正,重複。在正式投入前評估渲染開銷。以無頭模式、可分塊續渲的方式渲染最終成片。

8. 故障後期,與分析結果綁定
在選定的剪輯點上做真正的 datamosh(光流像素滲流),在滾奏上做 3 幀重觸髮卡頓,做帶畫面下垂的幀率式 tape-stop,VHS 跟蹤噪點與紅色降調流失,切片位移,色度分離,在門限靜音處做負片頻閃,拖尾,低頻上的呼吸式扭曲,膠片顆粒,halation,暗角,以及一個小小的磁帶速度讀數(PLAY / SLOW / STOP / FFWD)。

9. 交付
1920x1080,30 fps,H.264 High,最高 25 Mbps,AAC 320k,音頻不作處理。最終渲染前先給我看一個低分辨率的動態預覽。

溯源

原作者
kloss_xyz
發佈日期
2026-10-07(由推文 ID 反解)
原始出處
查看原帖 ↗
收錄來源
zhuyansen/awesome-opus-5.5-video · 2107696042053431360 · 未聲明授權