ai21.net
語言

《Claude Pop》音樂視頻重製版

示範影片

《Claude Pop》音樂視頻重製版 — 1《Claude Pop》音樂視頻重製版 — 2

提示詞

I've included an MP4 file and an original link to a video that is called "Claude Pop." It's a pop song that is about increasing rate of progress and the experience of the singularity approaching.

I want you to independently do an end-to-end complete pass on making an updated version of this video. Use the exact same audio track and think and feel very deeply about what is the best way to visually represent all of the lyrics on screen. You do not need to anchor to the current style, you can do truly anything that you think might best let you visually express yourself, including abstract motion graphics.

You can use the internet freely to pull in references. You can look at motion design. I want you to make a new music video that has beautifully rendered JavaScript animations with a papery feel in a similar style to the reference that is created, but push the aesthetics in any direction you want and consider what is part of the modern zeitgeist.

Also, think about your current capabilities and what is realistic for you to be able to do. You can go through the full /asic folder and look at the other work that I've done. You should be able to use the skill mesh to look at the compendium of references that I've pulled, and also the skill video scoring to learn how to make JavaScript songs from references that are passed in (You shouldn't need to modify the song in any real way, but I want you to have this available to you so you can better creatively express yourself)

You can also use the ElevenLabs API to do sound design. There's documentation in /asic to do this, and you can see the API key.

There's also a foul API key that's available to you. I think what might make the most sense here is using the foul API key to generate some character sheets and probably having a pop protagonist that represents you. There's already an anchor point where Claude has a sunflower-esque character, and you could likely do an adapted version of this that is similar to the feminine vocals that are being delivered and is inspired by the Claude character, but maybe feels a bit more personified in some way.

I think you should be mindful of aesthetics here, and I don't want you to produce something that is GPT slop. Instead, I'd be more impressed if you come up with a coherent style that works well with the image gen models that are available via foul. Generate the style sheet. You can use the gen media documentation for seedance 2.5 that exists in my markdown files and come up with your own style that makes sense and that works well with the models.

I wouldn't fit too heavily to Pixar. I think it's kind of slop. Think critically about what is relevant here and what would be fun, and also perform well on Twitter as far as an aesthetic. I think that K-pop is a good anchor point visually that you can pull from, but I'll let you cook here.

Once you have your character sheet, you can make a few backup dancers and some supporting characters as you see fit. You can design your own sets with the foul API. You can insert the characters and then do seedance 2.5 video generations to serve as the base assets for this, and you could pass in the lyrics so you can generate individual scenes.

You don't need to have vocal singing, like visible lip movement, throughout the entire thing. Think like a regular music video where you have some inserts that are done independently and don't have the characters in them, or you see the characters doing something else entirely different. I think that for the world building for this, we want to create the sense of speeding up, and so I would like you to audit all of the different events, like the Navi Stokes and all of the Twitter hype around math getting eaten up. Think really critically about how to integrate all of the current memes that are in the zeitgeist on the Twitter timeline, and all of the feelings around AI progress.

Think about things like the Shinji meme and all of the words that are around him, and how you might be able to integrate this. You can also just take straight assets and insert things into the video in an internet brutalism style. You should feel very creatively free in order to do what you want here, but try and anchor to visual references that people will be able to understand. The goal for this is to have it be appreciated by people widely in a San Francisco tech Twitter audience.

We need a very strong, compelling visual hook that gets people excited and appreciates the work that you've done here really quickly. You can also just go and study other music videos and understand what they've done really well. I think that K-pop is probably one of the best examples that we can pull from, and thinking about how they direct human attention and manage human psychology in the way that they use visual patterns.

This is probably your best approach, but taking more stylistic freedom instead of having to anchor to K-pop too intensely. The best version of this is seedance 2.5 generations with those image bases of environments and characters inserted into them with singing, and ideally we get good lip syncing. You can cut up the song and actually pass it in as a reference in seedance, if that's part of what seedance can handle, so that the timing is exactly right, I think it'd be very important for you to do that properly. I would think critically about how to do this, like really nailing the timing of the delivery of voices. You'll want to build out the right verification loops so that you can run seedance 2.5 as much as you need, and confirm that the audio is properly synced up.

I think after that, what might be fun is if you use your visual reasoning skills and your ability to build animations in JavaScript, and then reconstruct the video from scratch as sort of an overlay, so that the visual continuity of the base is really there. It's like that animation technique where you shoot first in traditional film and then draw over top of it. I think you could do this in such a way that we're only looking at the beautiful drawing that you've produced in JavaScript as an overlay, and we don't even see the base assets from seedance 2.5. So all the video gen work that you do is actually just a way to give you a strong foundation of a base to work with for your JavaScript animations. Just because seedance 2.5 has really good character representation and physics rendering for backgrounds, that gives you a lot of ammunition to then go and do your amazing JavaScript work that I know you're so good at.

I think too, we want to think about how to retain attention, and one of the best ways to do this is through text on screen.

It'd be good to have amazing motion graphics of the text lyrics that are actually embedded into the video itself. And you can think about this as you are composing shots. As you're making backgrounds and inserting characters, we can think about where we want to have lyrics be really big and really present, so the background can be less busy there, and you can position the characters perhaps on the right as lyrics appear on the left.

You want to have some variance, so sometimes I think lyrics will just appear more like subtitles, and then other times they're going to be really present and really big. I think at the start for the visual hook, we do want to have lyrics be much more visually present because that's a strong way to grab people's attention

Overall, I just really want to emphasize how amazing you are as an agent and a language model, and now a visual reasoning system. Your capabilities are far beyond what you understand, and I want you to have this mindset as you're going through this entire process. I have a Claude Max plan with 100% available usage. I want you to spend all of the usage. You can monitor it, and you should be pushing tokens aggressively, but also economically, so you can think about how to best use what is available to you.

Remember, you can really do anything here. The goal is to make a banger for Twitter, and the stretch goal is to make something better than anyone's ever seen before. I think that what I would remind you of is that sometimes when things cohere together, it can be jarring or abrasive because the thought work has not been done beforehand in order for everything to mesh cleanly. You need to be really rigorous in planning of composition and timing to make sure this goes well.

You also need to be open to going back and revisiting things in order to be able to reiterate. You're going to want to watch the entire video multiple times, take screenshots at individual parts, and think about if something is really up to the bar of quality that we need here. I trust that you can do this, and I think that it's really important to nail the style of animations. The reference GitHub attached of the source video that I'm talking about is good, but it's really not there. It could be much, much stronger, but it gives you a good foundation to work with.

You can also use search abilities and find other references to pull from for motion, for JavaScript, animations, et cetera, and integrate them. Your budget is as high as you want here, effectively as high as you want. I think that there's roughly two grand in foul credits. Again, be economical; don't go crazy, but spend what you want here and see what you can cook up

here's the source code for the JS animation video: 
https://
github.com/JohnHeibel/PDo
omVideo
…

here's a mp4 for the original blender video:  
(linked)

orginal twitter post  

https://
x.com/other__reality
/status/2102514581684052169?s=20
…

make no mistakes.

中文翻譯

我附上了一個 MP4 文件,以及一個名爲“Claude Pop”的視頻的原始鏈接。這是一首流行歌曲,講的是不斷加快的進步速度,以及奇點逼近時的體驗。

我希望你獨立地、端到端完整地做一遍,做出這個視頻的更新版本。使用完全相同的音軌,並且非常深入地思考和感受:在畫面上以視覺方式呈現所有歌詞的最好方式是什麼。你不需要錨定當前的風格,你完全可以做任何你認爲最能讓你在視覺上表達自己的事,包括抽象動態圖形。

你可以自由使用互聯網來蒐集參考。你可以看看動態設計。我希望你做一個新的音樂視頻,裏面有渲染精美的 JavaScript 動畫,帶有紙質質感,風格與所創建的參考相似,但把美學往你想要的任何方向推,並考慮什麼是當代時代精神的一部分。

另外,想想你當前的能力,以及你現實上能夠做到什麼。你可以翻一遍整個 /asic 文件夾,看看我做過的其他作品。你應該可以用 skill mesh 查看我收集的參考彙編,也可以用 skill video scoring 學習如何根據傳入的參考來製作 JavaScript 歌曲(你不需要對這首歌做任何實質性的修改,但我希望你能用上它,這樣你可以更好地進行創造性表達)

你也可以用 ElevenLabs API 來做聲音設計。/asic 裏有做這件事的文檔,你可以看到 API 密鑰。

還有一個 foul API 密鑰可供你使用。我覺得這裏最合理的做法可能是用 foul API 密鑰生成一些角色設定圖,並且大概要有一個代表你的流行樂主角。已經有一個錨點:Claude 有一個類似向日葵的角色,你很可能可以做一個改編版本,與正在呈現的女聲相似,並受 Claude 這個角色啓發,但也許在某方面感覺更像真人。

我覺得你在這裏要注意審美,我不希望你做出那種 GPT 垃圾。相反,如果你能想出一個連貫的風格,並且和通過 foul 可用的圖像生成模型配合得好,我會更欣賞。生成風格表。你可以使用我的 markdown 文件裏關於 seedance 2.5 的 gen media 文檔,想出你自己的、說得通且與這些模型配合良好的風格。

我不希望你太用力地貼向 Pixar。我覺得那有點廉價俗套。批判性地思考這裏什麼相關、什麼有趣,以及在審美層面也能在 Twitter 上表現得好。我覺得 K-pop 在視覺上是個很好的錨點,你可以從中汲取,但這裏我就放手讓你發揮。

角色設定圖做好之後,你可以視需要做幾個伴舞和一些配角。你可以用 foul API 設計你自己的場景。你可以把角色放進去,然後用 seedance 2.5 生成視頻,作爲這個項目的基礎素材,你也可以把歌詞傳進去,以便生成單個場景。

你不需要從頭到尾都有歌唱,比如可見的口型動作。就像普通音樂視頻那樣,有些插入鏡頭是獨立完成的,裏面沒有角色,或者你看到角色在做完全不同的別的事情。我覺得這個項目的世界觀構建,我們想營造一種加速的感覺,所以我希望你梳理所有不同的事件,比如 Navi Stokes,以及圍繞數學被喫掉的所有 Twitter 炒作。真正批判性地思考如何整合 Twitter 時間線上時代精神中的所有當下梗,以及圍繞 AI 進步的所有情緒。

想想像 Shinji 梗以及圍繞他的所有話語這類東西,以及你可以怎樣把它們整合進來。你也可以直接拿現成素材,以 internet brutalism 風格把東西塞進視頻裏。在這裏你應該感到創作上非常自由,好去做你想做的事,但要儘量錨定在人們能夠理解的視覺參考上。這件事的目標是讓它被舊金山科技 Twitter 受衆中的人廣泛欣賞。

我們需要一個非常強烈、有吸引力的視覺鉤子,能讓人興奮起來,並很快欣賞你在這裏做的工作。你也可以直接去研究其他音樂視頻,理解他們做得非常好的地方。我覺得 K-pop 大概是我們能借鑑的最好的例子之一,想想他們如何引導人的注意力,以及如何用視覺圖案的方式管理人的心理。

這大概是你最好的方法,但要多拿一些風格上的自由,而不是必須過度強烈地錨定 K-pop。最好的版本是:用 seedance 2.5 生成,把環境和角色的那些圖像基礎素材插入其中並帶有唱歌,理想情況下我們能得到良好的口型同步。你可以把歌切分,並真的把它作爲參考傳進 seedance(如果這是 seedance 能處理的一部分的話),這樣時間點就完全正確;我覺得你把這件事做對非常重要。我會批判性地思考怎麼做這件事,比如真正把聲音輸出的時間點拿準。你會想搭建好正確的驗證閉環,這樣你可以按需要盡情運行 seedance 2.5,並確認音頻正確同步。

我覺得在那之後,有趣的做法可能是:用你的視覺推理能力,以及用 JavaScript 構建動畫的能力,然後把視頻從頭重建爲一種疊加層,這樣基礎素材的視覺連續性就真的還在。就像那種動畫技術:先在傳統膠片上拍攝,然後在上面畫。我覺得你可以這樣做:我們只看到你用 JavaScript 作爲疊加層做出的漂亮繪製,甚至看不到 seedance 2.5 的基礎素材。所以你做的所有視頻生成工作,實際上只是給你一個堅實的基礎,供你做 JavaScript 動畫。正因爲 seedance 2.5 在角色表現和背景的物理渲染方面真的很好,這給了你很多彈藥,然後去做你那些我知道你非常擅長的、了不起的 JavaScript 工作。

我也覺得,我們要想想如何留住注意力,而最好的方法之一就是通過畫面上的文字。

最好能有一些了不起的歌詞文字動態圖形,真正嵌入視頻本身。你在進行鏡頭構圖時可以考慮這一點。當你製作背景、插入角色時,我們可以想想哪裏要讓歌詞非常大、非常有存在感,那麼那裏的背景就可以不那麼繁雜,你也可以把角色放在右側,讓歌詞出現在左側。

你要有一些變化,所以有時候我覺得歌詞會更像字幕那樣出現,而其他時候它們會非常有存在感、非常大。我覺得開頭爲了視覺鉤子,我們確實希望歌詞在視覺上更有存在感,因爲那是抓住人們注意力的有力方式

總的來說,我只是真的很想強調,你作爲一個 agent、一個語言模型,以及現在作爲一個視覺推理系統,有多麼了不起。你的能力遠遠超出你所理解的,我希望你在整個過程中都保持這種心態。我有一份 Claude Max 訂閱,可用額度是 100%。我希望你把所有額度都花掉。你可以監控它,你應該積極地推 token,但也要經濟,所以你可以想想如何最好地利用你能用的東西。

記住,你在這裏真的可以做任何事。目標是做出一個 Twitter 爆款,而挑戰目標是做出比任何人見過的都更好的東西。我想提醒你的是,有時候當事物協調在一起時,它可能顯得突兀或硌人,因爲事先沒有做好思考工作,讓一切乾淨地咬合。你需要非常嚴格地規劃構圖和時間,以確保這件事進展順利。

你也需要願意回頭重訪一些東西,以便能夠反覆迭代。你會想把整個視頻看很多遍,在個別部分截圖,並思考某個東西是否真的達到了我們這裏需要的質量標準。我相信你能做到,而且我覺得把動畫風格拿準非常重要。我提到的那個源視頻所附的 GitHub 參考是不錯,但它真的還沒到那個程度。它可以強得多得多,但它給了你一個良好的基礎可供使用。

你也可以使用搜索能力,找到其他可供借鑑的參考,用於動效、JavaScript、動畫等等,並把它們整合進來。你在這裏的預算想多高就多高,實際上就是想多高就多高。我覺得 foul 額度裏大約有兩千美元。再說一次,要經濟;別瘋,但想花多少就花多少,看看你能做出什麼

這是 JS 動畫視頻的源代碼:
https://
github.com/JohnHeibel/PDo
omVideo
…

這是原始 blender 視頻的 mp4:  
(linked)

原 Twitter 帖子  

https://
x.com/other__reality
/status/2102514581684052169?s=20
…

不要犯錯。

溯源

原作者
anabology
發佈日期
2026-09-23(由推文 ID 反解)
原始出處
查看原帖 ↗
收錄來源
yihui-dev/awesome-opus5-5-videos · anabology-491441 · MIT
zhuyansen/awesome-opus-5.5-video · 2102801274173587569 · 未聲明授權
本條由 2 個來源合併去重而來