RedditPP Mascot

RedditPP

r/AIToolBench • … • u/lisandroskar

Best workflow to turn a real concert crowd video into AI fans singing my song?

Hi! I’m a musician and I’m trying to solve a very specific AI video problem. I have a real reference video filmed from the stage looking at the front row / barricade of a concert. What I want is to preserve the feeling, camera movement and realism of that footage, but generate/transform the people in the crowd so they look like real fans singing along to MY song. Basically: **Real concert reference video → AI-generated/modified fans → same concert energy and camera feel → fans accurately singing my actual song.** The final result should feel like authentic fan footage from one of my shows, NOT like an AI music video or a talking/singing avatar. I’ve already tried several approaches: Kling — results can look good, but I’m limited to short clips and couldn’t find a convincing way to continue them. Higgsfield Magnific Seedance Using the original video as a motion/reference video. Providing the song + lyrics. Providing only the song. Separating the vocals from the instrumental and feeding ONLY the vocal track, hoping to improve lip-sync. The biggest problem is that the models either: don’t accurately follow the singing, introduce errors/change the music, lose the realism/movement of the original crowd, or work for a short clip but can’t maintain the result. I’m totally open to ComfyUI or a multi-step workflow. It doesn’t have to be a one-click commercial tool.

— 0