How I made a mod using AI
For the 2 people who will get benefit out of this, and 3 others that might enjoy it. People who use AI to make mods take a lot of flack. So I thought I'd share the process of how I went about creating this mod with AI, in the hopes that it will enlighten some as to what kind of work goes into it. With pics!
(The mod - [I Can Climb Ladders Now](https://steamcommunity.com/sharedfiles/filedetails/?id=3787667088) )
Pic 2: How it started. I always go through research first. We start with a logfile and some exploration. No code or scripts created, no animation or pictures yet. Just research and exploration about how this might work, and a logfile to summarize findings. Also, whenever I start a new mod, which is a new chat session, I have to tell AI certain things we've learned before, but these things don't transfer from chat to chat, such as folder structure... and other odd things like how to do Sandbox options - it always gets these wrong.
Pic 3: More exploration and research. (note that 'interact' in my keybinds is G). AI is suggesting we find a safe spot on the roof before we initiate the climb - good idea. You'll note that at the bottom it says that new animations aren't necessary... yet.
Pic 4: Referencing other mods can be very useful. No need to spend half a day learning how to do something if someone else has already figured it out. Project Arcade is a great mod, btw. Check it out. PS: AI immediately understands references like "Grok".
Pic 5: Fucking Blender. I'd started the animations and at this point AI is walking me through it. It's a HUGE learning curve. Luckily I run a youtube channel and am pretty proficient with a video editor, so I'm familiar with keyed frames in a timeline.
Pic 1: (sorry this is out of order, I wanted this to be the thumbnail for this post). I would be trying to do something in Blender and AI would say, "Select only CTRL-armIK.R. Press I - Location & Rotation. Add CTRL-Fingers.R to the selection and..." And I'd be looking at this screen going, "Ok WHERE THE FUCK IS THAT???"
Pic 6: I would get very frustrated. And I had to start over a number of times.
Pic 7 (Part 1): With the animations done (or so I thought), we got into this workflow. AI doesn't analyze video very well and it takes forever. So I took clips from my Steam recordings, loaded them into Davinci Resolve, and went through them frame by frame to figure out how to fix problems. What were the problems? Matching the player animations to the world as the world moves about the player. In this pic, when I'm giving timecodes like 1:24, that means the 24th frame of the 2nd second. So yeah, frame by frame.
Pic 8 (Part 2): AI's response to me in Pic 7. We spent a VERY LONG TIME doing exactly this kind of work in this kind of workflow.
Pic 9: AI can inspect pictures and it's pretty good at figuring out what it is seeing. So I'd often share them to get my point across. In this pic I'm trying to figure out why the player ends the animation at least a foot (1/3 meter) off the ground, when the vanilla pose is (last pic on right) he's standing on the roof. Turns out I'd done the animation wrong - I didn't know the feet always have to be at z=0. So yeah, back to fucking Blender...
Pic 10: More workflow. I'd graduated from saying how many 'rungs' (ladder rungs - an easy visual to use) to actual measurements in meters.
Pic 11: AI had told me at one point I needed to go back to Blender to fix something, but I disagreed, told it why, and backed it up with pictures. Unfortunately you can't see those little pics as they're just thumbnails.
Pic 11b: okay I just added this. It's one of the little pics from Pic 11 - I'm trying to show AI that the ClimbOntoRoof animation begins in different locations depending on where you are when you click your interact key.
Pic 12: AI can be pretty witty sometimes, and it always gets references.
Pic 13: Ready for upload. This is one of the many things that AI does that's just annoying to do on your own. When you're finished with your mod, you promote it to your Workshop folder and update files like modinfo and other stuff. I just tell AI to do it.
Pic 14: When I was getting near the end of figuring out how animations worked with my world, I was trying to get everything lined up just perfect, so I put together these views from every ladder angle. First row, right hand high. Second row, left hand high. 3rd row, the descending slide. What was aggravating, is.. for example, look at the last row - in the 1st and 3rd pic, the left foot and hand seem to be wide. In the 2nd pic, the right hand seems to be wide. In the 4th pic, the right foot and hand seem to be wide. How the hell do you fix this? I forget actually. I think I just moved him closer to the ladder in the North and West ladders, and shifted him right on the South ladder.
Hope you enjoyed.