An open source framework for AI assisted VR mods?
So, it seems like there's quite a lot of activity lately for VR mods coded with AI assistance.
I used to be a software dev, although I'm not involved with VR modding so forgive me if my question is naive or unrealistic.
I wonder if it would be a good idea for people to come together and make a shared open source framework for these kinds of VR mods. I think this would improve the confidence that users could have in these mods, as there would be more eyes on the parts that are common across mods.
I'm imagining something like this:
- The VR / player facing layer. This is the part that handles the controllers, buttons, head tracking, loading up config files, maybe a GUI for settings, different headsets and runtimes, etc. This is the shared project and could be coded mostly without AI. It has a standardised interface to connect to the second layer, below.
- A per-game layer that maps and connects the inputs from the first layer into the relevant sections of the game, and also handles stereo rendering and other game specific hacks like converting third person to first person cameras etc. This is probably the part where AI coding tools would be useful but optional.
So, for a dev interested in writing a VR mod, they need to download the project for the first layer, and then start to investigate their desired game and figure out the methods to manipulate the camera, rendering and gun/body movement. Using that information, they can write the 2nd layer specific to that game.
In the meantime, the first layer is getting contributions and development from the community, and various techniques, scripts, AI prompts etc can be shared to help devs who want to try to make a mod for another game.
It's a fairly similar approach to UEVR, VorpX and Luke Ross, where there's a common framework across any game, and then devs can figure out the specific things needed to make it work well with each particular game.