generative AI Builder | Binto K Bino

Gen AI world builder

A tool for generating worlds and setting scene using Unity 3D and OpenAI API, making it easier for designers to create and set up scenery in unity

Working:

Essentially, we are asking GPT to return position, rotation and scale of objects to be placed in a unity scene using openai API.These objects to be placed are kept in a resources folder. The input prompt along with the prefab names and corresponding properties are sent to the API.

I have fine tuned two Openai gpt models by feeding them dataset made from unity scenes manually. One is used for placing objects in the scene whereas the other one is responsible for environmental set ups (sky, sunlight, placing ambient lights), based on the prompt input.