Generating 3D Game Assets with ChatGPT and Shap-E

Aporia releases its latest market overview – 2024 AI Report: Evolution of Models & Solutions. In this tutorial, we learn how to create 3D game assets automatically using ChatGPT and Shap-E. We use the ChatGPT API to generate ideas for different game items and characters, which are then passed to Shap-E – a new model by OpenAI to generate 3D objects from text. The code is provided to convert the 3D models to standard 3D file formats such as glTF and obj, so they can be imported into popular game editors like Unity, Godot, and Unreal. While exciting, we are also introduced to the risks of bias and fairness issues arising from these AI tools, reminding us to be cautious when designing games with ambiguous prompts.