How to Use the XVERSE 3D Gaussian Splatting UE Plugin

Jun 26, 2022 | Data Science

The XVERSE 3D-GS UE Plugin is a revolutionary tool designed for Unreal Engine 5, which allows for real-time visualization and manipulation of 3D scenes using a method called Gaussian Splatting. This guide will walk you through the steps to get it up and running on your system, while also addressing some common troubleshooting issues you might encounter along the way.

Getting Started with XVERSE 3D-GS UE Plugin

Here’s how you can get started with the plugin:

  • Ensure you have the necessary system requirements:
    • Windows 10 or 11
    • Unreal Engine (UE) version 5.1.x to 5.3.x
    • CUDA 11 or higher (if using the XV3DTools)
  • Download the plugin:
    1. Go to the GitHub Release page.
    2. Download the appropriate zip file for your version of Unreal Engine.
    3. Unzip the file and move the folder XV3DGS into your Plugins folder in your UE directory.
  • Import demo data to test:

How to Import Your Gaussian Splatting Model

Once you have your plugin installed, follow these steps to import your Gaussian model:

  1. After installing version 1.1.3 or later, you can drag and drop your .ply files directly into the Content Browser.
  2. Otherwise, use the Load Assets button from the navigation bar or navigate to Window > XV3DGS.
  3. Select the Load PLY button, and choose your .ply file. The system will automatically generate Levels of Detail (LOD) for your model.
  4. Drag the blueprint generated into your Level Viewport to visualize your Gaussian scene.

Local Training on Windows

If you want to train MP4 videos into Gaussian Splatting ply files using XV3DTools, follow these steps:

  1. Download XV3DTools (V1.1.1) from the provided links.
  2. Set the installation path and select the MP4 file you wish to process.
  3. Specify the output folder, ensuring all paths are free of special characters or non-English letters.
  4. Click the Start Training button, and monitor the process through advanced options if needed.

Understanding the Code: An Analogy to Cooking

Think of working with the XVERSE 3D-GS plugin like following a recipe in cooking. Every step in the coding process is akin to a step in a recipe that has its own purpose:

  • **Preparing Ingredients (Importing Models)**: Just as you gather ingredients before cooking, you need to import your models into the project.
  • **Cooking Techniques (Loading and Editing)**: Different methods like baking or boiling correspond to how you load, edit, or manipulate the models within Unreal Engine.
  • **Tasting the Dish (Rendering)**: The final output is like the taste of the dish—rendering actually visualizes your 3D scene, just like the final dish presentation. If it needs adjustments (like seasoning), you can tweak lighting or other parameters until it’s to your liking.

Troubleshooting Common Issues

If you encounter any issues while using the XVERSE 3D-GS UE Plugin, consider the following troubleshooting tips:

  • Ensure that all system requirements are met, especially the version of Unreal Engine and CUDA.
  • If the plugin crashes when loading files, recheck the file paths. Ensure there are no Chinese characters or special symbols.
  • For issues with GPU rendering, confirm that your graphics card supports CUDA 11 or higher.

For more insights, updates, or to collaborate on AI development projects, stay connected with fxis.ai.

Final Thoughts

At fxis.ai, we believe that such advancements are crucial for the future of AI, as they enable more comprehensive and effective solutions. Our team is continually exploring new methodologies to push the envelope in artificial intelligence, ensuring that our clients benefit from the latest technological innovations.

Stay Informed with the Newest F(x) Insights and Blogs

Tech News and Blog Highlights, Straight to Your Inbox