imageAssetGenerator

3-D asset generation from single view camera images

Since R2025a

Description

The imageAssetGenerator object generates 3-D assets from single view camera images by using a pretrained TripoSR 3-D asset generator model [1].

Note

This object requires an internet connection to download the TripoSR model for its first use. For more information on how to download the model, see Optional Set Up for Scenario Generation.

Creation

Syntax

assetGenerator = imageAssetGenerator

assetGenerator = imageAssetGenerator(Model=modelName)

Description

assetGenerator = imageAssetGenerator creates a default imageAssetGenerator object, assetGenerator, to generate 3-D assets from single view camera images.

assetGenerator = imageAssetGenerator(Model=modelName) creates an imageAssetGenerator object, assetGenerator, using the specified asset generator model, modelName.

Note

This object requires the Scenario Builder for Automated Driving Toolbox™ support package and a Deep Learning Toolbox™ license. You can install the Scenario Builder for Automated Driving Toolbox support package from the Add-On Explorer. For more information about installing add-ons, see Get and Manage Add-Ons.

Input Arguments

modelName — Name of 3-D asset generation model

"TripoSR" (default)

Name of the 3-D asset generation model, specified as "TripoSR". Currently, this function supports only the TripoSR lane detection model.

If you call the imageAssetGenerator function and the TripoSR model is not installed, the function opens the Optional Setup for Scenario Builder for Automated Driving Toolbox window, from which you can download and install the model. For more information on installing the model, see Optional Set Up for Scenario Generation.

This argument sets the Model property.

Output Arguments

assetGenerator — 3-D asset generator

imageAssetGenerator object

3-D asset generator, returned as an imageAssetGenerator object.

Properties

Model — Name of 3-D asset generation model

"TripoSR" (default)

This property is read-only after object creation. To set this property, use the modelName input argument when calling the imageAssetGenerator function.

Name of the lane detection model, represented as "TripoSR".

Object Functions

generate

Generate 3-D asset from single view camera image

Examples

Generate 3D Asset from Single View Camera RGB Image

Read a single view camera RGB image into the workspace.

I = imread("ObjaverseAssetImage.jpeg");
imshow(I)

Initialize the image asset generator object.

assetGenerator = imageAssetGenerator;

Generate an asset from the image by using the generate object function of the imageAssetGenerator object.

assetAttributes = generate(assetGenerator,I);

Create a surface mesh from the obtained asset attributes.

assetMesh = surfaceMesh(assetAttributes.vertices,assetAttributes.faces,VertexColors=assetAttributes.vertexColors);

Display the created surface mesh.

surfaceMeshShow(assetMesh,BackgroundColor="White")

References

[1] Tochilkin, Dmitry, David Pankratz, Zexiang Liu, Zixuan Huang, Adam Letts, Yangguang Li, Ding Liang, Christian Laforte, Varun Jampani, and Yan-Pei Cao. “TripoSR: Fast 3D Object Reconstruction from a Single Image.” arXiv, 2024. https://doi.org/10.48550/ARXIV.2403.02151.

Version History

Introduced in R2025a