Favicon of SAM 3D Objects

SAM 3D Objects

An AI 3D reconstruction model turns masked objects in one image into textured 3D models with pose and layout, with downloadable code and weights.

SAM 3D Objects reconstructs objects in 3D from a single image. It's for researchers and developers who want to recover object geometry and appearance from photographs, including cluttered scenes with partly hidden objects.

  • Textured object reconstruction: Turn an object selected by an image mask into a 3D model with shape, texture, and pose.
  • Multiple objects and layout: Reconstruct several objects from the same image, including their placement in the scene.
  • Challenging photographs: Process small objects, unusual poses, and objects partly obscured by other items in natural images.
  • Human and object alignment: Combine object reconstructions with results from the separate SAM 3D Body model in a shared coordinate frame.
  • Gaussian splat export: Save reconstructed Gaussian splats as PLY files for use outside the model's inference workflow.

The Python code and model weights are available to download and run on your own hardware. A separate online demo provides a hosted way to try the model. Both the code and checkpoints use the custom SAM License.

Similar to SAM 3D Objects