18332273. METHOD AND APPRATUS WITH NEURAL RENDERING BASED ON VIEW AUGMENTATION simplified abstract (SAMSUNG ELECTRONICS CO., LTD.)

From WikiPatents
Jump to navigation Jump to search

METHOD AND APPRATUS WITH NEURAL RENDERING BASED ON VIEW AUGMENTATION

Organization Name

SAMSUNG ELECTRONICS CO., LTD.

Inventor(s)

Young Chun Ahn of Suwon-si (KR)

Nahyup Kang of Suwon-si (KR)

Seokhwan Jang of Suwon-si (KR)

Jiyeon Kim of Suwon-si (KR)

METHOD AND APPRATUS WITH NEURAL RENDERING BASED ON VIEW AUGMENTATION - A simplified explanation of the abstract

This abstract first appeared for US patent application 18332273 titled 'METHOD AND APPRATUS WITH NEURAL RENDERING BASED ON VIEW AUGMENTATION

Simplified Explanation

The patent application describes a method and apparatus for neural rendering based on view augmentation. The method involves training a neural scene representation (NSR) model using original training images of a target scene, generating augmented images by warping the original training images to create new views, performing background-foreground segmentation on the images to generate segmentation masks, and training the NSR model for volume rendering of the target scene.

  • Neural rendering method based on view augmentation
  • Training NSR model using original and augmented images
  • Background-foreground segmentation for segmentation masks
  • Configuring NSR model for volume rendering of target scene

Potential Applications

The technology can be applied in various fields such as virtual reality, gaming, medical imaging, and architectural visualization.

Problems Solved

This technology solves the problem of efficiently rendering complex scenes from different viewpoints using neural networks.

Benefits

The benefits of this technology include improved rendering quality, enhanced realism in virtual environments, and faster rendering speeds.

Potential Commercial Applications

Potential commercial applications include software development for virtual reality experiences, video game development, medical imaging software, and architectural design tools.

Possible Prior Art

One possible prior art for this technology could be research papers or patents related to neural rendering, view augmentation, and scene representation models.

Unanswered Questions

How does this technology compare to traditional rendering methods?

This technology offers a more efficient and realistic rendering solution compared to traditional methods by leveraging neural networks for scene representation and view augmentation.

What are the limitations of this technology in terms of scene complexity and rendering speed?

The technology may face limitations when dealing with extremely complex scenes or when real-time rendering speeds are required. Further research and optimization may be needed to address these challenges.


Original Abstract Submitted

A method and apparatus for neural rendering based on view augmentation are provided. A method of training a neural scene representation (NSR) model includes: receiving original training images of a target scene, the original training images respectively corresponding to base views of the target scene; generating augmented images of the target scene by warping the original training images, the augmented images respectively corresponding to new views of the target scene; performing background-foreground segmentation on the original training images and the augmented images to generate segmentation masks; and training a neural scene representation (NSR) model to be configured for volume rendering of the target scene by using the original training images, the augmented images, and the segmentation masks.