SCENE MODELING USING TRAJECTORY PREDICTIONS AND TOKENIZED FEATURES

Abstract: in various examples, systems and methods are disclosed relating to generating scene mode conditioned trajectory predictions that are usable for interfacing with an llm. a system can obtain traffic scene data associated with movement of one or more agents relative to a vehicle navigating through an environment. the system can encode the traffic scene data to determine latent representations of the movement of the one or more agents relative to the vehicle navigating through the environment. then the system can determine a joint scene mode distribution based at least on the latent representations. the system can then decode the joint scene mode distribution into one or more trajectory predictions and one or more categorical predictions for each agent of the one or more agents.

Inventor(s): Yuxiao CHEN, Sander TONKENS, Marco PAVONE

CPC Classification: B60W30/095 (CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT)

Search for rejections for patent application number 20250171017