18409018. USING A LANGUAGE MODEL TO LOCALIZE AND ROUTE PLAN FOR NAVIGATION SYSTEMS AND APPLICATIONS (NVIDIA Corporation)
Contents
USING A LANGUAGE MODEL TO LOCALIZE AND ROUTE PLAN FOR NAVIGATION SYSTEMS AND APPLICATIONS
Organization Name
Inventor(s)
Denis Laprise of Palo Alto CA (US)
Mark Wheeler of Saratoga CA (US)
USING A LANGUAGE MODEL TO LOCALIZE AND ROUTE PLAN FOR NAVIGATION SYSTEMS AND APPLICATIONS
This abstract first appeared for US patent application 18409018 titled 'USING A LANGUAGE MODEL TO LOCALIZE AND ROUTE PLAN FOR NAVIGATION SYSTEMS AND APPLICATIONS
Original Abstract Submitted
Approaches presented herein provide for the generation of a tokenized description of an environment for use in making decisions with respect to the environment. In particular, a large language model (LLM) can be used to generate a tokenized text string representation of an environment using sensor information captured at a specific location, as well as information about the semantics, topology, and geometry of the environment. A similarity-based search can be performed against tokenized descriptions for various locations until a single high-quality match is identified, and the geographic position of the match can be inferred to correspond to the current position of a vehicle that captured the sensor data. The current location and tokenized description can also be provided to a language model, along with a road-level route plan, in order to generate more detailed routing information that is optimized based on the additional information available in the tokenized description for a sequence of goals corresponding to the route plan.
