18934512. MULTI-CAMERA ENTITY TRACKING TRANSFORMER MODEL (NEC Laboratories America, Inc.)
MULTI-CAMERA ENTITY TRACKING TRANSFORMER MODEL
Organization Name
NEC Laboratories America, Inc.
Inventor(s)
Deep Patel of Franklin Park NJ US
Iain Melvin of Princeton NJ US
Alexandru Niculescu-mizil of Plainsboro NJ US
MULTI-CAMERA ENTITY TRACKING TRANSFORMER MODEL
This abstract first appeared for US patent application 18934512 titled 'MULTI-CAMERA ENTITY TRACKING TRANSFORMER MODEL
Original Abstract Submitted
Systems and methods for a multi-entity tracking transformer model (MCTR). To train the MCTR, processing track embeddings and detection embeddings of video feeds obtained from multiple cameras to generate updated track embeddings with a tracking module. The updated track embeddings can be associated with the detection embeddings to generate track-detection associations (TDA) for each camera view and camera frame with an association module. A cost module can calculate a differentiable loss from the TDA by combining a detection loss, a track loss and an auxiliary track loss. A model trainer can train the MCTR using the differentiable loss and contiguous video segments sampled from a training dataset to track multiple objects with multiple cameras.