18610453. COMPUTER-READABLE RECORDING MEDIUM STORING TRACKING PROGRAM, TRACKING METHOD, AND INFORMATION PROCESSING APPARATUS simplified abstract (Fujitsu Limited)

From WikiPatents
Jump to navigation Jump to search

COMPUTER-READABLE RECORDING MEDIUM STORING TRACKING PROGRAM, TRACKING METHOD, AND INFORMATION PROCESSING APPARATUS

Organization Name

Fujitsu Limited

Inventor(s)

Fan Yang of Edogawa (JP)

COMPUTER-READABLE RECORDING MEDIUM STORING TRACKING PROGRAM, TRACKING METHOD, AND INFORMATION PROCESSING APPARATUS - A simplified explanation of the abstract

This abstract first appeared for US patent application 18610453 titled 'COMPUTER-READABLE RECORDING MEDIUM STORING TRACKING PROGRAM, TRACKING METHOD, AND INFORMATION PROCESSING APPARATUS

Simplified Explanation

This method tracks individuals in a 3D space using multi-camera RGB videos by segmenting video streams, detecting head bounding boxes, associating them into 2D tracklets, and generating 3D tracklets through triangulation.

  • Online segmentation of video streams using sliding windows
  • Detection of head bounding boxes in each frame of videos
  • Multiple Object Tracking on each camera view to associate bounding boxes into 2D tracklets
  • Cross-view association to consolidate 2D tracklets from different views into a unified cluster
  • Triangulation geometry applied to each cluster to generate 3D tracklets
  • Calculation of Euclidean distance between short-term 3D tracklets to connect them into long-term 3D tracklets

Potential Applications

This technology can be used for surveillance systems, crowd monitoring, sports analysis, and virtual reality applications.

Problems Solved

This technology addresses the challenge of tracking individuals accurately in a 3D space using multi-camera setups.

Benefits

The method offers a comprehensive and efficient approach to tracking individuals in a 3D space, providing accurate 3D trajectories using RGB videos.

Commercial Applications

    • 3D Trajectory Tracking System for Surveillance**
    • Crowd Monitoring System for Events**
    • Sports Analysis Software for Coaches**
    • Virtual Reality Environment Tracking**

Questions about 3D trajectory tracking

How does this technology improve surveillance systems?

This technology enhances surveillance systems by accurately tracking individuals in a 3D space, providing detailed trajectories for monitoring and analysis.

What are the potential applications of this method in sports analysis?

This method can be used in sports analysis to track players' movements in 3D space, providing valuable insights for coaches and analysts.


Original Abstract Submitted

This method estimates 3D trajectories of observed individuals in a 3D world coordinate system, using RGB videos captured by cameras and associated camera parameters. The process involves an online segmentation of video streams using sliding windows during the video capture phase. Within each window, head bounding boxes are detected from each frame of videos. Multiple Object Tracking is employed on each camera view to associate these bounding boxes into 2D tracklets. A cross-view association is implemented to consolidate identical person's 2D tracklets from different views into a unified cluster. Triangulation geometry is applied to each cluster, resulting in the generation of 3D tracklets for each individual. The Euclidean distance between short-term 3D tracklets of adjacent sliding windows is calculated, facilitating the connection of these short-term 3D tracklets into long-term 3D tracklets. This methodology offers a comprehensive and efficient approach to tracking individuals in a 3D space using multi-camera RGB videos.