19014633. SYSTEM AND METHOD FOR CALIBRATING MOVING CAMERAS CAPTURING BROADCAST VIDEO (STATS LLC)

SYSTEM AND METHOD FOR CALIBRATING MOVING CAMERAS CAPTURING BROADCAST VIDEO

Organization Name

STATS LLC

Inventor(s)

Long Sha of Chicago IL US

Sujoy Ganguly of Chicago IL US

Xinyu Wei of Melbourne AU

Patrick Joseph Lucey of Chicago IL US

Aditya Cherukumudi of London GB

SYSTEM AND METHOD FOR CALIBRATING MOVING CAMERAS CAPTURING BROADCAST VIDEO

This abstract first appeared for US patent application 19014633 titled 'SYSTEM AND METHOD FOR CALIBRATING MOVING CAMERAS CAPTURING BROADCAST VIDEO

Original Abstract Submitted

A system and method of calibrating moving cameras capturing a sporting event is disclosed herein. A computing system retrieves a broadcast video feed for a sporting event. The broadcast video feed includes a plurality of video frames. The computing system labels, via a neural network, components of a playing surface captured in each video frame. The computing system matches a subset of labeled video frames to a set of templates with various camera perspectives. The computing system fits a playing surface model to the set of labeled video frames that were matched to the set of templates. The computing system identifies camera motion in each video frame using an optical flow model. The computing system generates a homography matrix for each video frame based on the fitted playing surface model and camera motion. The computing system calibrates each camera based on the homography matrix generated for each video frame.