18742019. DISTRIBUTED ARCHITECTURE FOR FUSION-TRANSFORMER TRAINING ACCELERATION (Tata Consultancy Services Limited)

DISTRIBUTED ARCHITECTURE FOR FUSION-TRANSFORMER TRAINING ACCELERATION

Organization Name

Tata Consultancy Services Limited

Inventor(s)

Shruti Kunal Kunde of Thane (IN)

Ravi Kumar Singh of Thane (IN)

Chaman Banolia of Pune (IN)

Rekha Singhal of Thane (IN)

Balamuralidhar Purushothaman of Bangalore (IN)

Shailesh Shankar Deshpande of Pune (IN)

DISTRIBUTED ARCHITECTURE FOR FUSION-TRANSFORMER TRAINING ACCELERATION

This abstract first appeared for US patent application 18742019 titled 'DISTRIBUTED ARCHITECTURE FOR FUSION-TRANSFORMER TRAINING ACCELERATION

Original Abstract Submitted

The disclosure addresses problems associated with a systematic integration of multi-modal data for effective training, and handling of large volume of data because of high resolution of the multiple modalities. Embodiments herein provide a method and a system for a distributed training of a multi-modal data fusion transformer. Herein, a distributed training approach called a Distributed Architecture for Fusion-Transformer Training Acceleration (DAFTA) is proposed for processing large multimodal remote sensing data. DAFTA is enabled to handle any combination of remote sensing modalities. Additionally, similarity of feature space is leveraged to optimize the training process and to achieve the training with reduced data set which is equivalent to a complete data set. The proposed approach provides a systematic and efficient method for managing large sensing data and enables accurate and timely insights for various applications.