18377973. DATA RECONCILIATION ARCHITECTURE FOR IMPROVED FAULT TOLERANCE (BANK OF AMERICA CORPORATION)
DATA RECONCILIATION ARCHITECTURE FOR IMPROVED FAULT TOLERANCE
Organization Name
Inventor(s)
Arpan Agrawal of McKinney TX US
Dinesh Kumar Kanchi Sridharan of Arakkonam IN
DATA RECONCILIATION ARCHITECTURE FOR IMPROVED FAULT TOLERANCE
This abstract first appeared for US patent application 18377973 titled 'DATA RECONCILIATION ARCHITECTURE FOR IMPROVED FAULT TOLERANCE
Original Abstract Submitted
In conventional networked computing systems, stream-processing software is utilized to handle real-time data feeds. For example, a stream-processing software may sort incoming data feeds into data logs, which are then consumed by various application servers within the computing system. However, this consumption process is susceptible to failure as application servers often fail to consume a full payload of data comprising a particular message. As such, a need exists for a streaming architecture with improved fault tolerance. The system provided herein solves the problem via a reliable streaming process, which regularly generates partitions within a series of data lakes. As streaming data is received, the payloads are synced into the different data lakes based on metadata associated with the streaming data. The system can then perform individual quality checks on each partition of data, enabling the system to continuously monitor data quality over time.