US Patent Application 17723022. SYSTEM AND METHOD FOR NETWORK INTERFACE CONTROLLER BASED DATA DEDUPLICATION simplified abstract
Contents
SYSTEM AND METHOD FOR NETWORK INTERFACE CONTROLLER BASED DATA DEDUPLICATION
Organization Name
Inventor(s)
BORIS Glimcher of Tel Aviv-Yafo (IL)
SYSTEM AND METHOD FOR NETWORK INTERFACE CONTROLLER BASED DATA DEDUPLICATION - A simplified explanation of the abstract
- This abstract for appeared for US patent application number 17723022 Titled 'SYSTEM AND METHOD FOR NETWORK INTERFACE CONTROLLER BASED DATA DEDUPLICATION'
Simplified Explanation
This abstract describes methods and systems for managing data storage in a distributed system. It introduces a data processing system that includes a network interface controller (NIC) which presents emulated storage devices for data storage. These emulated storage devices utilize the storage resources of actual storage devices. The NIC and the storage devices implement a distributed deduplication process.
In this process, the NIC divides the data into smaller chunks and generates unique fingerprints for each chunk. These fingerprints are then sent to the storage, which compares them against the fingerprints of already stored chunks. If a fingerprint does not match any existing chunk, the storage requests the corresponding chunk from the NIC. The NIC only provides the requested chunks to the storage and discards the rest.
Overall, this system aims to efficiently manage data storage in a distributed environment by eliminating duplicate chunks of data and only storing unique chunks.
Original Abstract Submitted
Methods and systems for managing storage of data in a distributed system is disclosed. To manage storage of data in a distributed system, a data processing system may include a network interface controller (NIC). The NIC may present emulated storages that may be used for data storage. The emulated storage devices may utilize storage resources of storage devices. The NIC and the storage devices may implement a distributed deduplication process. The NIC may segment data into chunks and obtain fingerprints of the chunks. The fingerprints may be provided to the storage which may check the fingerprints against fingerprints of already stored chunks. The storage may request the chunks corresponding to the fingerprints that did not match any fingerprints of the already stored chunks. The NIC may provide only those requested chunks to the storage before discarding all of the chunks.
