20240037073. SYSTEM AND METHOD FOR AUTOMATICALLY MANAGING STORAGE RESOURCES OF A BIG DATA PLATFORM simplified abstract (The Toronto-Dominion Bank)
SYSTEM AND METHOD FOR AUTOMATICALLY MANAGING STORAGE RESOURCES OF A BIG DATA PLATFORM
Organization Name
Inventor(s)
GORDON MANWAY Lam of RICHMOND HILL (CA)
SARVJOT KAUR Kang of TORONTO (CA)
SYSTEM AND METHOD FOR AUTOMATICALLY MANAGING STORAGE RESOURCES OF A BIG DATA PLATFORM - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240037073 titled 'SYSTEM AND METHOD FOR AUTOMATICALLY MANAGING STORAGE RESOURCES OF A BIG DATA PLATFORM
Simplified Explanation
The abstract describes a computer-implemented method for automatically managing storage resources of a distributed file system. Here is a simplified explanation of the patent application:
- The method involves obtaining actual past storage usage data of a first directory from multiple directories in the distributed file system up to the current time.
- It also involves detecting a space quota limit for the first directory, which is associated with a pre-defined expected future time.
- From the actual past storage usage data, the method determines projected storage usage data of the first directory over a future time period.
- An aggregated correction coefficient is obtained, which indicates the aggregated projected storage usage needs of the remaining directories relative to the first directory.
- If the expected value of the projected storage usage data at the expected future time is inconsistent with the space quota limit, the method adjusts the space quota limit to a new quota limit based on the expected value weighted by the aggregated correction coefficient.
Potential applications of this technology:
- Efficient management of storage resources in distributed file systems.
- Automatic adjustment of space quota limits based on projected storage usage data.
- Optimization of storage allocation in a distributed file system.
Problems solved by this technology:
- Ensures that space quota limits are adjusted based on projected storage usage, preventing overutilization or underutilization of storage resources.
- Provides a proactive approach to managing storage resources, avoiding potential storage capacity issues.
Benefits of this technology:
- Improved storage resource management efficiency.
- Prevents storage capacity issues and potential data loss.
- Optimizes storage allocation, reducing wasted storage space.
- Automates the process of adjusting space quota limits, reducing manual intervention.
Original Abstract Submitted
there is provided a computer-implemented method for automatically managing storage resources of a distributed file system comprising: obtaining actual past storage usage data of a first directory from a plurality of directories of the distributed file system to a current time; detecting, a space quota limit for the first directory and associated with a pre-defined expected future time; determining from the actual past storage usage data, projected storage usage data of the first directory over a future time period; obtaining an aggregated correction coefficient providing an indication of aggregated projected storage usage needs of remaining other directories relative to the first directory; in response to determining an expected value of the projected storage usage data at the expected future time is inconsistent with the space quota limit, adjusting the space quota limit to a new quota limit based on the expected value weighted by the aggregated correction coefficient.
