International business machines corporation (20240095234). DATA INGESTION TO AVOID CONGESTION IN NOSQL DATABASES simplified abstract
Contents
- 1 DATA INGESTION TO AVOID CONGESTION IN NOSQL DATABASES
- 1.1 Organization Name
- 1.2 Inventor(s)
- 1.3 DATA INGESTION TO AVOID CONGESTION IN NOSQL DATABASES - A simplified explanation of the abstract
- 1.4 Simplified Explanation
- 1.5 Potential Applications
- 1.6 Problems Solved
- 1.7 Benefits
- 1.8 Potential Commercial Applications
- 1.9 Possible Prior Art
- 1.10 Original Abstract Submitted
DATA INGESTION TO AVOID CONGESTION IN NOSQL DATABASES
Organization Name
international business machines corporation
Inventor(s)
Peng Hui Jiang of Beijing (CN)
DATA INGESTION TO AVOID CONGESTION IN NOSQL DATABASES - A simplified explanation of the abstract
This abstract first appeared for US patent application 20240095234 titled 'DATA INGESTION TO AVOID CONGESTION IN NOSQL DATABASES
Simplified Explanation
The abstract describes a method, computer program product, and computer system for optimizing database access patterns based on collected traffic and analyzed database transaction logs.
- Traffic is collected against a NoSQL database by an activity collector.
- Database transaction logs are periodically extracted and analyzed.
- The collected traffic and analyzed database transaction logs are used to build a knowledge base of database access patterns.
- Current traffic is captured to compute an activity threshold.
- Traffic is directed to a workload processor based on the activity threshold.
- Traffic is directed to an intensive insert/update/delete (IUD) processor if the activity threshold exceeds a configured threshold.
- Temporary shards are generated along with adaptive keys and indexes in response to the intensive IUD processor traffic.
- The intensive IUD processor traffic is redirected to the temporary shards while the activity threshold exceeds the configured threshold.
Potential Applications
This technology could be applied in optimizing database performance and workload distribution in large-scale systems.
Problems Solved
This technology solves the problem of inefficient database access patterns and workload management in high-traffic environments.
Benefits
The benefits of this technology include improved database performance, better resource utilization, and enhanced scalability in handling heavy workloads.
Potential Commercial Applications
Optimizing database access patterns and workload distribution can be valuable in industries such as e-commerce, finance, and social media platforms.
Possible Prior Art
One possible prior art could be the use of machine learning algorithms to optimize database performance based on historical data and traffic patterns.
Unanswered Questions
How does this technology handle security and privacy concerns in collecting and analyzing database traffic?
This article does not address the specific security measures implemented to protect sensitive data during the traffic collection and analysis process.
What are the potential limitations or challenges in implementing this technology in real-world systems?
The article does not discuss any potential obstacles or difficulties that may arise when deploying this technology in production environments, such as compatibility issues with existing systems or scalability concerns.
Original Abstract Submitted
method, computer program product, and computer system are provided. traffic is collected against a nosql database by an activity collector. a database transaction log is periodically extracted and analyzed. the collected traffic and the analyzed database transaction log are input to building a knowledge base of database access patterns. current traffic is captured and used to compute an activity threshold. traffic is directed to a workload processor based on the activity threshold. traffic is directed to an intensive insert/update/delete (iud) processor in response to the activity threshold exceeding a configured threshold. a plurality of temporary shards is generated along with an adaptive key and adaptive index in the plurality of temporary shards. the intensive iud processor traffic is re-directed to the plurality of temporary shards while the activity threshold exceeds the configured threshold.
