17934171. SYSTEMS AND METHODS FOR INFERENCE SYSTEM CACHING simplified abstract (SAMSUNG ELECTRONICS CO., LTD.)
SYSTEMS AND METHODS FOR INFERENCE SYSTEM CACHING
Organization Name
Inventor(s)
Mehran Elyasi of St. Paul MN (US)
Rekha Pitchumani of Oak Hill VA (US)
Tong Zhang of Mountain View CA (US)
Heekwon Park of San Jose CA (US)
SYSTEMS AND METHODS FOR INFERENCE SYSTEM CACHING - A simplified explanation of the abstract
This abstract first appeared for US patent application 17934171 titled 'SYSTEMS AND METHODS FOR INFERENCE SYSTEM CACHING
Simplified Explanation
The abstract describes a system and method for inference using an embedding table. It involves forming a culled index vector with a first index and requesting a weight vector corresponding to that index.
- Culled index vector formation with a first index
- Requesting weight vector based on the first index
- First index being a culled element within the index vector
Potential Applications
- Natural language processing
- Machine learning algorithms
- Recommendation systems
Problems Solved
- Efficient inference using embedding tables
- Simplified indexing for weight vectors
Benefits
- Improved performance in inference tasks
- Reduced computational complexity
- Enhanced accuracy in predictions
Original Abstract Submitted
A system and method for inference using an embedding table. In some embodiments, the method includes forming a culled index vector including a first index, and requesting a weight vector corresponding to the first index. The first index may be a first element of a first index vector, the first index being culled within the culled index vector.
