17736312. ELECTRONIC DEVICE AND OPERATING METHOD WITH MODEL CO-LOCATION simplified abstract (SAMSUNG ELECTRONICS CO., LTD.)
ELECTRONIC DEVICE AND OPERATING METHOD WITH MODEL CO-LOCATION
Organization Name
Inventor(s)
ELECTRONIC DEVICE AND OPERATING METHOD WITH MODEL CO-LOCATION - A simplified explanation of the abstract
This abstract first appeared for US patent application 17736312 titled 'ELECTRONIC DEVICE AND OPERATING METHOD WITH MODEL CO-LOCATION
Simplified Explanation
The abstract describes an electronic device and method for co-locating models on an accelerator based on their computational characteristics and affinity.
- The electronic device has processors that analyze computational characteristics of models being located to an accelerator.
- It determines an affinity, representing the utilization of the accelerator, based on the computational characteristics of two co-located models.
- The two models with high affinity are then co-located on the accelerator.
Potential Applications
- This technology can be applied in various fields that utilize models and accelerators, such as machine learning, data analysis, and simulations.
- It can optimize the performance and efficiency of the accelerator by co-locating models with high affinity, leading to faster processing and reduced resource consumption.
Problems Solved
- Co-locating models on an accelerator can improve performance, but it is challenging to determine which models should be co-located.
- This technology solves the problem by analyzing the computational characteristics of models and determining their affinity, allowing for efficient co-location on the accelerator.
Benefits
- Improved performance: Co-locating models with high affinity on the accelerator can enhance processing speed and overall performance.
- Resource optimization: By co-locating models efficiently, the electronic device can make better use of the accelerator's resources, reducing waste and improving efficiency.
Original Abstract Submitted
An electronic device to co-locating models and a method of operating the electronic device is provided. The electronic device includes one or more of processors configured to analyze computational characteristics in response to a plurality of models being located to an accelerator, determine an affinity representing a utilization of the accelerator in response to two models among the plurality of models being co-located based on the computational characteristics of the plurality of models, and co-locate the two models among the plurality of models to the accelerator based on the affinity.
