18348667. DEVICE AND METHOD FOR PARTITIONING ACCELERATOR AND BATCH SCHEDULING simplified abstract (Samsung Electronics Co., Ltd.)
Contents
DEVICE AND METHOD FOR PARTITIONING ACCELERATOR AND BATCH SCHEDULING
Organization Name
Inventor(s)
DEVICE AND METHOD FOR PARTITIONING ACCELERATOR AND BATCH SCHEDULING - A simplified explanation of the abstract
This abstract first appeared for US patent application 18348667 titled 'DEVICE AND METHOD FOR PARTITIONING ACCELERATOR AND BATCH SCHEDULING
Simplified Explanation
The patent application describes an electronic device and method for partitioning an accelerator and scheduling batches. The device includes processors and a memory storing instructions to perform the following steps:
- Partitioning the accelerator into partitions of different sizes based on resource utilization of the input batches.
- Determining correspondences between the sizes of the batches and the sizes of the partitions in the first partitioning.
- Determining the numbers of partitions for the respective sizes of the partitions based on the correspondences.
- Partitioning the accelerator into a second partitioning based on the determined numbers of the respective sizes of the partitions.
Potential applications of this technology:
- High-performance computing systems that utilize accelerators for parallel processing tasks.
- Data centers and cloud computing environments that require efficient resource allocation and scheduling for improved performance.
Problems solved by this technology:
- Efficient partitioning and scheduling of batches in an accelerator, optimizing resource utilization and improving overall system performance.
- Simplifying the process of determining the number and size of partitions based on the characteristics of the input batches.
Benefits of this technology:
- Improved performance and efficiency in parallel processing tasks by effectively utilizing the resources of the accelerator.
- Simplified and automated partitioning and scheduling process, reducing the need for manual optimization and configuration.
- Enhanced scalability and adaptability of the system by dynamically adjusting the partitioning based on the characteristics of the input batches.
Original Abstract Submitted
An electronic device and method for partitioning an accelerator and scheduling batches are disclosed. An electronic device includes one or more processors, and a memory storing instructions configured to cause the one or more processors to, for a first partitioning of an accelerator into partitions of different sizes, based on resource utilization of the partitions batch of different sizes input to the partition, determine correspondences between the sizes of the batches and the sizes of the partitions in the first partitioning, determine numbers of partitions for the respective determined sizes of the partitions based on the correspondences between the sizes of the batches and the sizes of the partitions in the first partitioning, and partition the accelerator into a second partitioning based on the determined numbers of the respective sizes of the partitions.
