18361616. Systems and Methods for Task Switching in Neural Network Processor simplified abstract (Apple Inc.)
Systems and Methods for Task Switching in Neural Network Processor
Organization Name
Inventor(s)
Erik K. Norden of San Jose CA (US)
Systems and Methods for Task Switching in Neural Network Processor - A simplified explanation of the abstract
This abstract first appeared for US patent application 18361616 titled 'Systems and Methods for Task Switching in Neural Network Processor
Simplified Explanation
Embodiments relate to managing tasks that, when executed by a neural processor circuit, instantiates a neural network. A neural task manager circuit within the neural processor circuit can switch between tasks in different task queues, each storing a reference to a task list for instantiating a neural network. Each task queue can also be assigned a priority parameter. The neural task manager circuit can switch between task queues according to the priority parameters for execution of tasks by the neural processor circuit.
- Neural task manager circuit manages tasks for instantiating a neural network.
- Task queues store references to task lists for neural network instantiation.
- Task queues can be assigned priority parameters.
- Neural processor circuit executes tasks from different task queues based on priority parameters.
- Neural processor circuit includes neural engine circuits for performing neural operations.
Potential Applications
- Artificial intelligence
- Machine learning
- Neural network training
Problems Solved
- Efficient task management for neural network instantiation
- Prioritization of tasks for optimal performance
Benefits
- Improved efficiency in neural network instantiation
- Better utilization of neural processor resources
- Enhanced performance in neural operations
Original Abstract Submitted
Embodiments relate to managing tasks that when executed by a neural processor circuit instantiates a neural network. A neural task manager circuit within the neural processor circuit can switch between tasks in different task queues. Each task queue is configured to store a reference to a task list of tasks for instantiating a neural network. Each task queue can also be assigned a priority parameter. While the neural processor circuit is executing tasks of a first task list and prior to completion of each task, the neural task manager circuit can switch between task queues according to the priority parameters for execution of tasks of a second task list by the neural processor circuit. The neural processor circuit includes one or more neural engine circuits that are configured to perform neural operations by executing the tasks assigned by the task manager.
