Apple inc. (20240126496). Coordinating Adjustments to Composite Graphical User Interfaces Generated by Multiple Devices simplified abstract

Coordinating Adjustments to Composite Graphical User Interfaces Generated by Multiple Devices

Organization Name

apple inc.

Inventor(s)

Brian D. Pietsch of Foster City CA (US)

Jianhong Jiang of Santa Clara CA (US)

Kevin W. Mar of Sunnyvale CA (US)

Thomas R. Powell of San Francisco CA (US)

Glenn A. Anderson of Campbell CA (US)

Coordinating Adjustments to Composite Graphical User Interfaces Generated by Multiple Devices - A simplified explanation of the abstract

This abstract first appeared for US patent application 20240126496 titled 'Coordinating Adjustments to Composite Graphical User Interfaces Generated by Multiple Devices

Simplified Explanation

The abstract describes a system where a user device and an accessory device work together to create a composite graphical user interface. The user device receives configuration data from the accessory device, generates a display buffer based on this data, and sends video frames to the accessory device. The accessory device then combines these video frames with its own generated GUI to create the composite GUI.

• User device and accessory device cooperate to create a composite graphical user interface.
• User device receives configuration data from accessory device.
• User device generates display buffer and sends video frames to accessory device.
• Accessory device combines received video frames with its own GUI to create composite GUI.

Potential Applications

The technology described in this patent application could be applied in various scenarios, such as:

• Collaborative work environments where multiple users interact with a shared GUI.
• Gaming systems where the main screen displays the game world and an accessory device shows additional information or controls.
• Interactive displays in public spaces where users can interact with different parts of the GUI on separate devices.

Problems Solved

This technology solves several problems, including:

• Efficient use of screen real estate by allowing multiple devices to work together to display a single GUI.
• Seamless transitions between different view areas within the GUI display.
• Enhanced user experience by providing a larger, more interactive interface.

Benefits

Some benefits of this technology include:

• Improved collaboration and communication in shared work environments.
• Enhanced gaming experiences with additional information or controls on a separate device.
• More engaging and interactive public displays with multiple touchpoints for users.

Potential Commercial Applications

The technology could be commercially applied in:

• Multi-user interactive displays for retail or entertainment venues.
• Gaming peripherals that enhance gameplay by offloading certain controls to a separate device.
• Collaborative workstations in office settings for more efficient teamwork.

Possible Prior Art

One possible prior art for this technology could be the concept of dual-screen setups in gaming or productivity environments, where users connect multiple monitors to a single device for expanded screen real estate. However, the specific coordination and generation of a composite GUI between a user device and an accessory device as described in this patent application may be a novel approach.

Unanswered Questions

How does the system handle synchronization between the user device and accessory device to ensure smooth transitions between view areas?

The abstract mentions transitions between different view areas within the GUI display, but it does not provide details on how this synchronization is achieved.

What types of devices are compatible with this system, and are there any limitations on the size or capabilities of the accessory device?

The abstract mentions configuration data defining the maximum GUI display area of the accessory device, but it does not specify the range of devices that can be used in this system or any restrictions on their features.

Original Abstract Submitted

in some implementations, a user device can coordinate adjustments to a composite gui generated in cooperation with an accessory device that presents the composite graphical user interface. for example, the user device can receive configuration data that defines the maximum gui display area (e.g., size, dimensions) of the accessory device, various view areas within the gui display area of the accessory device into which the user device can render guis, and/or transitions between the various view areas. the user device can generate a display buffer based on the maximum gui display area, generate a graphical user interface in an area of the buffer corresponding to a current view area specified by the accessory device, and send to the accessory device video frames corresponding to the display buffer. the accessory device can generate a composite gui based on the received video frames that include the user device generated gui.