Today the U.S. Patent and Trademark Office officially granted Apple a patent that relates to next-gen wearable user input devices with haptic feedback elements incorporated to create an immersive computing environment, especially for virtual reality applications. The patent covers next-gen VR gloves, partial gloves and other wearable attachments that could be used with VR applications and beyond.
Apple’s granted patent describes systems, devices, and techniques related to wearable user input devices, such as a glove, patch, thimble, partial hand covering, glasses, clothing, and/or other wearable items attachable to a user.
The user input device includes a flexible fabric and/or conformable material configured to attach to a user at one or more locations. For example, the flexible fabric may include a first portion (or first attachment piece) configured to attach to a user at a first location and a second portion (or second attachment piece) configured to attach to a user at a second location. The first and second portions may expand and contract to conform the flexible fabric to the user. The device facilitates an immersive environment within which a user may interact with a computing device.
The flexible fabric or other material of the user input device may define a wearable item (e.g., such as a glove or separate attachment pieces configured to conform to a user’s hand) that includes an array of sensors or measurement circuitry that detect motion of the user input device as it moves through a three-dimensional space.
The user input device may be positioned or moved in, or moved through, a variety of input configurations (e.g., including motion patterns, gestures, signs, finger or hand positions, or the like) that are used to provide input to a computing device free of any defined or static user input surface.
In one embodiment, a first portion of the flexible fabric may be moved relative to a second portion of the flexible fabric to define an input configuration. The input configuration may correspond to a predetermined function executable by an interconnected computing device. Accordingly, the user input device may be positioned or moved into an input configuration in the air and/or relative to any appropriate or adjacently disposed surface to control a computing device. In this regard, the user input device may be suitable for use with various electronic devices (e.g., a computer, laptop, tablet, smart phone, or the like).
The user input device may be used to control or interact with a virtual environment represented on a virtual reality device. The virtual reality device may include any appropriate device configured to create a visually immersive three-dimensional environment.
For example, the virtual reality device may be defined by glasses, goggles, headsets, or the like that are configured to encompass or substantially surround a user’s eyes to create a sensory experience that simulates a user’s presence in a virtual environment.
Apple’s patent FIG. 1 below depicts an example user input device #104 which may include measurement circuitry to determine a position and/or input configuration of the user input device. The user input device may also include a haptic feedback structure configured to provide haptic feedback based on the identified input configuration of the user input device and/or in response to an instruction from an associated computing device.
The user input device may include a flexible fabric #128 configured to attach to a user in any appropriate manner such as a glove or other wearable item that is attachable to a user to create an immersive environment within which a user may interact with a computing device. In some instances, the flexible fabric may form a set of attachment piece that individually attach to a user’s fingers.
Apple’s patent FIGS. 4A-4D below depict example user input devices 404a, 404b, 404c, and 404d which may detect an input configuration for controlling a computing device. The user input devices may include similar software, firmware, and/or hardware components that provide haptic feedback structures, primary sensing regions, secondary sensing regions, strain-sensitive elements, capacitive sensors, and so on.
Patent FIGS. 5A-5C above depict example user input devices 504a, 504b, and 504c, may include various communication modules, antennas, and/or other appropriate features to receive electrical power and data communication from the docking stations 508a-508c. This may allow the user input devices 504a-504c to operate free of a power source or processing unit directly attached, or integrated within, the user input devices 504a-504c.
The docking station may include a wrist band, watch, patch, or other electronic device. In some cases, the docking station may be configured to engage or store a respective one of the user input devices 504a-504c (or portions thereof) during period of non-use. This may enhance the adaptability and portability of the user input devices 504a-504c.
In Apple’s patent FIG. 8 below depicts an example computing system #100 including the user input device and a computing device #108. The user input device #104 may be configured to be used with a variety of electronic devices. For example, the computing device 108 may be substantially any type of electronic device operable to receive user input, including a virtual reality device.
Such input may facilitate the device’s operation, such as executing a predetermined function in response to the input. Some examples of electronic devices may include a desktop computer, laptop, smart phone, portable media player, or the like.
Other examples of electronic devices may include wearable devices (including watches, glasses, rings, or the like), health monitoring devices (including pedometers, heart rate monitors, or the like), and other electronic devices including digital cameras, printers, scanners, security systems or devices, or electronics for automobiles, among other electronic devices.
Patent FIGS. 9A and 9B above depict the user input device #104 typing on a virtual keyboard. For example, the user input device may be manipulated into various input configurations relative to an array of input regions #908 in order to generate a user input signal corresponding to a keyboard command.
Patent FIGS. 10A and 10B above depict the user input device 104 selecting a file represented by a computing device. In this regard, the user input device 104 may be manipulated into various input configurations to indicate a selection of information represented by a computing device.
Patent FIGS. 13A and 13B above depict the user input device #104 resembling holding an Apple Pencil, although no pencil is present. In this regard, the user input device may be manipulated into various input configurations to control a pencil or other drawing implement represented by a computing device.
Apple’s patent FIGS. 14A and 14B below depict the user input device #104 resembling holding a baseball bat, although no baseball bat is present. In this regard, the user input device may be manipulated into various input configurations to control a function of a computer application executing on a computing device, such as an application directed to playing baseball.
(Click on image to Enlarge)
Patent FIGS. 15A and 15B above depict the user input device #104 resembling holding a video game controller, although no video game controller is present. In this regard, the user input device may be manipulated into a variety of input configurations to control a function of a computer application that is executing on a computing device, such as an application directed to racing a car.
In Apple’s Patent FIG. 18A below, the user input device #804a may include a light source configured to display a user input surface #882a having an array of user input regions contained therein (such as the user input region #886a) at a surface of the flexible fabric #828a. Each user input region may include various markings, symbols, or other indicia to indicate a function associated with the user input region. For example, in the depicted embodiment of FIG. 18A, the user input region #886a may be configured to resemble an arrow, for example, for controlling an aspect of a computing device.
In patent FIG. 18B, the user input device #804b may include a light source configured to project a user input surface #882b having an array of user input regions contained thereon (such as the user input region #886b) at any adjacently disposed surface (such as surface 890). Each user input region may include various markings, symbols, or other indicia to indicate a function associated with the user input region. For example, in the indicated embodiment of FIG. 18B, the user input region #886b may be configured to resemble an arrow, for example, for controlling an aspect of a computer application depicted at the display.
The position of the user input device #804b may be detected in relation to the user input surface #882b projected onto a surface #890. Based on the position of the user input device a user input signal may be generated to control a computing device.
In the latter patent figures 20A and 20B above Apple doesn’t explain the devices that the glove is interacting with. With these two figures, Apple spends more time discussing magnetic fields with the magnets using ferrofluid. The input devices are to be used within a virtual reality environment to control various elements within a VR environment.
Additionally, or alternatively, a virtual reality device may be a computing device configured to create a holographic projection in real space as shown in patent FIGS. 19A and 19B below.
For more details, review Apple’s granted patent 11,144,121.
From out Archives: Other VR Glove Patent Reports
01: Apple Wins Patent for Advanced VR Glove that could be used in Gaming, Education and Military Training
02: Apple wins a major Mixed Reality Glove Patent that uses Multi-Segment Force Sensors and much more
03: Apple Wins Patent for Haptic Feedback Gloves for VR Games that could be played on a Mac
