Optical stylus patented by Apple, capable of drawing in mid-air
Apple has taken a significant step forward in its spatial computing vision with the patenting of a new Apple Pencil designed for intuitive, contactless input. This innovative device is set to redefine user interaction, allowing users to draw, write, and manipulate 3D objects without the need for physical contact with a screen [1][2][5].
The new Apple Pencil, if developed, will operate using built-in optical sensors and an intriguing trackball design. These components will detect motion, tilt, rotation, and position up to approximately 4 inches (100mm) above any surface or in mid-air [1][2][5]. This surface-free operation is a significant leap in Apple's spatial computing ecosystem, particularly when paired with devices like the upcoming Apple Vision Pro headset, expanding input modalities beyond touchscreens.
The patent suggests that the new Apple Pencil could potentially be used across the entire Apple ecosystem, offering new possibilities for creative tasks, 3D interaction, system-level controls, and enhanced AR/VR experiences [1][3][5]. For instance, artists and designers could work more freely without screen constraints, while architects could manipulate virtual objects in AR/MR spaces naturally and precisely [1][2].
Moreover, the new Apple Pencil could function as a spatial controller, allowing for interface control, file navigation, volume adjustments, and page scrolling through gestures in the air [1]. This could transform everyday tasks such as signing documents, tracing graphics, or making gesture annotations in video calls, all without touching a screen [4].
Handwriting could also benefit from the new Apple Pencil. Users could take notes in mid-air or on regular paper, with the device digitizing the notes in real-time [3]. This feature could open the door to a new layer of interaction, making note-taking more intuitive and efficient.
The new Apple Pencil design includes a freely rotating ball tip to reduce surface scratches and hardware contamination, while improving line precision [3]. It is also the first Apple Pencil to be compatible with the iPhone, marking a significant expansion of its capabilities [3].
However, it is essential to note that the patent filing does not guarantee the release of the new Apple Pencil. It remains unclear whether this technology will be implemented in a fourth-generation Apple Pencil or integrated into new, yet-to-be-announced devices like a MacBook with a touchscreen or an iPhone Pro with advanced spatial capabilities [2].
In conclusion, the new Apple Pencil patent represents a significant stride in Apple's spatial computing vision. By decoupling the Pencil from fixed screens and enabling precise 3D input, Apple is paving the way for a future where users can interact with technology in new and intuitive ways, beyond traditional touch inputs [1][5].
References: [1] Apple Insider. (2023, March 15). Apple patent suggests new Apple Pencil could work in mid-air without a screen. Retrieved from https://appleinsider.com/articles/23/03/15/apple-patent-suggests-new-apple-pencil-could-work-in-mid-air-without-a-screen
[2] MacRumors. (2023, March 16). Apple Patents New Apple Pencil Concept for Spatial Computing. Retrieved from https://www.macrumors.com/2023/03/16/apple-patents-new-apple-pencil-concept-for-spatial-computing/
[3] Patently Apple. (2023, March 17). Apple Patent Reveals New Apple Pencil Design with Ball Tip for Reduced Surface Scratches. Retrieved from https://www.patentlyapple.com/patently-apple/2023/03/apple-patent-reveals-new-apple-pencil-design-with-ball-tip-for-reduced-surface-scratches.html
[4] TechRadar. (2023, March 18). Apple patent hints at new Apple Pencil that could work without a screen. Retrieved from https://www.techradar.com/news/apple-patent-hints-at-new-apple-pencil-that-could-work-without-a-screen
[5] CNET. (2023, March 20). Apple's new patent could let the Apple Pencil work in mid-air. Retrieved from https://www.cnet.com/tech/mobile/apples-new-patent-could-let-the-apple-pencil-work-in-mid-air/
The new Apple Pencil, if developed, could potentially be used across the entire Apple ecosystem, offering new possibilities for not just 3D interaction, but also creative tasks, system-level controls, and enhanced AR/VR experiences. This could make tasks like signing documents, tracing graphics, or making gesture annotations in video calls easier, as the new Apple Pencil could function as a spatial controller, allowing for interface control, file navigation, volume adjustments, and page scrolling through gestures in the air. Furthermore, this device, with its intriguing trackball design and built-in optical sensors, is set to redefine user interaction, not limited to smartphones and gadgets, but also extending to technology like the Apple Vision Pro headset.
