Name: 'Apple Glass' users may be able to manipulate AR images with any real object | AppleInsider
Brand: appleinsider.com
SKU: appleinsider-com-25
Availability: OnlineOnly

critic

'Apple Glass' users may be able to manipulate AR images with any real object | AppleInsider

preview

&nbsp;&nbsp;&nbsp;AppleInsider is supported by its audience and may earn commission as an Amazon Associate and affiliate partner on qualifying purchases. These affiliate partnerships do not influence our editorial content.Apple is researching technology to allow an "" user to not be constrained to fixed physical gestures or touch controls, and instead manipulate any object to alter what is visible on the headset. It's already possible to use app to show you a or an on before ever buying one. You can walk around a in the same way. You just can't do anything with these virtual objects. You can look, but you can't touch and that's fine, that's even impressive. But as becomes more part of our regular world, and as Apple else it does, it becomes a problem. With AR and especially with what Apple refers to as Mixed Reality (MR), it's great to be able to see an iPad Pro in front of you, but you need to be able to use it. You have to be able to pick up a virtual object and use it, or otherwise AR is no better than a 3D movie. Apple's proposed solution is described in "Manipulation of Virtual Objects using a Tracked Physical Object," a filed in January 2020 but only revealed this week. It suggests that truly mixing realities, in that the virtual object could be mapped onto an actual object in the real world. "Various electronic devices exist, such as head-mound devices (also known as headsets and HMDs)," begins the application, "with displays that present users with a computer-generated reality (CGR) environment in which they may be fully immersed in a surrounding physical environment, fully immersed in a virtual reality environment comprising virtual objects, or anywhere in between." "While direct manipulation of physical objects in the surrounding physical environment is available to users naturally, the same is not true for virtual objects in the CGR environment," it continues. "Lacking a means to directly interact with virtual objects presented to a user as part of a CGR environment limits a degree to which the virtual objects are integrated into the CGR environment. Thus, it may be desirable to provide users with a means of directly manipulating virtual objects presented as part of CGR environments." Maybe it wouldn't be practical to keep a life-size Lamborghini-shaped block of wood. And maybe it wouldn't be a lot of use to have a Mac Pro-shaped piece of fiberglass. But you could much more usefully have an iPad-shaped and iPad-sized object. Apple refers to the real-world object as a "proxy device," and says that the same camera system that are used to position virtual AR around the user can precisely track that. "Input is received from the proxy device using an input device of the proxy device that represents a request to create a fixed alignment between the virtual object and the virtual representation in a three-dimensional ("3-D") coordinate space defined for the content," says the patent application. "A position and an orientation of the virtual object in the 3-D coordinate space is dynamically updated using position data that defines movement of the proxy device in the physical environment," it continues. So if you are holding, say, a rectangular device, the AR/MR system can tell where it is, what orientation it has, what face is up, and so on. It can tell when you move or turn it, which means it knows exactly where to overlay the AR image. "The method involves presenting content including a virtual object and a virtual representation of a proxy device physically unassociated with an electronic device on a display of the electronic device," it continues. So to someone standing next to you, you're waving about a blank slate. But to you, it is an iPad Pro with all the controls and displays this means. In this sense, the idea is similar to the recent one about . The invention is credited to Austin C. Germer, and Ryan S. Burgoyne, the latter of whom was recently listed on a patent application covering .The concept is great, I'm looking forward to seeing what Apple comes up with.That said when they are for sale to the general public, there is one thing that is inevitable.I'd predict it will be within weeks, likely less than a month, the first person will crash their car because they were playing a game on the glasses while driving.&nbsp;Google R&amp;D photocopiers going full blast.Cool! Hope I’m alive to see it.Please enable JavaScript to comment&nbsp;An app called Diffusion Bee lets users run the Stable Diffusion machine learning model locally on their Apple Silicon Mac to create AI-generated art. Here's how to get started.Apple announced iCloud Shared Photo Library as part of iOS 16, but it appears that the feature won't arrive in the iOS 16 release on September 12.An SEC filing from Globalstar reveals that Apple plans to use 85% of its current and future network capacity for its services to iPhone 14 consumers, and pay for future satellite upgrades.Apple's iPhone 14 Pro and iPhone 14 Pro Max have arrived. Here's how they stack up versus the iPhone 13 Pro and Pro Max.Apple's iPhone 14 is aimed at about the same market that the iPhone SE targets. Here's how it compares to the third-generation iPhone SE.Apple reintroduced the Plus iPhone descriptor at its event on Wednesday with the introduction of the iPhone 14 Plus. Here's how it compares to the iPhone 14 Pro Max.Apple has launched its iPhone 14 range, but on the surface it's a tough compare to the iPhone 13. Here's what's different and if it's good enough for an upgrade.The Apple Watch Series 8 and Apple Watch Ultra are the company's newest wearable accessories, and these are the features that might tempt new buyers or Apple Watch Series 7 owners.&nbsp;Apple has shared a new video that explains how its new Crash Detection feature can detect serious car crashes and alert emergency responders automatically.An app called Diffusion Bee lets users run the Stable Diffusion machine learning model locally on their Apple Silicon Mac to create AI-generated art. Here's how to get started.Safari 16.0 has been released for Apple's ecosystem, with the latest version of the browser for iOS 16 now able to open AVIF images ahead of similar support in macOS Ventura and iPadOS.For 72 hours only, save $150 on Apple's upgraded MacBook Air M2 at Apple Authorized Reseller B&amp;H Photo. Plus, enjoy free expedited shipping in the contiguous U.S.Users who were trying to accept new App Store terms and conditions in the wake of the iOS 16 or iOS 15.7 updates were getting blocked by a recurring error.It's been a rocky road to the iOS 16 launch. Here are the high-profile features that didn't debut in the initial release of Apple's operating system.A future update to iOS 16 will make the iPhone even more environmentally friendly, with Clean Energy Charging prioritizing recharging at times when cleaner energy sources are available.In September 2017, Tim Cook said the iPhone X would "set the path for technology for the next decade." Halfway through that decade, it looks like Cook was right.An app called Diffusion Bee lets users run the Stable Diffusion machine learning model locally on their Apple Silicon Mac to create AI-generated art. Here's how to get started.Apple announced iCloud Shared Photo Library as part of iOS 16, but it appears that the feature won't arrive in the iOS 16 release on September 12.An SEC filing from Globalstar reveals that Apple plans to use 85% of its current and future network capacity for its services to iPhone 14 consumers, and pay for future satellite upgrades.It's been a rocky road to the iOS 16 launch. Here are the high-profile features that didn't debut in the initial release of Apple's operating system.Apple's annual update to its operating system brings new features and much-needed changes. Here are the stand-out features in iOS 16.Apple's "Far Out" event is on September 7. Beyond the new iPhone 14, here's what to expect from September's Apple event — and beyond.Apple's iOS 16 will make the iPhone more customizable than ever. This is the ultimate guide on how to make the iPhone a more personal device.The second-generation Razer Kishi is here for iPhone users with a new design, better buttons, and a companion app. How does it stack up to the Backbone One?Less an overhaul and more refining what's already in place, iOS 16 is all about personalization on top of a retained solid foundation.With the SwitchEasy four-in-one MagPower multi-charger, you can power up all your gear with a single device — including your Apple Watch with an Apple-certified puck.The Benks Grand Pro Headphone Stand for AirPods Max is a welcome upgrade over the original. However, it introduces complexity where there was none before — while also ignoring an obvious problem.Keep tabs on the air quality of your home — including potentially deadly radon levels — with the Airthings View Plus.Apple didn't make a Magic Keyboard for iPad mini 6, and Lululook's Magnetic Keyboard perhaps acts as a testament to why.{{ summary }}{{{ reviewStars.html }}}

&nbsp;&nbsp;&nbsp;AppleInsider is supported by its audience and may earn commission as an Amazon Associate and affiliate partner on qualifying purchases. These affiliate partnerships do not influence our editorial content.Apple is researching technology to allow an "" user to not be constrained to fixed physical gestures or touch controls, and instead manipulate any object to alter what is visible on the headset. It's already possible to use app to show you a or an on before ever buying one. You can walk around a in the same way. You just can't do anything with these virtual objects. You...

'Apple Glass' users may be able to manipulate AR images with any real object | AppleInsider

No article scores yet.

CRITIC REVIEWS

PUBLIC REVIEWS