MyLab – A Mixed Reality Chemistry App for the HoloLens
From DSC:
After reviewing the article and video (below), it will be interesting to see how machine-to-machine (M2M) communications will be used in combination with augmented reality — and perhaps with virtual reality and mixed reality as well. That is, get to within a certain range of an object, and something automatically happens on your mobile device or your head mounted device. Perhaps that’s the sort of thing Apple is building into their next smart phone. It would sure open up some interesting learning and entertainment-related experiences — as such new affordances could help foster anticipation and curiosity, while grabbing someone’s attention.
This type of thing could easily become a piece of the future of art and creativity.
Mini-Mirages Emerge in an Augmented Reality Art Exhibition — from creators.vice.com by Nathaniel Ainley
Adrien M and Claire B’s latest series of installations basically looks like Harry Potter magic come to life.
Excerpt:
Even in its early beta stages, the new live exhibition from digital artists Adrien M and Claire B will have you rubbing your eyes in disbelief. Throughout their Mirages & Miracles display, the artist duo uses wondrous applications of augmented reality to create an orchestra of new installations, both small and large. Much like their live dance performance work at BAM, the new bundle merges the digital with the material, blurring the lines between what is real and what is fake. The multi-pronged ensemble uses augmented drawings, holographic illusions, virtual-reality headsets, and large-scale projections to create a number of unbelievable scenarios “that take root in both the mirage and the miracle,” according to the duo.
Mirages & miracles, premier aperçu… from Adrien M & Claire B on Vimeo.
Adobe unveils new Microsoft HoloLens and Amazon Alexa integrations — from geekwire.com by Nat Levy
Introducing the AR Landscape — from medium.com by Super Ventures
Mapping out the augmented reality ecosystem
Alibaba leads $18M investment in car navigation augmented reality outfit WayRay — from siliconangle.com by Kyt Dotson
Excerpt:
WayRay boasts the 2015 launch of Navion, what it calls the “first ever holographic navigator” for cars that uses AR technology to project a Global Positioning System, or GPS, info overlay onto the car’s windshield.
Just like a video game, users of the GPS need only follow green arrows projected as if onto the road in front of the car providing visual directions. More importantly, because the system displays on the windscreen, it does not require a cumbersome headset or eyewear worn by the driver. It integrates directly into the dashboard of the car.
The system also recognizes simple voice and gesture commands from the driver — eschewing turning of knobs or pressing buttons. The objective of the system is to allow the driver to spend more time paying attention to the road, with hands on the wheel. Many modern-day onboard GPS systems also recognize voice commands but require the driver to glance over at a screen.
Viro Media Is A Tool For Creating Simple Mobile VR Apps For Businesses — from uploadvr.com by Charles Singletary
Excerpt:
Viro Media is supplying a platform of their own and their hope is to be the simplest experience where companies can code once and have their content available on multiple mobile platforms. We chatted with Viro Media CEO Danny Moon about the tool and what creators can expect to accomplish with it.
Listen to these podcasts to dive into virtual reality — from haptic.al by Deniz Ergürel
We curated some great episodes with our friends at RadioPublic
Excerpt:
Virtual reality can transport us to new places, where we can experience new worlds and people, like no other. It is a whole new medium poised to change the future of gaming, education, health care and enterprise. Today we are starting a new series to help you discover what this new technology promises. With the help of our friends at RadioPublic, we are curating a quick library of podcasts related to virtual reality technology.
Psychologists using virtual reality to help treat PTSD in veterans — from kxan.com by Amanda Brandeis
Excerpt:
AUSTIN (KXAN) — Virtual reality is no longer reserved for entertainment and gamers, its helping solve real-world problems. Some of the latest advancements are being demonstrated at South by Southwest.
Dr. Skip Rizzo directs the Medical Virtual Reality Lab at the University of Southern California’s Institute for Creative Technologies. He’s helping veterans who suffer from post-traumatic stress disorder (PTSD). He’s up teamed with Dell to develop and spread the technology to more people.
NVIDIA Jetson Enables Artec 3D, Live Planet to Create VR Content in Real Time — from blogs.nvidia.com
While VR revolutionizes fields across everyday life — entertainment, medicine, architecture, education and product design — creating VR content remains among its biggest challenges.
Excerpt:
At NVIDIA Jetson TX2 launch [on March 7, 2017], in San Francisco, [NVIDIA] showed how the platform not only accelerates AI computing, graphics and computer vision, but also powers the workflows used to create VR content. Artec 3D debuted at the event the first handheld scanner offering real-time 3D capture, fusion, modeling and visualization on its own display or streamed to phones and tablets.
Project Empathy
A collection of virtual reality experiences that help us see the world through the eyes of another
Excerpt:
Benefit Studio’s virtual reality series, Project Empathy is a collection of thoughtful, evocative and surprising experiences by some of the finest creators in entertainment, technology and journalism.
Each film is designed to create empathy through a first-person experience–from being a child inside the U.S. prison system to being a widow cast away from society in India. Individually, each of the films in this series presents its filmmaker’s unique vision, portraying an intimate experience through the eyes of someone whose story has been lost or overlooked and yet is integral to the larger story of our global society. Collectively, these creatively distinct films weave together a colorful tapestry of what it means to be human today.
Work in a high-risk industry? Virtual reality may soon become part of routine training — from ibtimes.cok.uk by Owen Hughes
Immersive training videos could be used to train workers in construction, mining and nuclear power.
At Syracuse University, more students are getting ahold of virtual reality — from dailyorange.com by Haley Kim
As Instructors Experiment With VR, a Shift From ‘Looking’ to ‘Interacting’ — from edsurge.com by Marguerite McNeal
Excerpt:
Most introductory geology professors teach students about earthquakes by assigning readings and showing diagrams of tectonic plates and fault lines to the class. But Paul Low is not most instructors.
“You guys can go wherever you like,” he tells a group of learners. “I’m going to go over to the epicenter and fly through and just kind of get a feel.”
Low is leading a virtual tour of the Earth’s bowels, directly beneath New Zealand’s south island, where a 7.8 magnitude earthquake struck last November. Outfitted with headsets and hand controllers, the students are “flying” around the seismic hotbed and navigating through layers of the Earth’s surface.
Low, who taught undergraduate geology and environmental sciences and is now a research associate at Washington and Lee University, is among a small group of profs-turned-technologists who are experimenting with virtual reality’s applications in higher education.
These University Courses Are Teaching Students the Skills to Work in VR — from uploadvr.com
Excerpt:
“As virtual reality moves more towards the mainstream through the development of new, more affordable consumer technologies, a way needs to be found for students to translate what they learn in academic situations into careers within the industry,” says Frankie Cavanagh, a lecturer at Northumbria University. He founded a company called Somniator last year with the aim not only of developing VR games, but to provide a bridge between higher education and the technology sector. Over 70 students from Newcastle University, Northumbria University and Gateshead College in the UK have been placed so far through the program, working on real games as part of their degrees and getting paid for additional work commissioned.
Working with VR already translates into an extraordinarily diverse range of possible career paths, and those options are only going to become even broader as the industry matures in the next few years.
Scope AR Brings Live, Interactive AR Video Support to Caterpillar Customers — from augmented.reality.news by Tommy Palladino
Excerpt:
Customer service just got a lot more interesting. Construction equipment manufacturer Caterpillar just announced official availability of what they’re calling the CAT LIVESHARE solution to customer support, which builds augmented reality capabilities into the platform. They’ve partnered with Scope AR, a company who develops technical support and training documentation tools using augmented reality. The CAT LIVESHARE support system uses Scope AR’s Remote AR software as the backbone.
New virtual reality tool helps architects create dementia-friendly environments — from dezzen.com by Jessica Mairs
Visual showing appearance of a room without and with the Virtual Reality Empathy Platform headset
Video via:
Acer’s Windows Holographic headset will ship to developers this month — from theverge.com by Nick Statt
Stryker is using Microsoft’s HoloLens to design operating rooms of the future — from digitaltrends.com by Mark Coppock
Excerpt:
Augmented reality has a number of increasingly important applications in a variety of industries, from engineering to retail to interior design. One of the most exciting applications of AR, and the one that promises perhaps the most immediate impact on our lives, is in medicine, where AR can help educate, diagnose, and even treat disease in new and innovative ways.
Microsoft’s HoloLens AR solution is perhaps the most advanced today in terms of becoming a part of the real world, even while it’s not yet a retail option aimed at consumers. Global medical technology company Stryker, which is using HoloLens to redesign the operating room, provides a clear example of the potential of AR in this setting.
From DSC:
Microsoft uses the term “mixed reality” when they are discussing their Hololens product:
Using HoloLens and Stryker’s new By Design solution, hospital stakeholders are now able to envision the ideal operating room configuration with the power of holograms and the benefit of mixed reality.
Microsoft Accelerates HoloLens V3 Development, Sidesteps V2 — from thurrott.com by Brad Sams
Excerpt:
Back when the first version of Hololens came out, Microsoft created a roadmap that highlighted several release points for the product. This isn’t unusual, you start with the first device, second generation devices are typically smaller and more affordable and then with version three you introduce new technology that upgrades the experience; this is a standard process path in the technology sector. Microsoft, based on my sources, is sidelining what was going to be version two of HoloLens and is going straight to version three.
…
While some may see this as bad news that a cheaper version of HoloLens will not arrive this year or likely next year, by accelerating the technology that will bring us the expanded field of view with a smaller footprint, the new roadmap allows for a device that is usable in everyday life to arrive sooner.
Microsoft is playing for the long-term with this technology to make sure they are well positioned for the next revolution in computing. By adjusting their path today for HoloLens, they are making sure that they remain the segment leader for years to come.
CES 2017: Intel’s VR visions — from jwtintelligence.com by Shepherd Laughlin
The company showed off advances in volumetric capture, VR live streaming, and “merged reality.”
Excerpt (emphasis DSC):
Live-streaming 360-degree video was another area of focus for Intel. Guests were able to watch a live basketball game being broadcast from Indianapolis, Indiana, choosing from multiple points of view as the action moved up and down the court. Intel “will be among the first technology providers to enable the live sports experience on multiple VR devices,” the company stated.
After taking a 3D scan of the room, Project Alloy can substitute virtual objects where physical objects stand.
From DSC:
If viewers of a live basketball game can choose from multiple points of view, why can’t remote learners do this as well with a face-to-face classroom that’s taking place at a university or college? Learning from the Living [Class] Room.
From CES 2017: Introducing DAQRI’s Smart Glasses™
Excerpt:
Data visualization, guided work instructions, remote expert — for use in a variety of industries: medical, aviation and aerospace, architecture and AEC, lean manufacturing, engineering, and construction.
Third-party Microsoft HoloLens-based mixed reality headsets coming soon, prices to start at $299 — from bgr.in by Deepali Moray
Microsoft has partnered with companies including Dell and Acer which will release their own HoloLens compatible devices.
Excerpt:
The company said that it is teaming up with the likes of Dell, HP, Lenovo and Acer, which will release headsets based on the HoloLens technology. “These new head-mounted displays will be the first consumer offerings utilizing the Mixed Reality capabilities of Windows 10 Creators Update,” a Microsoft spokesperson said. Microsoft’s partner companies for taking the HoloLens technology forward include Dell, HP, Lenovo, Acer, and 3 Glasses. Headsets by these manufacturers will work the same way as the original HoloLens but carry the design and branding of their respective companies. While the HoloLens developer edition costs a whopping $2999 (approximately Rs 2,00,000), the third-party headsets will be priced starting $299 (approximately Rs 20,000).
Verto Studio 3D App Makes 3D Modeling on HoloLens Easy — from winbuzzer.com by Luke Jones
The upcoming Verto Studio 3D application allows users to create 3D models and interact with them when wearing HoloLens. It is the first software of its kind for mixed reality.
Excerpt:
How is The Immersive Experience Delivered?
Tethered Headset VR – The user can participate in a VR experience by using a computer with a tethered VR headset (also known as a Head Mounted Display – HMD) like Facebook’s Oculus Rift, PlayStation VR, or the HTC Vive. The user has the ability to move freely and interact in the VR environment while using a handheld controller to emulate VR hands. But, the user has a limited area in which to move about because they are tethered to a computer.
Non-Tethered Headset VR/AR – These devices are headsets and computers built into one system, so users are free of any cables limiting their movement. These devices use AR to deliver a 360° immersive experience. Much like with Oculus Rift and Vive, the user would be able to move around in the AR environment as well as interact and manipulate objects. A great example of this headset is Microsoft’s HoloLens, which delivers an AR experience to the user through just a headset.
Mobile Device Inserted into a Headgear – To experience VR, the user inserts their mobile device into a Google Cardboard, Samsung Gear 360°, or any other type of mobile device headgear, along with headphones if they choose. This form of VR doesn’t require the user to be tethered to a computer and most VR experiences can be 360° photos, videos, and interactive scenarios.
Mobile VR – The user can access VR without any type of headgear simply by using a mobile device and headphones (optional). They can still have many of the same experiences that they would through Google Cardboard or any other type of mobile device headgear. Although they don’t get the full immersion that they would with headgear, they would still be able to experience VR. Currently, this version of the VR experience seems to be the most popular because it only requires a mobile device. Apps like Pokémon Go and Snapchat’s animated selfie lens only require a mobile device and have a huge number of users.
Desktop VR – Using just a desktop computer, the user can access 360° photos and videos, as well as other VR and AR experiences, by using the trackpad or computer mouse to move their field of view and become immersed in the VR scenario.
New VR – Non-mobile and non-headset platforms like Leap Motion use depth sensors to create a VR image of one’s hands on a desktop computer; they emulate hand gestures in real time. This technology could be used for anything from teaching assembly in a manufacturing plant to learning a step-by-step process to medical training.
VR/AR Solutions
Goggles that are worn, while they are “Oh Myyy” awesome, will not be the final destination of VR/AR. We will want to engage and respond, without wearing a large device over our eyes. Pokémon Go was a good early predictor of how non-goggled experiences will soar.
Elliott Masie
Top 8 VR & AR predictions for 2017 — from haptic.al by Christine Hart
Excerpt:
Education will go virtual
Similar to VR for brand engagement, we’ve seen major potential for delivering hands-on training and distance education in a virtual environment. If VR can take a class on a tour of Mars, the current trickle of educational VR could turn into a flood in 2017.
Published on Dec 26, 2016
Top 10 Virtual Reality Predictions For 2017 In vTime. Its been an amazing year for VR and AR. New VR and AR headsets, ground breaking content and lots more. 2017 promises to be amazing as well. Here’s our top 10 virtual reality predictions for the coming year. Filmed in vTime with vCast. Sorry about the audio quality. We used mics on Rift and Vive which are very good on other platforms. We’ve reported this to vTime.
Addendums
AR becomes the killer app for smartphones
Mixed reality is coming in 2017! Here’s what you need to know — from linkedin.com by Keith Curtin
Excerpts:
A hybrid of both AR & VR, Mixed Reality (MR) is far more advanced than Virtual Reality because it combines the use of several types of technologies including sensors, advanced optics and next gen computing power. All of this technology bundled into a single device will provide the user with the capability to overlay augmented holographic digital content into your real-time space, creating scenarios that are unbelievably realistic and mind-blowing.
How does it work?
Mixed Reality works by scanning your physical environment and creating a 3D map of your surroundings so the device will know exactly where and how to place digital content into that space – realistically – while allowing you to interact with it using gestures. Much different than Virtual Reality where the user is immersed in a totally different world, Mixed Reality experiences invite digital content into your real-time surroundings, allowing you to interact with them.
Mixed reality use cases mentioned in the article included: