AREA: How would you describe the opportunity for Augmented Reality in 2017? SAM MURLEY: I think it’s huge — almost unprecedented — and I believe the tipping point will happen sometime this year. This tipping point has been primed over the past 12 to 18 months with large investments in new startups, successful pilots in the enterprise, and increasing business opportunities for providers and integrators of Augmented Reality. During this time, we have witnessed examples of proven implementations – small scale pilots, larger scale pilots, and companies rolling out AR in production — and we should expect this to continue to increase in 2017. You can also expect to see continued growth of assisted reality devices, scalable for industrial use cases such as manufacturing, industrial, and services industries as well as new adoption of mixed reality and augmented reality devices, spatially-aware and consumer focused for automotive, consumer, retail, gaming, and education use cases. We’ll see new software providers emerge, existing companies taking the lead, key improvements in smart eyewear optics and usability, and a few strategic partnerships will probably form.
AREA: Do you have visibility into all the different AR pilots or programs that are going on at GE? SAM MURLEY:
…
At the 2016 GE Minds + Machines conference, our Vice President of GE Software Research, Colin Parris, showed off how the Microsoft HoloLens could help the company “talk” to machines and service malfunctioning equipment. It was a perfect example of how Augmented Reality will change the future of work, giving our customers the ability to talk directly to a Digital Twin — a virtual model of that physical asset — and ask it questions about recent performance, anomalies, potential issues and receive answers back using natural language. We will see Digital Twins of many assets, from jet engines to or compressors. Digital Twins are powerful – they allow tweaking and changing aspects of your asset in order to see how it will perform, prior to deploying in the field. GE’s Predix, the operating system for the industrial Internet, makes this cutting-edge methodology possible. “What you saw was an example of the human mind working with the mind of a machine,” said Parris. With Augmented Reality, we are able to empower the workforce with tools that increase productivity, reduce downtime, and tap into the Digital Thread and Predix. With Artificial Intelligence and Machine Learning, Augmented Reality quickly allows language to be the next interface between the Connected Workforce and the Internet of Things (IoT). No keyboard or screen needed.
From DSC: I also believe that the tipping point will happen sometime this year. I hadn’t heard of the concept of a Digital Twin — but I sense that we’ll be hearing that more often in the future.
With Artificial Intelligence and Machine Learning, Augmented Reality quickly allows language to be the next interface between the Connected Workforce and the Internet of Things (IoT). No keyboard or screen needed.
From DSC:
I then saw the concept of the “Digital Twin” again out at:
Breaking through the screen — from medium.com by Evan Helda Excerpt (emphasis DSC ):
Within the world of the enterprise, this concept of a simultaneous existence of “things” virtually and physically has been around for a while. It is known as the “digital twin”, or sometimes referred to as the “digital tapestry” (will cover this topic in a later post). Well, thanks to the internet and ubiquity of sensors today, almost every “thing” now has a “digital twin”, if you will. These “things” will embody this co-existence, existing in a sense virtually and physically, and all connected in a myriad of ways. The outcome at maturity is something we’ve yet to fully comprehend.
11 Ed Tech Trends to Watch in 2017 — from campustechnology.com by Rhea Kelly — with Susan Aldridge, Gerard Au, myself, Marci Powell, & Phil Ventimiglia Five higher ed leaders analyze the hottest trends in education technology this year.
From DSC: I greatly enjoyed this project and appreciated being able to work with Rhea, Susan, Gerard, Marci, and Phil.
Fifty years since the inception of CES, “consumer electronics” doesn’t begin to describe the full scope of the event.
“It’s no longer a technology show; it’s a connected life show and an advertising and media show,” said Shawn DuBravac of CTA, the trade organization that organizes CES. And it changes quickly: three years ago, he said, 20% of this year’s exhibitors didn’t exist.
This year, among big tech companies Amazon was the clear winner—though Amazon itself kept a low profile, letting others announce a multitude of new uses for Alexa, its virtual assistant.
Electric and self-driving cars were everywhere. Taking a page from Apple and Microsoft, which pulled out of CES years ago, Tesla sat out the conference as rival auto makers tried to mount convincing challenges to its dominance of the electric car market.
What about exciting new “gadgets”? Farhad Manjoo of the New York Times declared them “gone” in December, killed by the iPhone and cheap knockoffs. Category-changing devices were in short supply at the show, and Alexa, this year’s most talked-about product, was actually an invisible service.
But there were signs that Internet of Things products that had once been isolated were talking to each other in interesting new ways. And devices aimed at specific needs and populations—from new mothers to vacationers to the disabled—showed that gadgets might not be done for just yet.
Addendum:
Tech Stock Roundup: AR/VR and Self Driving Cars Dominate CES— from zacks.com by Sejuti Banerjea
Excerpt:
As most of us were expecting, the show was dominated by virtual/augmented reality (VR/AR) and self driving cars, two areas where new technology was showcased and important collaborations announced. Some other developments involved Amazon’s Alexa, 5G technology from Intel and Qualcomm and robots from Panasonic and Honda.
CES 2017: Intel’s VR visions — from jwtintelligence.com by Shepherd Laughlin The company showed off advances in volumetric capture, VR live streaming, and “merged reality.”
Excerpt (emphasis DSC):
Live-streaming 360-degree video was another area of focus for Intel. Guests were able to watch a live basketball game being broadcast from Indianapolis, Indiana, choosing from multiple points of view as the action moved up and down the court.Intel “will be among the first technology providers to enable the live sports experience on multiple VR devices,” the company stated.
After taking a 3D scan of the room, Project Alloy can substitute virtual objects where physical objects stand.
From DSC: If viewers of a live basketball game can choose from multiple points of view, why can’t remote learners do this as well with a face-to-face classroom that’s taking place at a university or college? Learning from the Living [Class] Room.
Data visualization, guided work instructions, remote expert — for use in a variety of industries: medical, aviation and aerospace, architecture and AEC, lean manufacturing, engineering, and construction.
The company said that it is teaming up with the likes of Dell, HP, Lenovo and Acer, which will release headsets based on the HoloLens technology. “These new head-mounted displays will be the first consumer offerings utilizing the Mixed Reality capabilities of Windows 10 Creators Update,” a Microsoft spokesperson said. Microsoft’s partner companies for taking the HoloLens technology forward include Dell, HP, Lenovo, Acer, and 3 Glasses. Headsets by these manufacturers will work the same way as the original HoloLens but carry the design and branding of their respective companies. While the HoloLens developer edition costs a whopping $2999 (approximately Rs 2,00,000), the third-party headsets will be priced starting $299 (approximately Rs 20,000).
Verto Studio 3D App Makes 3D Modeling on HoloLens Easy— from winbuzzer.com by Luke Jones The upcoming Verto Studio 3D application allows users to create 3D models and interact with them when wearing HoloLens. It is the first software of its kind for mixed reality.
Excerpt: How is The Immersive Experience Delivered?
Tethered Headset VR – The user can participate in a VR experience by using a computer with a tethered VR headset (also known as a Head Mounted Display – HMD) like Facebook’s Oculus Rift, PlayStation VR, or the HTC Vive. The user has the ability to move freely and interact in the VR environment while using a handheld controller to emulate VR hands. But, the user has a limited area in which to move about because they are tethered to a computer.
Non-Tethered Headset VR/AR – These devices are headsets and computers built into one system, so users are free of any cables limiting their movement. These devices use AR to deliver a 360° immersive experience. Much like with Oculus Rift and Vive, the user would be able to move around in the AR environment as well as interact and manipulate objects. A great example of this headset is Microsoft’s HoloLens, which delivers an AR experience to the user through just a headset.
Mobile Device Inserted into a Headgear – To experience VR, the user inserts their mobile device into a Google Cardboard, Samsung Gear 360°, or any other type of mobile device headgear, along with headphones if they choose. This form of VR doesn’t require the user to be tethered to a computer and most VR experiences can be 360° photos, videos, and interactive scenarios.
Mobile VR – The user can access VR without any type of headgear simply by using a mobile device and headphones (optional). They can still have many of the same experiences that they would through Google Cardboard or any other type of mobile device headgear. Although they don’t get the full immersion that they would with headgear, they would still be able to experience VR. Currently, this version of the VR experience seems to be the most popular because it only requires a mobile device. Apps like Pokémon Go and Snapchat’s animated selfie lens only require a mobile device and have a huge number of users.
Desktop VR – Using just a desktop computer, the user can access 360° photos and videos, as well as other VR and AR experiences, by using the trackpad or computer mouse to move their field of view and become immersed in the VR scenario.
New VR – Non-mobile and non-headset platforms like Leap Motion use depth sensors to create a VR image of one’s hands on a desktop computer; they emulate hand gestures in real time. This technology could be used for anything from teaching assembly in a manufacturing plant to learning a step-by-step process to medical training.
Goggles that are worn, while they are “Oh Myyy” awesome, will not be the final destination of VR/AR. We will want to engage and respond, without wearing a large device over our eyes. Pokémon Go was a good early predictor of how non-goggled experiences will soar.
Education will go virtual
Similar to VR for brand engagement, we’ve seen major potential for delivering hands-on training and distance education in a virtual environment. If VR can take a class on a tour of Mars, the current trickle of educational VR could turn into a flood in 2017.
Published on Dec 26, 2016
Top 10 Virtual Reality Predictions For 2017 In vTime. Its been an amazing year for VR and AR. New VR and AR headsets, ground breaking content and lots more. 2017 promises to be amazing as well. Here’s our top 10 virtual reality predictions for the coming year. Filmed in vTime with vCast. Sorry about the audio quality. We used mics on Rift and Vive which are very good on other platforms. We’ve reported this to vTime.
Addendums
5 top Virtual Reality and Augmented Reality technology trends for 2017— from marxentlabs.com by Joe Bardi Excerpt:
So what’s in store for Virtual Reality and Augmented Reality in 2017? We asked Marxent’s talented team of computer vision experts, 3D artists and engineers to help us suss out what the year ahead will hold. Here are their predictions for the top Virtual Reality and Augmented Reality technology trends for 2017.
In time for CES 2017, the VR/AR Association (VRARA) has launched theDirectory, a first-of-its-kind searchable global database of technology solution providers in the VR, AR, and MR ecosystem.
With ever-growing interest in VR/AR—and companies offering services for nearly every industry vertical—it has become a major challenge for brands and organizations to know who is in the ecosystem, where they are located, and what they do. This VRARA initiative seeks to fill that need.
A hybrid of both AR & VR, Mixed Reality (MR) is far more advanced than Virtual Reality because it combines the use of several types of technologies including sensors, advanced optics and next gen computing power. All of this technology bundled into a single device will provide the user with the capability to overlay augmented holographic digital content into your real-time space, creating scenarios that are unbelievably realistic and mind-blowing.
How does it work?
Mixed Reality works by scanning your physical environment and creating a 3D map of your surroundings so the device will know exactly where and how to place digital content into that space – realistically – while allowing you to interact with it using gestures. Much different than Virtual Reality where the user is immersed in a totally different world, Mixed Reality experiences invite digital content into your real-time surroundings, allowing you to interact with them.
Mixed reality use cases mentioned in the article included:
In parallel with gaming, VR is expanding into many other areas, including these:
Healthcare Surgical Theater is working with UCLA, New York University, the Mayo Clinic and other major medical centers to use VR to help surgeons prepare for difficult operations. Virtual 3D models are constructed from MRIs, CAT scans and/or ultrasounds.
Mental health
Meditation promotes mental health by reducing stress and anxiety.
Education Unimersiv is focusing on historical sites, creating a series of VR tours for the Colosseum, Acropolis, Parthenon, Stonehenge, Titanic, etc. These tours allow each site to be explored as it existed when it was built. Additional locations’ virtual sites and attractions will undoubtedly be added in the near future. The British Museum offered a Virtual Reality Weekend in August 2015. Visitors were able to explore a Bronze Age roundhouse with a flickering fire and changing levels of light while they “handled” Bronze Age relics. The American Museum of Natural History allows students anywhere in the world to take virtual tours of selected museum exhibits, and other museums will soon follow.
Training
Virtual reality is an excellent tool when the task is dangerous or the equipment involved is expensive.
Crime reconstruction
Architecture
Collaboration Virtual reality, augmented reality and mixed reality will form the basis for the next set of collaboration tools.
However, we see very little experienced-based learning in all levels of education today. Traditional learning consists of little more than oration through lectures and textbooks (and their digital equivalents). Experience-based learning is often very difficult to facilitate in the classroom. Whether it be a field trip in elementary school, or simulation exercises in med school, it can be tedious, costly and time consuming.
…
Where VR is really winning in education is in subject matter retention. The first of several surveys that we’ve done was based on a VR field trip through the circulatory system with high-school age children. We saw an increase of nearly 80% in subject matter retention from a group that used VR, compared against a control group that was provided the same subject matter via text and image. (I’ll expand on the details of this experiment, and some research initiatives we’re working on in another blog post).
The old phrase of ‘needing to see it to believe it’ is a powerful mantra across all aspects of residential design. Architecture, interior design and property development are all highly visual trades that require buy-in from both those working on the project and the client. As such, making sure everyone is sold on a coherent vision is vital to ensure that everything goes smoothly and no one is left dissatisfied when the project is completed.
It’s a way for educators to bring their students to places that would be out of reach otherwise. Google Expeditions, the VR mode of Google Street View and Nearpod’s virtual field trips are among the most popular experiences teachers explore with their students. “Some of our students have never really left the bubbles of their own town”, says Jaime Donally, creator of the #ARVRinEDU chat on Twitter. “Virtual reality is a relatively inexpensive way to show them the world.”
In the video below, a facilities manager is using a mobile device to scan a QR code on a wall, behind which is a critical piece of HVAC equipment. With one scan, we can view data on the asset’s performance and health, location data for the asset. This data is being pulled by the IoT Platform from the asset itself, TRIRIGA, and any other useful sources.
Excerpt:
But the best experiences, VR acolytes agree, are still yet to come. Resh Sidhu leads VR development for Framestore, the high-end visual effects house that won an Oscar for the movie Gravity, and has since expanded into creating VR content. With hardware finally delivering on its promise, she believes it is now up to creatives to explore the possibilities.
There’s so much more to VR than just gaming. Which is probably why HTC has been exploring entirely new ways to bring VR to art, education and culture — starting with museums around the world.
HTC recently collaborated with TIME-LIFE on “Remembering Pearl Harbor,” a VR experience commemorating the 75th anniversary of the attack with exhibitions at the Intrepid Sea, Air and Space Museum in New York City and the Newsuem in Washington D.C. Last month, Vive also collaborated with the Royal Academy of Arts in London on the world’s first 3-D printed VR art exhibit.
Now HTC Vive has revealed the launch of a new VR center at La Geode, part of Paris’ Science and Industry Museum, as well as a partnership with the Nobel Museum for a first-of-its-kind VR exhibit showcasing the contributions of Nobel laureates.
From DSC: Recently, my neighbor graciously gave us his old Honda snowblower, as he was getting a new one. He wondered if we had a use for it. As I’m definitely not getting any younger and I’m not Howard Hughes, I said, “Sure thing! That would be great — it would save my back big time! Thank you!” (Though the image below is not mine, it might as well be…as both are quite old now.)
Anyway…when I recently ran out of gas, I would have loved to be able to take out my iPhone, hold it up to this particular Honda snowblower and ask an app to tell me if this particular Honda snowblower takes a mixture of gas and oil, or does it have a separate container for the oil? (It wasn’t immediately clear where to put the oil in, so I’m figuring it’s a mix.)
But what I would have liked to have happen was:
I launched an app on my iPhone that featured machine learning-based capabilities
The app would have scanned the snowblower and identified which make/model it was and proceeded to tell me whether it needed a gas/oil mix (or not)
If there was a separate place to pour in the oil, the app would have asked me if I wanted to learn how to put oil in the snowblower. Upon me saying yes, it would then have proceeded to display an augmented reality-based training video — showing me where the oil was to be put in and what type of oil to use (links to local providers would also come in handy…offering nice revenue streams for advertisers and suppliers alike).
So several technologies would have to be involved here…but those techs are already here. We just need to pull them together in order to provide this type of useful functionality!
“Every child is a genius in his or her own way. VR can be the key to awakening the genius inside.”
This is the closing line of a new research study currently making its way out of China. Conducted by Beijing Bluefocus E-Commerce Co., Ltd and Beijing iBokan Wisdom Mobile Internet Technology Training Institution, the study takes a detailed look at the different ways virtual reality can make public education more effective.
“Compared with traditional education, VR-based education is of obvious advantage in theoretical knowledge teaching as well as practical skills training. In theoretical knowledge teaching, it boasts the ability to make abstract problems concrete, and theoretical thinking well-supported. In practical skills training, it helps sharpen students’ operational skills, provides an immersive learning experience, and enhances students’ sense of involvement in class, making learning more fun, more secure, and more active,” the study states.
CALIFORNIA — Acer Starbreeze, Google, HTC VIVE, Facebook’s Oculus, Samsung, and Sony Interactive Entertainment [on 12/7/16] announced the creation of a non-profit organization of international headset manufacturers to promote the growth of the global virtual reality (VR) industry. The Global Virtual Reality Association (GVRA) will develop and share best practices for industry and foster dialogue between public and private stakeholders around the world.
The goal of the Global Virtual Reality Association is to promote responsible development and adoption of VR globally. The association’s members will develop and share best practices, conduct research, and bring the international VR community together as the technology progresses. The group will also serve as a resource for consumers, policymakers, and industry interested in VR.
VR has the potential to be the next great computing platform, improving sectors ranging from education to healthcare, and contribute significantly to the global economy. Through research, international engagement, and the development of best practices, the founding companies of the Global Virtual Reality Association will work to unlock and maximize VR’s potential and ensure those gains are shared as broadly around the world as possible.
Occipital announced today that it is launching a mixed reality platform built upon its depth-sensing technologies called Bridge. The headset is available for $399 and starts shipping in March; eager developers can get their hands on an Explorer Edition for $499, which starts shipping next week.
From DSC: While I hope that early innovators in the AR/VR/MR space thrive, I do wonder what will happen if and when Apple puts out their rendition/version of a new form of Human Computer Interaction (or forms) — such as integrating AR-capabilities directly into their next iPhone.
Enterprise augmented reality applications ready for prime time — from internetofthingsagenda.techtarget.com by Beth Stackpole Pokémon Go may have put AR on the map, but the technology is now being leveraged for enterprise applications in areas like marketing, maintenance and field service.
Excerpt:
Unlike virtual reality, which creates an immersive, computer-generated environment, the less familiar augmented reality, or AR, technology superimposes computer-generated images and overlays information on a user’s real-world view. This computer-generated sensory data — which could include elements such as sound, graphics, GPS data, video or 3D models — bridges the digital and physical worlds. For an enterprise, the applications are boundless, arming workers walking the warehouse or selling on the shop floor, for example, with essential information that can improve productivity, streamline customer interactions and deliver optimized maintenance in the field.
2016 is fast drawing to a close. And while many will be glad to see the back of it, for those of us who work and play with Virtual Reality, it has been a most exciting year.
By the time the bells ring out signalling the start of a new year, the total number of VR users will exceed 43 million. This is a market on the move, projected to be worth $30bn by 2020. If it’s to meet that valuation, then we believe 2017 will be an incredibly important year in the lifecycle of VR hardware and software development.
VR will be enjoyed by an increasingly mainstream audience very soon, and here we take a quick look at some of the trends we expect to develop over the next 12 months for that to happen.
IN an Australian first, education students will be able hone their skills without stepping foot in a classroom. Murdoch University has hosted a pilot trial of TeachLivE, a virtual reality environment for teachers in training.
The student avatars are able to disrupt the class in a range of ways that teachers may encounter such as pulling out mobile phones or losing their pen during class.
8 Cutting Edge Virtual Reality Job Opportunities— from appreal-vr.com by Yariv Levski Today we’re highlighting the top 8 job opportunities in VR to give you a current scope of the Virtual Reality job market.
The Epson Moverio BT-300, to give the smart glasses their full name, are wearable technology – lightweight, comfortable see-through glasses – that allow you to see digital data, and have a first person view (FPV) experience: all while seeing the real world at the same time. The applications are almost endless.
Volkswagen’s pivot away from diesel cars to electric vehicles is still a work in progress, but some details about its coming I.D. electric car — unveiled in Paris earlier this year — are starting to come to light. Much of the news is about an innovative augmented reality heads-up display Volkswagen plans to offer in its electric vehicles. Klaus Bischoff, head of the VW brand, says the I.D. electric car will completely reinvent vehicle instrumentation systems when it is launched at the end of the decade.
For decades, numerous research centers and academics around the world have been working the potential of virtual reality technology. Countless research projects undertaken in these centers are an important indicator that everything from health care to real estate can experience disruption in a few years.
…
Virtual Human Interaction Lab — Stanford University
Virtual Reality Applications Center — Iowa State University
Institute for Creative Technologies—USC
Medical Virtual Reality — USC
The Imaging Media Research Center — Korea Institute of Science and Technology
Virtual Reality & Immersive Visualization Group — RWTH Aachen University
Center For Simulations & Virtual Environments Research — UCIT
Duke immersive Virtual Environment —Duke University
Experimental Virtual Environments (EVENT) Lab for Neuroscience and Technology — Barcelona University
Immersive Media Technology Experiences (IMTE) — Norwegian University of Technology
Human Interface Technology Laboratory — University of Washington
Augmented Reality (AR) dwelled quietly in the shadow of VR until earlier this year, when a certain app propelled it into the mainstream. Now, AR is a household term and can hold its own with advanced virtual technologies. The AR industry is predicted to hit global revenues of $90 billion by 2020, not just matching VR but overtaking it by a large margin. Of course, a lot of this turnover will be generated by applications in the entertainment industry. VR was primarily created by gamers for gamers, but AR began as a visionary idea that would change the way that humanity interacted with the world around them. The first applications of augmented reality were actually geared towards improving human performance in the workplace… But there’s far, far more to be explored.
I stood at the peak of Mount Rainier, the tallest mountain in Washington state. The sounds of wind whipped past my ears, and mountains and valleys filled a seemingly endless horizon in every direction. I’d never seen anything like it—until I grabbed the sun.
Using my HTC Vive virtual reality wand, I reached into the heavens in order to spin the Earth along its normal rotational axis, until I set the horizon on fire with a sunset. I breathed deeply at the sight, then spun our planet just a little more, until I filled the sky with a heaping helping of the Milky Way Galaxy.
Virtual reality has exposed me to some pretty incredible experiences, but I’ve grown ever so jaded in the past few years of testing consumer-grade headsets. Google Earth VR, however, has dropped my jaw anew. This, more than any other game or app for SteamVR’s “room scale” system, makes me want to call every friend and loved one I know and tell them to come over, put on a headset, and warp anywhere on Earth that they please.
In VR architecture, the difference between real and unreal is fluid and, to a large extent, unimportant. What is important, and potentially revolutionary, is VR’s ability to draw designers and their clients into a visceral world of dimension, scale, and feeling, removing the unfortunate schism between a built environment that exists in three dimensions and a visualization of it that has until now existed in two.
Many of the VR projects in Architecture are focused on the final stages of design process, basically for selling a house to a client. Thomas sees the real potential in the early stages: when the main decisions need to be made. VR is so good for this, as it helps for non professionals to understand and grasp the concepts of architecture very intuitively. And this is what we talked mostly about.
A proposed benefit of virtual reality is that it could one day eliminate the need to move our fleshy bodies around the world for business meetings and work engagements. Instead, we’ll be meeting up with colleagues and associates in virtual spaces. While this would be great news for the environment and business people sick of airports, it would be troubling news for airlines.
Imagine during one of your future trials that jurors in your courtroom are provided with virtual reality headsets, which allow them to view the accident site or crime scene digitally and walk around or be guided through a 3D world to examine vital details of the scene.
How can such an evidentiary presentation be accomplished? A system is being developed whereby investigators use a robot system inspired by NASA’s Curiosity Mars rover using 3D imaging and panoramic videography equipment to record virtual reality video of the scene.6 The captured 360° immersive video and photographs of the scene would allow recreation of a VR experience with video and pictures of the original scene from every angle. Admissibility of this evidence would require a showing that the VR simulation fairly and accurately depicts what it represents. If a judge permits presentation of the evidence after its accuracy is established, jurors receiving the evidence could turn their heads and view various aspects of the scene by looking up, down, and around, and zooming in and out.
Unlike an animation or edited video initially created to demonstrate one party’s point of view, the purpose of this type of evidence would be to gather data and objectively preserve the scene without staging or tampering. Even further, this approach would allow investigators to revisit scenes as they existed during the initial forensic examination and give jurors a vivid rendition of the site as it existed when the events occurred.
The theme running throughout most of this year’s WinHEC keynote in Shenzhen, China was mixed reality. Microsoft’s Alex Kipman continues to be a great spokesperson and evangelist for the new medium, and it is apparent that Microsoft is going in deep, if not all in, on this version of the future. I, for one, as a mixed reality or bust developer, am very glad to see it.
As part of the presentation, Microsoft presented a video (see below) that shows the various forms of mixed reality. The video starts with a few virtual objects in the room with a person, transitions into the same room with a virtual person, then becomes a full virtual reality experience with Windows Holographic.
NeuroNet Learning (Gainesville, FL), a research-based early reading program designed to assist students with essential reading, handwriting skills and math;
TheTalkList (San Diego, CA), a language learning exchange platform;
Trovvit (Brooklyn, NY), a social digital portfolio tool; and
Versity U (Jeffersonville, IN), a nursing exam platform.
From DSC: In the future, I’d like to see holograms provide stunning visual centerpieces for the entrance ways into libraries, or in our classrooms, or in our art galleries, recital halls, and more. The object(s), person(s), scene(s) could change into something else, providing a visually engaging experience that sets a tone for that space, time, and/or event.
Eventually, perhaps these types of technologies/setups will even be a way to display artwork within our homes and apartments.
From DSC:
(With thanks to Woontack Woo for his posting this via his paper.li entitled “#AR #CAMAR for Ubiquitous VR”)
Check this out!
On December 3rd, the Legend of Sword opera comes to Australia — but this is no ordinary opera! It is a “holographic sensational experience!” Set designers and those involved with drama will need to check this out. This could easily be the future of set design!
But not only that, let’s move this same concept over to the world of learning. What might augmented reality do for how our learning spaces look and act like in the future? What new affordances and experiences could they provide for us? This needs to be on our radars.
Legend of Sword 1 is a holographic sensational experience that has finished its 2nd tour in China. A Chinese legend of the ages to amaze and ignite your imagination. First time ever such a visual spectacular stage in Australia on Sat 3rd Dec only. Performed in Chinese with English subtitles.
Legend of Sword and Fairy 1 is based on a hit video game in China. Through the hardworking of the renowned production team, the performance illustrates the beautiful fantasy of game on stage, and allow the audience feel like placing themselves in the eastern fairy world. With the special effects with the olfactory experience, and that actors performing and interact with audience at close distance, the eastern fairy world is realised on stage. It is not only a play with beautiful scenes, but also full of elements from oriental style adventure. The theatre experience will offer much more than a show, but the excitement of love and adventure.
Legend of Sword and Fairy 1 was premiered in April 2015 at Shanghai Cultural Plaza, which set off a frenzy of magic in Shanghai, relying on the perfect visual and 5D all-round sensual experience. Because of the fantasy theme that matches with top visual presentation, Legend of Sword and Fairy 1 became the hot topic in Shanghai immediately. With only just 10 performances at the time, its Weibo topic hits have already exceeded 100 million mark halfway.
So far, Legend of Sword and Fairy 1 has finished its second tour in a number of cities in China, including Beijing, Chongqing, Chengdu, Nanjing, Xiamen, Qingdao, Shenyang, Dalian, Wuxi, Ningbo, Wenzhou, Xi’an, Shenzhen, Dongguan, Huizhou, Zhengzhou, Lishui, Ma’anshan, Kunshan, Changzhou etc.
The headlines for Pokémon GO were initially shocking, but by now they’re familiar: as many as 21 million active daily users, 700,000 downloads per day, $5.7 million in-app purchases per day, $200 million earned as of August. Analysts anticipate the game will garner several billion dollars in ad revenue over the next year. By almost any measure, Pokémon GO is huge.
The technologies behind the game, augmented and virtual reality (AVR), are huge too. Many financial analysts expect the technology to generate $150 billion over the next three years, outpacing even smartphones with unprecedented growth, much of it in entertainment. But AVR is not only about entertainment. In August 2015, Teegan Lexcen was born in Florida with only half a heart and needed surgery. With current cardiac imaging software insufficient to assist with such a delicate operation on an infant, surgeons at Nicklaus Children’s Hospital in Miami turned to 3D imaging software and a $20 Google Cardboard VR set. They used a cellphone to peer into the baby’s heart, saw exactly how to improve her situation and performed the successful surgery in December 2015.
“I could see the whole heart. I could see the chest wall,” Dr. Redmond Burke told Today. “I could see all the things I was worried about in creating an operation.”
Texas Tech University Health Sciences Center in Lubbock and San Diego State University are both part of a Pearson mixed reality pilot aimed at leveraging mixed reality to solve challenges in nursing education.
…
At Bryn Mawr College, a women’s liberal arts college in Pennsylvania, faculty, students, and staff are exploring various educational applications for the HoloLens mixed reality devices. They are testing Skype for HoloLens to connect students with tutors in Pearson’s 24/7 online tutoring service, Smarthinking.
…
At Canberra Grammar School in Australia, Pearson is working with teachers in a variety of disciplines to develop holograms for use in their classrooms. The University of Canberra is partnering with Pearson to provide support for the project and evaluate the impact these holograms have on teaching and learning.
As fantastic as technologies like augmented and mixed reality may be, experiencing them, much less creating them, requires a sizable investment, financially speaking. It is just beyond the reach of consumers as well as your garage-type indie developer. AR and VR startup Zappar, however, wants to smash that perception. With ZapBox, you can grab a kit for less than a triple-A video game to start your journey towards mixed reality fun and fame. It’s Magic Leap meets Google Cardboard. Or as Zappar itself says, making Magic Leap, magic cheap!
A school bus, virtual reality, & an out-of-this-world journey — from goodmenproject.com “Field Trip To Mars” is the barrier-shattering outcome of an ambitious mission to give a busload of people the same, Virtual Reality experience – going to Mars.
Excerpt:
Inspiration was Lockheed‘s goal when it asked its creative resources, led by McCann, to create the world’s first mobile group Virtual Reality experience. As one creator notes, VR now is essentially a private, isolating experience. But wouldn’t it be cool to give a busload of people the same, simultaneous VR experience? And then – just to make it really challenging – put the whole thing on wheels?
“Field Trip To Mars” is the barrier-shattering outcome of this ambitious mission.
From DSC: This is incredible! Very well done. The visual experience tracks the corresponding speeds of the bus and even turns of the bus.
The United States Department of Education (ED) has formally kicked off a new competition designed to encourage the development of virtual and augmented reality concepts for education.
Dubbed the EdSim Challenge, the competition is aimed squarely at developing students’ career and technical skills — it’s funded through the Carl D. Perkins Career and Technical Education Act of 2006 — and calls on developers and ed tech organizations to develop concepts for “computer-generated virtual and augmented reality educational experiences that combine existing and future technologies with skill-building content and assessment. Collaboration is encouraged among the developer community to make aspects of simulations available through open source licenses and low-cost shareable components. ED is most interested in simulations that pair the engagement of commercial games with educational content that transfers academic, technical, and employability skills.”
Virtual reality boosts students’ results— from raconteur.net by Edwin Smith Virtual and augmented reality can enable teaching and training in situations which would otherwise be too hazardous, costly or even impossible in the real world
Excerpt:
More recently, though, the concept described in Aristotle’s Nicomachean Ethics has been bolstered by further scientific evidence. Last year, a University of Chicago study found that students who physically experience scientific concepts, such as the angular momentum acting on a bicycle wheel spinning on an axel that they’re holding, understand them more deeply and also achieve significantly improved scores in tests.
Virtual and augmented reality are shaking up sectors — from raconteur.net by Sophie Charara Both virtual and augmented reality have huge potential to leap from visual entertainment to transform the industrial and service sectors
Microsoft might not have envisioned its HoloLens headset as a war helmet, but that’s not stopping Ukrainian company LimpidArmor from experimenting. Defence Blog reports that LimpidArmor has started testing military equipment that includes a helmet with Microsoft’s HoloLens headset integrated into it.
The helmet is designed for tank commanders to use alongside a Circular Review System (CRS) of cameras located on the sides of armored vehicles. Microsoft’s HoloLens gathers feeds from the cameras outside to display them in the headset as a full 360-degree view. The system even includes automatic target tracking, and the ability to highlight enemy and allied soldiers and positions.
Bring your VR to work— from itproportal.com by Timo Elliott, Josh Waddell 4 hours ago With all the hype, there’s surprisingly little discussion of the latent business value which VR and AR offer.
Excerpt:
With all the hype, there’s surprisingly little discussion of the latent business value which VR and AR offer — and that’s a blind spot that companies and CIOs can’t afford to have. It hasn’t been that long since consumer demand for the iPhone and iPad forced companies, grumbling all the way, into finding business cases for them. Gartner has said that the next five to ten years will bring “transparently immersive experiences” to the workplace. They believe this will introduce “more transparency between people, businesses, and things” and help make technology “more adaptive, contextual, and fluid.”
If digitally enhanced reality generates even half as much consumer enthusiasm as smartphones and tablets, you can expect to see a new wave of consumerisation of IT as employees who have embraced VR and AR at home insist on bringing it to the workplace. This wave of consumerisation could have an even greater impact than the last one. Rather than risk being blindsided for a second time, organisations would be well advised to take a proactive approach and be ready with potential business uses for VR and AR technologies by the time they invade the enterprise.
In Gartner’s latest emerging technologies hype cycle, Virtual Reality is already on the Slope of Enlightenment, with Augmented Reality following closely.
One place where students are literally immersed in VR is at Carnegie Mellon University’s Entertainment Technology Center (ETC). ETC offers a two-year Master of Entertainment Technology program (MET) launched in 1998 and cofounded by the late Randy Pausch, author of “The Last Lecture.”
MET starts with an intense boot camp called the “immersion semester” in which students take a Building Virtual Worlds (BVW) course, a leadership course, along with courses in improvisational acting, and visual storytelling. Pioneered by Pausch, BVW challenges students in small teams to create virtual reality worlds quickly over a period of two weeks, culminating in a presentation festival every December.
Apple patents augmented reality mapping system for iPhone — from appleinsider.com by Mikey Campbell Apple on Tuesday was granted a patent detailing an augmented reality mapping system that harnesses iPhone hardware to overlay visual enhancements onto live video, lending credence to recent rumors suggesting the company plans to implement an iOS-based AR strategy in the near future.
Virtual reality is a combination of life-like images, effects and sounds that creates an imaginary world in front of our eyes.
But what if we could also imitate more complex sensations like the feeling of falling rain, a beating heart or a cat walking? What if we could distinguish, between a light sprinkle and a heavy downpour in a virtual experience?
Disney Research?—?a network of research laboratories supporting The Walt Disney Company, has announced the development of a 360-degree virtual reality application offering a library of feel effects and full body sensations.
Literature class meets virtual reality — from blog.cospaces.io by Susanne Krause Not every student finds it easy to let a novel come to life in their imagination. Could virtual reality help? Tiffany Capers gave it a try: She let her 7th graders build settings from Lois Lowry’s “The Giver” with CoSpaces and explore them in virtual reality. And: they loved it.
After generations of peering into a microscope to examine cells, scientists could simply stroll straight through one.
Calling his project the “stuff of science fiction,” director of the 3D Visualisation Aesthetics Lab at the University of New South Wales (UNSW) John McGhee is letting people come face-to-face with a breast cancer cell.
In contrast, VR has been described as the “ultimate empathy machine.” It gives us a way to virtually put us in someone else’s shoes and experience the world the way they do.
This isn’t meant to be an exhaustive list, but if I missed something major, please tell me and I’ll add it. Also, please reach out if you’re working on anything cool in this space à sarah(at)accomplice(dot)co.
Hand and finger tracking, gesture interfaces, and grip simulation:
