Microsoft just demonstrated a meeting room of the future at the company’s Build developer conference.
…
It all starts with a 360-degree camera and microphone array that can detect anyone in a meeting room, greet them, and even transcribe exactly what they say in a meeting regardless of language.
…
Microsoft takes the meeting room scenario even further, though. The company is using its artificial intelligence tools to then act on what meeting participants say.
From DSC: Whoa! Many things to think about here. Consider the possibilities for global/blended/online-based learning (including MOOCs) with technologies associated with translation, transcription, and identification.
But as with any new technology, there are inherent risks we should acknowledge, anticipate, and deal with as soon as possible. If we do so, these technologies are likely to continue to thrive.
…
As wonderful as AR is and will continue to be, there are some serious privacy and security pitfalls, including dangers to physical safety, that as an industry we need to collectively avoid. There are also ongoing threats from cyber criminals and nation states bent on political chaos and worse — to say nothing of teenagers who can be easily distracted and fail to exercise judgement — all creating virtual landmines that could slow or even derail the success of AR. We love AR, and that’s why we’re calling out these issues now to raise awareness.
Microsoft Remote Assist — Collaborate in mixed reality to solve problems faster
With Microsoft Remote Assist we set out to create a HoloLens app that would help our customers collaborate remotely with heads-up, hands-free video calling, image sharing, and mixed-reality annotations. During the design process, we spent a lot of time with Firstline Workers. We asked ourselves, “How can we help Firstline Workers share what they see with an expert while staying hands-on to solve problems and complete tasks together, faster.” It was important to us that Firstline Workers are able to reach experts on whatever device they are using at the time, including PCs, phones, or tablets.
Microsoft Layout — Design spaces in context with mixed reality
With Microsoft Layout our goal was to build an app that would help people use HoloLens to bring designs from concept to completion using some of the superpowers mixed reality makes possible. With Microsoft Layout customers can import 3-D models to easily create and edit room layouts in real-world scale. Further, you can experience designs as high-quality holograms in physical space or in virtual reality and share and edit with stakeholders in real time.
From DSC: Those involved with creating/enhancing learning spaces may want to experiment with Microsoft Layout.
The new updates allow for collaborative AR experiences, such as playing multiplayer games or painting a AR community mural using a capability called Cloud Anchors.
“You can see what you can’t imagine,” said Aaron Herridge, a graduate student in Creighton’s medical physics master’s program and a RaD Lab intern who is helping develop the lab’s virtual reality program. “It’s an otherworldly experience,” Herridge says. “But that’s the great plus of virtual reality. It can take you places that you couldn’t possibly go in real life. And in physics, we always say that if you can’t visualize it, you can’t do the math. It’s going to be a huge educational leap.”
“We’re always looking for ways to help students get the real feeling for astronomy,” Gabel said. “Visualizing space from another planet, like Mars, or from Earth’s moon, is a unique experience that goes beyond pencil and paper or a two-dimensional photograph in a textbook.
BAE created a guided step-by-step training solution for HoloLens to teach workers how to assemble a green energy bus battery.
From DSC: How long before items that need some assembling come with such experiences/training-related resources?
VR and AR: The Ethical Challenges Ahead— from er.educause.edu by Emory Craig and Maya Georgieva Immersive technologies will raise new ethical challenges, from issues of access, privacy, consent, and harassment to future scenarios we are only now beginning to imagine.
Excerpt:
As immersive technologies become ever more realistic with graphics, haptic feedback, and social interactions that closely align with our natural experience, we foresee the ethical debates intensifying. What happens when the boundaries between the virtual and physical world are blurred? Will VR be a tool for escapism, violence, and propaganda? Or will it be used for social good, to foster empathy, and as a powerful new medium for learning?
Augmented reality might not be able to cure cancer (yet), but when combined with a machine learning algorithm, it can help doctors diagnose the disease. Researchers at Google have developed an augmented reality microscope (ARM) that takes real-time data from a neural network trained to detect cancerous cells and displays it in the field of view of the pathologist viewing the images.
Click on the image to get a larger image in a PDF file format.
From DSC: So regardless of what was being displayed up on any given screen at the time, once a learner was invited to use their devices to share information, a graphical layer would appear on the learner’s mobile device — as well as up on the image of the screens (but the actual images being projected on the screens would be shown in the background in a muted/pulled back/25% opacity layer so the code would “pop” visually-speaking) — letting him or her know what code to enter in order to wirelessly share their content up to a particular screen. This could be extra helpful when you have multiple screens in a room.
For folks at Microsoft: I could have said Mixed Reality here as well.
From DSC:
This application looks to be very well done and thought out! Wow!
Check out the video entitled “Interactive Ink – Enables digital handwriting“ — and you may also wonder whether this could be a great medium/method of having to “write things down” for better information processing in our minds, while also producing digital work for easier distribution and sharing!
Wow! Talk about solid user experience design and interface design! Nicely done.
Below is an excerpt of the information from Bella Pietsch from anthonyBarnum Public Relations
Imagine a world where users interact with their digital devices seamlessly, and don’t suffer from lag and delayed response time. I work with MyScript, a company whose Interactive Ink tech creates that world of seamless handwritten interactivity by combining the flexibility of pen and paper with the power and productivity of digital processing.
According to a recent forecast, the global handwriting recognition market is valued at a trillion-plus dollars and is expected to grow at an almost 16 percent compound annual growth rate by 2025. To add additional context, the new affordable iPad with stylus support was just released, allowing users to work with the $99 Apple Pencil, which was previously only supported by the iPad Pro.
Check out the demo of Interactive Ink using an Apple Pencil, Microsoft Surface Pen, Samsung S Pen or Google Pixelbook Pen here.
Interactive Ink’s proficiencies are the future of writing and equating. Developed by MyScript Labs, Interactive Ink is a form of digital ink technology which allows ink editing via simple gestures and providing device reflow flexibility. Interactive Ink relies on real-time predictive handwriting recognition, driven by artificial intelligence and neural network architectures.
Here’s something every tech company agrees on: the world needs more AI engineers. Microsoft is the latest firm to try to answer this demand, and this week, it launched a new course on its tech accreditation scheme (known as the Microsoft Professional Program) dedicated to artificial intelligence.
The course has 10 modules, each taking between eight and 16 hours to complete online. They cover a range of sub-disciplines, including computer vision, data analysis, speech recognition, and natural language processing. Interestingly, there’s also an ethics course (a topic Microsoft is paying close attention as it pivots to focus on AI) as well as a module on machine learning in Azure, the company’s cloud platform.
As we watch major tech platforms evolve over time, it’s clear that companies like Facebook, Apple, Google and Amazon (among others) have created businesses that are having a huge impact on humanity — sometimes positive and other times not so much.
That suggests that these platforms have to understand how people are using them and when they are trying to manipulate them or use them for nefarious purposes — or the companies themselves are. We can apply that same responsibility filter to individual technologies like artificial intelligence and indeed any advanced technologies and the impact they could possibly have on society over time.
…
We can be sure that Twitter’s creators never imagined a world where bots would be launched to influence an election when they created the company more than a decade ago. Over time though, it becomes crystal clear that Twitter, and indeed all large platforms, can be used for a variety of motivations, and the platforms have to react when they think there are certain parties who are using their networks to manipulate parts of the populace.
But it’s up to the companies who are developing the tech to recognize the responsibility that comes with great economic success or simply the impact of whatever they are creating could have on society.
5% picked tech when asked which industry had the most power and influence, well behind the U.S. government, Wall Street and Hollywood.
Respondents were much more likely to say sexual harassment was a major issue in Hollywood (49%) and government (35%) than in Silicon Valley (17%).
It is difficult for Americans to escape the technology industry’s influence in everyday life. Facebook Inc. reports that more than 184 million people in the United States log on to the social network daily, or roughly 56 percent of the population. According to the Pew Research Center, nearly three-quarters (73 percent) of all Americans and 94 percent of Americans ages 18-24 use YouTube. Amazon.com Inc.’s market value is now nearly three times that of Walmart Inc.
But when asked which geographic center holds the most power and influence in America, respondents in a recent Morning Consult survey ranked the tech industry in Silicon Valley far behind politics and government in Washington, finance on Wall Street and the entertainment industry in Hollywood.
The path to opportunity is changing
The short shelf life of skills and a tightening labor market are giving rise to a multitude of skill gaps. Businesses are fighting to stay ahead of the curve, trying to hold onto their best talent and struggling to fill key positions. Individuals are conscious of staying relevant in the age of automation.
Enter the talent development function.
These organizational leaders create learning opportunities to enable employee growth and achievement. They have the ability to guide their organizations to success in tomorrow’s labor market, but they can’t do it alone.
… Our research answers the talent developer’s most pressing questions: * How are savvy talent development leaders adapting to the pace of change in today’s dynamic world of work?
* Why do employees demand learning and development resources, but don’t make the time to learn?
* How do executives think about learning and development?
* Are managers the missing link to successful learning programs?
From DSC: Even though this piece is a bit of a sales pitch for Lynda.com — a great service I might add — it’s still worth checking out. I say this because it brings up a very real trend that I’m trying to bring more awareness to — i.e., the pace of change has changed. Our society is not ready for this new, exponential pace of change. Technologies are impacting jobs and how we do our jobs, and will likely do so for the next several decades. Skills gaps are real and likely growing larger. Corporations need to do their part in helping higher education revise/develop curriculum and they need to offer funds to create new types of learning labs/environments. They need to offer more internships and opportunities to learn new skills.
Over 143 million workers in the U.S. have LinkedIn profiles; over 20,000 companies in the U.S. use LinkedIn to recruit; over 3 million jobs are posted on LinkedIn in the U.S. every month; and members can add over 50,000 skills to their profiles to showcase their professional brands. That gives us unique and valuable insight into U.S. workforce trends.
The LinkedIn Workforce Report is a monthly report on employment trends in the U.S. workforce, and this month’s report looks at our latest data through December 2017. It’s divided into two sections: a National section that provides insights into hiring, skills gaps, and migration trends across the country, and a City section that provides insights into localized employment trends in 20 of the largest U.S. metro areas: Atlanta, Austin, Boston, Chicago, Cleveland-Akron, Dallas-Ft. Worth, Denver, Detroit, Houston, Los Angeles, Miami-Ft. Lauderdale, Minneapolis-St. Paul, Nashville, New York City, Philadelphia, Phoenix, San Francisco Bay Area, Seattle, St. Louis, and Washington, D.C.
Here’s the trade-off: what we gain in development ease-of-use (native SDKs, integration into existing workflows) and performance enhancements (load times, battery efficiency, render quality, integration with native apps), we lose in universality; naturally, each company wants you staying within its own ecosystem.
In a nutshell: new AR platforms from today’s tech giants are aimed at reducing technical headache so you can focus on creating amazing experiences… but they also want you creating more apps for their respective mobile ecosystems.
Learning to play the piano is getting an immersive upgrade with a new augmented reality (AR) piano training software called Music Everywhere. The HoloLens app aims to help students of all talent levels build fundamental music theory and performance skills. While traditional piano lessons can cost upwards of $100 per hour, Music Everywhere is free on the Microsoft store and offers a cost effective tutoring solution that provides students with immediate interaction feedback, making it differ greatly from watching a video tutorial.
Founded in 2017, Music Everywhere began at Carnegie Mellon’s ETC with Seth Glickman, Fu Yen Hsiao, and Byunghwan Lee realizing the nascent technology could be used for skills training. The app was the first Augmented Reality music learning platform to take first prize in Microsoft’s HoloLens Developer Contest, beating more than one-thousand submissions.
The market for virtual reality applications is growing at a rapid pace, and is expected to double in the next five years (Bolkan, 2017). As the cost of equipment falls and schools have greater access to technology, there is great interest in virtual reality as an educational tool. A small but growing group of educators have started to integrate virtual reality in their classrooms, with promising results (Castaneda, Cechony & Bautista, 2017). We reached out to teachers and administrators who are currently using virtual reality in their classrooms to hear their perspectives and practical strategies for infusing this resource into their classrooms.
Teachers have creative ideas for how to incorporate immersive education in current classrooms: how to select activities, how to set up the classroom, how to get support during the activity and how to transport devices. Teachers also shared their ideas for future applications of VR, including how to deepen the learning experience and to expand the reach of these technologies to a greater population of students.
Here we share three vignettes of three different approaches: a social studies class in a suburban school district, a district-wide perspective from an urban school district and a class designed entirely around understanding and implementing VR for other classrooms. We also share how we are using these ideas to inform our own project in designing a collaborative immersive virtual reality educational game for introductory high school biology.
VR is already being used for many real-world applications–hiring, training, marketing/sales, medical purposes, entertainment, and more–and is worth considering for many different university departments.
…
At German University in Cairo, architecture students used our platform to create tours of historical Cairo buildings, complete with educational hotspot overlays on particularly interesting features. This multimedia approach educated students without them having to travel to the buildings. It also made for a more “stickier” learning experience for the students involved in creating it.
…
At Emporia State University, for example, the forensic science students view virtual crime scenes recorded at the Kansas Bureau of Investigation in Topeka. Forensic-science students can look for clues and learn facts via voiceover, mimicking an actual crime-scene inquiry quite impressively.
Just as televisions and driverless cars have become part of the furniture at the CES technology show, so too have virtual and augmented reality headsets.
Although the momentum behind VR’s growth slowed in 2017 – the industry seemingly unsure if it should progress with a technology destined to remain a niche – AR is being welcomed into the spotlight with open arms.
…
Here are six AR and VR highlights from CES 2018.
The University of Washington, hoping to get ahead in the burgeoning field of augmented reality (AR) and virtual reality (VR), has launched the UW Reality Lab, a center for research, education and innovation in AR and VR.
…
One of the first research centers in the world built for AR and VR projects, the UW Reality Lab is also located in Seattle — a hotspot for technology companies, from behemoths like Amazon and Microsoft to startups still trying to get off the ground.
“We’re seeing some really compelling and high-quality AR and VR experiences being built today,” Steve Seitz, center co-lead and Allen School professor, said in the university’s statement. “But, there are still many core research advances needed to move the industry forward — tools for easily creating content, infrastructure solutions for streaming 3D video, and privacy and security safeguards — that university researchers are uniquely positioned to tackle.”
Why Augmented Reality is Important for eLearning According to a report released by CCS Insight, augmented and virtual reality hardware is set to become a $4 billion market by 2018. Let’s take a look at how augmented reality can be leveraged in the online learning space:
Simulated working environments One of the most common advantages of online learning is the ability to form an environment in which the users have the freedom to experiment. As people usually learn from their mistakes, when they work in a consequence-free environment, they are most likely to remember the right way to do things.
Support Gamification
As online learning management systems (LMSs) use gamification widely, augmented reality can be directly applied. In AR reality training module, employees will be rewarded for effectively performing their routine tasks in the right way, which will eventually improve performance.
Immersive Learning Environments
Using a tablet, smartphone for the online training software means the users are constantly distracted with emails, notifications from social channels etc. This is one of the reasons why elearning content uses interactive multimedia elements to engage students. With augmented reality, elearning courses can be supported with 360° video, which will engage the user and remove distractions for them.
Motion tracking
Motion and gesture tracking are part of the AR experience. They are commonly leveraged for choosing menu items or engaging with video game-based environments.
In the online learning domain, LMSs can use this technology to track learner’s progress to ensure that they are achieving the set targets without fail. This will boost real-time training performance and improve interactivity with instant feedback.
Simply put, with augmented reality the possibilities are endless. With the growing number of Bring Your Own Device (BYOD) workplaces, it is expected that employees and learners will be delighted to use augmented reality.
The Musical Future of VR
VR technology is still in its earliest stages, but musicians are already seeing how they will be able to connect to fans and make news ones without the expense of touring. In artificial environments, bands can invite music lovers into their world.
But beyond the obvious entertainment factor, VR has the potential to become a tool for education. Music students could enter a studio space using VR gear for lessons and practice. The immediate feedback provided and game-like atmosphere may keep students more motivated and engaged. Imagine methods for teaching that include ways to slow down and loop difficult parts or bringing in the composer for lessons.
VR can also connect music lovers to the many people behind the scenes involved in producing the music they enjoy. Listeners can learn about the industry and how a song comes to life. They’ll understand why it’s important to play a part in sustaining the music business.
For this technology to become a reality in itself inside consumers’ listening and learning spaces, obstacles need addressing. The hardware is still pricey, bulky and requires a power source. Apps need creators who will need more in the way of artificial intelligence.
“The ability to combine digital information with the real world is going to disrupt every business model, transform human/machine interaction, and generate innovative use cases across every discipline and in every vertical including education, healthcare, manufacturing,” Werner continued. “I see ARiA as the TED for AR, where the best minds come together to solve real work problems and share ideas to capitalize on the huge opportunity.”
Broadcast news and sports now routinely lay data, graphics, and animation onto the physical world. AR has become ubiquitous in ways that have nothing to do with smart glasses. “AR is on the verge.
In regards to mixed reality for immersive learning:
Pearson – the world’s largest education company – will begin rolling out in March curriculum that will work on both HoloLens and Windows Mixed Reality immersive VR headsets. These six new applications will deliver seamless experiences across devices and further illustrate the value of immersive educational experiences.
We are expanding our mixed media reality curriculum offerings through a new partnership with WGBH’s Bringing the Universe to America’s Classrooms project****, for distribution nationally on PBS LearningMedia™. This effort brings cutting-edge Earth and Space Science content into classrooms through digital learning resources that increase student engagement with science phenomena and practices.
To keep up with growing demand for HoloLens in the classroom we are committed to providing affordable solutions. Starting on January 22, we are making available a limited-time academic pricing offer for HoloLens. To take advantage of the limited-time academic pricing offer, please visit, hololens.com/edupromo.
