Our Blog

Nowadays, augmented reality has become more than science fiction. AR is vastly used in retail, entertainment, production, healthcare, military training, education, etc. The advantages AR gives to this field explain its growing popularity. The key advantages of them are simplifying the educational process, increasing user involvement, creating customers’ unique experiences, and increasing business efficiency. We would like to tell you about the 5 most interesting technologies, gadgets, and applications, which most clearly represent augmented reality trends in 2022. Virtual Try-On Virtual Try-on technologies bring real fitting rooms into the digital realm. Using the device’s camera, a customer can try the virtual product on. AR technology creates a realistic image of a product on customers’ bodies, which allows them to choose the right clothes without visiting physical shops. Such companies like ASOS and Adidas use AR try-on for a wide range of models in different sizes. 1822 Denim uses YourFit widget by 3DLOOK which significantly simplifies the process of choosing the right size for women. This program scans the customer’s body and then automatically calculates the right size. According to statistics, 90% of the company’s customers felt more confident about personalized recommendations. And 70% of customers went on a purchase after using 3DLOOK technology. Intravenous Assistance AR technologies can also improve healthcare and patients’ treatment. Some augment reality technologies scan a patient’s body parts and reveal an accurate picture of the circulatory system. AR intravenous assistance gadgets and programs are mostly implied during cosmetic procedures, intravenous medication delivery, treatment of varicose and other vein diseases, and so on. AccuVein is a handy gadget with augmented reality technology which helps to find the right vein in a patient’s body. This gadget reduces failed attempts at intravenous medication delivery. According to statistics, from 7% up to 21% of first attempts are failed, even by most experienced doctors. AR Military Training Augmented reality in the military sector is mostly used in different kinds of training. With AR technologies army successfully and safely trains jet pilots, infantry, fighting vehicles, tank crew, etc. One of the most recent technologies — is tactical augmented reality. The Communications-Electronics Research, Development and Engineering Centre (CERDEC) recently introduced a heads-up display. TAR uses a helmet-mounted eye display, wirelessly connected to the small computer on a waist. TAR also has integrated mapping, navigation, and 3D models to improve tactical maneuvers and fires. Current AR military technologies are using monochrome images, but CERDEC plans to display fully-colored videos and pictures to improve soldiers’ experience. AR in Education As it was proven multiple times, AR technologies in classes increase a student’s engagement, and interest in a subject and improve content understanding. AR can be used for virtual trips, which help students to learn about foreign cultures during History lessons. Using 3D geometric figures, a student can solve complex geometry tasks. For those who struggle with mathematics and geometry, Photomath is the right choice. After you scan an exercise from a physical worksheet with this mobile VR app, you’ll get the way how to solve a math problem, using interactive 3D graphics. Also, Photomath is suitable for solving problems in geometry, trigonometry, algebra, statistics, etc. This educational AR app has been downloaded from GooglePlay and App Store more than 300 million times. Art & Photography Augmented reality is also used as a new space to create art. AR mobile apps are both a perfect place for artists to make some experimental art and a helpful tool to create real paintings and photos. Like, for example, Sun Surveyor is — a mobile app, made for professional photographers. This app helps artists to find the right location for the photoshoot. It shows an AR picture of the chosen location, with the current location of the sun and the moon in the sky at any particular moment. This app allows calculating the length of shadows and distance between elevations. Sun Surveyor is available at GooglePlay and App Store for $7.99. More than a million users have downloaded this app (with the addition of the Lite version). It’s only a tiny part of the possibilities, which became available with augmented reality. The number of fields where AR is getting applied is growing every year.

The field of augmented and virtual reality development is developing by leaps and bounds: Facebook announced its plans to build a metaverse, major market players release new AR / VR / MR devices, new technologies and tools appear regularly. These factors represent both opportunities and challenges. It is very easy to lag behind the development of new directions, to concentrate on the familiar and convenient. Research & Development in VR/AR In order to stay at the peak of new solutions, we at Qualium Systems made a decision about a year ago to create an R&D department in virtual and augmented reality. As part of this department, we master and test new features, tools and capabilities. We use everything that has a perspective to solve the business problems of our clients. Passthrough API For example, we were one of the first to test a then new feature for Oculus Quest 2 – Passthrough API. This technology enables mixed reality experiences that combine real and virtual worlds into one. Immediately after an update became available, we started testing the API. It is an exciting promise by Oculus and has a lot of perspective. We are already brainstorming the ideas of using Passthrough API to solve our clients’ business issues. To test Passthrough API, we used the following Technology stack: Unity SDK, Oculus SDK 31-34, Passthrough API. Our experiment with the Passthrough API was for V31 when the technology was in experimental mode. In the further V34 version of Oculus, the Passthrough API has ceased to be an experimental function and now it does not need to be activated by a user via the console. You can watch our experiment in the video.   Comparison of the Oculus 2 with Passthrough API and HoloLens 2 Also, in continuation of our experiments with the Passthrough API technology, we decided to test the hypothesis – Can the Oculus 2 with Passthrough API take the place of HoloLens 2? After the MRTK library has been adapted to the Oculus Quest 2 and in the ver. 30 of the Operating system we received a pass-through feature, we decided to check if Oculus 2 could be used as an alternative to expensive HoloLens 2. To validate the idea, we’ve made two applications with the same features on the Oculus Quest 2 and on the HoloLens 2. You can see the result in the article http://ad88-46-150-10-153.eu.ngrok.io/blog/ar-vr/can-the-oculus-2-with-passthrough-api-take-the -place-of-hololens-2-checking-the-hypothesis. As part of our experiments, we are trying to highlight the industries that can most benefit from XR technologies, especially during a pandemic and its aftermath. The standalone application with computer vision base on Barracuda and TF model We understood that during the COVID-19 pandemic, many people lost the opportunity to train in the gym with a trainer. Lack of coaching support can lead to improper exercise performing, which in turn can lead to injury. But thanks to modern technology, it has become possible to train correctly. We are creating a standalone application with computer vision based on Barracuda and TF model. You view a recording of an exercise with a trainer and repeat it in real time. The computer vision based on Barracuda and TF model technology compares your movements and displays information on how well you perform the exercise. You can see the result in the video.   Tensorflow lite body recognition As part of testing our hypotheses that can be applied to sports and fitness, we compare Tensorflow lite body recognition based on PoseNet model and Unity Barracuda using tfjs-to-tf and tf2onnx.   Face tracking on PC with Unity SDK and UltraFaceBarracuda One industry that can benefit from XR adoption is Retail. As part of this direction, we tested Face tracking on PC with Unity SDK and UltraFaceBarracuda: depending on the face position, the picture that a person is looking at moves. As a result of this, the effect of a hologram is created. It is an interesting solution for marketing purposes with the ability to track people’s actions and test various marketing activities. To do so, we used the Technology stack: Unity SDK, UltraFaceBarracuda. See the result in the video. This is a small part of our experiments. We continue to research, hypothesize, and help our clients.

The AR / VR industry is rapidly evolving. One by one, tech giants announce the release of new devices, solutions and technologies. We decided to make brief reviews of the most interesting news, so that you keep abreast of the latest events. Lynx-R1’S Successful Kickstarter Ends With Over $800,000 Raised The Kickstarter crowd-funding campaign for the Lynx-R1 mixed reality (MR) headset was a success before it even had time to warm up, managing to exceed its $300,000 USD funding goal in less than a day. Now the campaign has concluded with over one thousand backers supporting the project and just over $800,000 raised over one month. https://www.vrfocus.com/2021/11/lynx-r1s-successful-kickstarter-ends-with-over-800000-raised/ Meta and Microsoft announce partnership to integrate Workplace and Teams Meta, the company formerly known as Facebook, announced a partnership with Microsoft that will allow customers to integrate Meta’s Workplace enterprise social network software with Microsoft Teams. The integration gives customers access to Workplace content inside the Teams app. Likewise, users can view Teams video meetings in the Workplace app. https://www.cnbc.com/2021/11/10/meta-and-microsoft-announce-partnership-to-integrate-workplace-and-teams.html Nreal Brings The First AR Glasses To America, Via Verizon Light was previously only available in Germany, Spain, Japan, and South Korea. It weighs around three times a heavy pair of sunglasses, or a third of a Magic Leap One headset. To achieve this form factor Light is powered by your smartphone over a USB cable, there is no battery or full-fledged chip onboard. https://uploadvr.com/nreal-light-ar-glasses-usa-launch/ Ultraleap raises £60 million in Series D fundraise to be the primary interface for the metaverse Ultraleap, the world leader in interface technologies – hand tracking and mid-air haptics – announced it has completed a £60 million ($82 million) Series D round of investment. The raise will enable Ultraleap to further develop and commercialise its revolutionary technologies for existing and next generation computing platforms. https://www.ultraleap.com/company/news/press-release/series-d-fundraise/ Huawei Launches VR Glass 6DoF Headset Speaking at the Huawei Full Scenario Smart Life Conference, the Chinese tech giant said as quoted by Huawei Central it would launch its VR Glass 6 degrees-of-freedom (DoF) game headset, which weighs only 188 grammes and can connect to Huawei smartphones and PCs with a Type-C cable. https://www.xrtoday.com/virtual-reality/huawei-launches-vr-glass-6dof-headset/ Niantic Receives $300 Million Investment From Coatue Niantic Inc., developer of the world’s first and only planet-scale AR platform, announced that Coatue has made a $300 million investment in the company at a valuation of $9 billion. Niantic will use the funds to invest in current games and new apps, expand the Lightship developer platform, and build out its vision for the Real-World Metaverse. https://nianticlabs.com/blog/coatue/

Virtual reality is a continuously developed technology as a powerful tool for learning in enterprise environments. The main advantage is that virtual reality training allows students to practice working processes with near real-life experience in a suitable time and place. It allows to check a student’s knowledge and trained skills consistently by using well-developed work processes flow scenarios with assessments on the special checkpoints and, what is important, all of that is going in-game. The PwC study found that VR in soft skills training can provide such advantages: Employees in VR courses can be trained up to four times faster. VR learners are more confident in applying what they’re taught. Employees are more emotionally connected to VR content. VR learners are more focused, VR learning can be more cost-effective at scale. In this article, we are providing two case VR simulators overviews that were developed by our company, so based on this information, you could consider whether it’s a good idea for your company training strategy as well. You can consider the VR simulators usage if: You want to train and cooperate in VR despite distance and time. You want to save money and time. You want to make your training effective and engaging. You want to engage employees in a fun like a game way to reduce overwhelming. You want to train safety procedures in a comfortable, safe environment. Let’s go deeper into the specific VR simulators area of usage. Please note that we developed our simulators for Oculus Quest 2. This device has a low price, but it allows you to use all the possibilities of virtual reality. Safety skills training Chemical safety training VR simulator VR can be used to carry out affordable, simple to organize safety skills training of various types under the regulatory requirements. If your company manufactures chemical mixtures in Canada, Europe, or the US, you may be subject to different regulatory requirements, one of which is the presence of chemical safety training modules for the workers. Our VR simulator provides near real-life experience training in the VR environment for the workers and allows them to go through the whole tech process step-by-step. The training provides tips for each step with consistent implementation. The worker gets theoretical knowledge and sharpens practical skills under the safety rules set for this specific industry. Technology: Unity3D, C#, 3DS Max, Photoshop Equipment training VR welding training VR can be really an irreplaceable thing when it comes to training the skills of working with special equipment. VR welding simulator is intended for students as a near real-life training which simulates the whole process of the welding torch set up before starting the work. VR simulator, as an operation and maintenance of welding and cutting equipment, is conformed to the provisions of American National Standard Z49.1, “Safety in Welding and Cutting”. VR allows students to experience real-life experiences without real-life consequences. VR offers a student the opportunity to become completely immersed in a given working situation using equipment that can be set up virtually anywhere. This experience is different to screen-based learning since a student becomes surrounded by the experience. Technology: Unity, UnityXR Interaction Toolkit, Blender, C# Conclusion If you want to avoid mistakes in the working places, save money and time for their correction, you can get on track with the VR cutting edge technologies implementation into your corporate training world which will bring a bunch of benefits for your company.

The AR / VR industry is rapidly evolving. One by one, tech giants announce the release of new devices, solutions and technologies. We decided to make brief reviews of the most interesting news, so that you keep abreast of the latest events. Qualcomm launches new AR dev kit, acquires Clay AIR Qualcomm today launched a new developer platform for building head-worn augmented reality experiences: the Snapdragon Spaces XR Developer Platform. https://techcrunch.com/2021/11/09/qualcomm-launches-new-ar-dev-kit-acquires-clay-air/ Niantic releases Lightship Augmented Reality Developer Kit AR technology company Niantic has announced that it is opening its Lightship Augmented Reality Developer Kit (ARDK) to developers that will make creating augmented reality experiences more accessible. https://www.financialexpress.com/brandwagon/niantic-releases-lightship-augmented-reality-developer-kit/2366292/ Meta Announces AR Glasses Prototype Project Nazare Alongside the reveal of the new Project Cambria VR headset, Meta (formerly Facebook) has just given a codename to its first pair of consumer AR glasses. Meet Project Nazare. https://uploadvr.com/meta-ar-glasses-project-nazare/ Cisco Launches Webex Hologram For Meetings At WebexOne, Cisco unveiled a preview of its next-generation hybrid work collaboration product. Webex Hologram is the industry’s only real-time meeting solution that takes advantage of augmented reality headsets to combine feature rich Webex meeting functionality with immersive 3D holograms. http://svdaily.com/2021/11/02/cisco-launches-webex-hologram-for-meetings/ Microsoft Teams enters the metaverse race with 3D avatars and immersive meetings Microsoft is entering the race to build a metaverse inside Teams, just days after Facebook rebranded to Meta in a push to build virtual spaces for both consumers and businesses. Microsoft is bringing Mesh, a collaborative platform for virtual experiences, directly into Microsoft Teams next year. https://www.theverge.com/2021/11/2/22758974/microsoft-teams-metaverse-mesh-3d-avatars-meetings-features

After the MRTK library has been adapted to the Oculus Quest 2 and in the ver. 30 of the Operating system we received a pass-through feature, we decided to check if Oculus 2 could be used as an alternative to expensive HoloLens 2. To validate the idea, we’ve made two applications with the same features on the Oculus Quest 2 and on the HoloLens 2. You can see the result in the video at the end of the article. Short introduction and comparison of headsets OQ2 vs HL2 For those who want to get more information on these devices, we have prepared a small review. Oculus Quest 2 Oculus Quest 2 is a virtual reality (VR) headset created by Oculus, a brand of Facebook. As with its predecessor, the Quest 2 is capable of running both a standalone headset with an internal, Android-based operating system, and with Oculus-compatible VR software running on a desktop computer when connected over USB or Wi-Fi. Hardware. The Quest 2 utilizes the Qualcomm Snapdragon XR2 system-on-chip (which is part of a Snapdragon product line designed primarily for VR and augmented reality devices), with 6 GB of RAM — an increase of 2 GB over the first-generation model. Its display is a singular fast-switch LCD panel with a 1832×1920 per eye resolution, which can run at a refresh rate of up to 120 Hz (an increase from 1440×1600 per-eye at 72 Hz). The headset includes physical interpupillary distance (IPD) adjustment at 58 mm, 63 mm and 68 mm, adjusted by physically moving the lenses into each position. This is also combined with software adjustment. The included Oculus Touch controllers are slightly bigger, influenced by the original Oculus Rift’s controllers. Their battery life has also been increased four-fold over the controllers included with the first-generation Quest. Hololens 2 The HoloLens 2 is a combination of waveguide and laser-based stereoscopic & full-color mixed reality smart glasses developed and manufactured jointly by Microsoft and MicroVision, Inc. in Redmond, Washington. It is the direct model successor to the pioneering Microsoft HoloLens and the technical successor to the MicroVision stereoscopic and monochromatic laser-based virtual retinal display (VRD) & helmet mounted display (HMD) prototype-in-the-running for the canceled RAH-66 Comanche stealth helicopter and the now-defunct monoscopic and monochromatic MicroVision Nomad Augmented Vision System. Hardware. The HoloLens features an inertial measurement unit (IMU) (which includes an accelerometer, gyroscope, and a magnetometer) four “environment understanding” sensors (two on each side), an energy-efficient depth camera with a 120°×120° angle of view, a 2.4-megapixel photographic video camera, a four-microphone array, and an ambient light sensor. The HoloLens contains an internal rechargeable battery, with average life rated at 2–3 hours of active use, or 2 weeks of standby time. The HoloLens can be operated while charging. HoloLens features IEEE 802.11ac Wi-Fi and Bluetooth 4.1 Low Energy (LE) wireless connectivity. The headset uses Bluetooth LE to pair with the included Clicker, a thumb-sized finger-operating input device that can be used for interface scrolling and selecting. The Clicker features a clickable surface for selecting, and an orientation sensor which provides scrolling functions via tilting and panning of the unit. The Clicker features an elastic finger loop for holding the device, and a USB 2.0 micro-B plug socket for charging its internal battery. HoloLens 2 and Oculus Quest 2 have different operating systems, provide different user experience and have different types of interaction with the system and world. Development process Developing applications for Oculus Quest 2 is based on the basic rules and best practices with specific oculus Quest side requirements using Unity engine. If we are talking about HoloLens 2, we have to develop an application for the Universal Windows Platform with specific restrictions and additional capabilities provided by Windows 10 Holographic operating system using the MRTK library provided by Microsoft. Some time ago we found that the MRTK library has been adapted to the Oculus Quest 2 and we started using it in our projects. This library has a lot of prepared elements that save time for prototyping and development. In the ver. 30 of the Operating system we received a pass-through feature from Oculus Quest 2 that allows us to step outside your view in VR to see a real-time view of your surroundings. Passthrough uses the sensors on your headset to approximate what you would see if you were able to look directly through the front of your headset and into the real world around you. Taking into account these feature possibilities, we decided to check if Oculus could be used as an alternative to expensive HoloLens 2. To validate the idea, we’ve made two applications with the same features on the Oculus Quest 2 and on the HoloLens 2. The result you can see in the video.   The summary Oculus Quest cannot be used as an alternative to the HoloLens for our purpose. The pass-through feature is not the same as Mix Reality. The possibility to work in the real world with Oculus Quest is limited. Also, Oculus Quest has no camera for recognition of images or objects, Oculus Quest doesn’t have lidar or high resolution cameras because Oculus Quest is a B2C product, not a B2B product. If you have tasks that are suitable for HoloLens 2, use it. Oculus Quest 2 provides some experience of HoloLens 2 usage but these experiences are too limited to make Oculus Quest 2 an alternative to HoloLens 2.

Many companies are beginning to understand the value of virtual reality technology as it caters to a wide variety of learning needs. This is largely due to the fact that VR pushes the boundaries of traditional learning, allowing you to create realistic learning scenarios in a simulated environment. Also, another important factor in the spread of virtual reality training solutions is that the cost of its implementation has fallen drastically. According to PwC, 23 million jobs will be using virtual or augmented reality by 2030. This will have the greatest impact on such large economies as China, the USA, the UK and Germany. This is the time when companies need to be proactive and forward-thinking to get the most out of virtual and augmented reality technologies. The main advantages of VR training: Ability to create a safe learning environment. Involvement of employees in the learning process. Reduced training costs. Development of practical skills. Scalability. Ability to track key learning indicators. Areas of VR training application: Simulation of complex processes in a safe environment, for example, actions in case of an emergency. Working out actions according to certain algorithms, instructions or checklists. Development of soft skills in areas such as customer service and management. Adaptation of personnel to the cultural norms of the company. Learning to work with equipment, machinery or complex processes. When considering how VR can be used to solve learning problems, companies in any case must understand their learning goals and determine which technology will help them achieve those goals.

What is AR and VR? Augmented Reality (AR) is a technology that enhances or augments your experience of the world around you, using devices such as smartphones, glasses, projectors etc. Virtual Reality (VR) is a technology that makes a person feel like they are somewhere else. It uses software to produce sensations to make users feel like they are apart of this other place. User needs to use devices, such as special glasses with a screen or/and gloves fitted with sensors. Here are 6 Industries where Virtual and Augmented reality is being actively used besides gaming: 1. Sports By putting on a VR headset an athlete can feel like they are located in a real-life game setting. The feeling of “realness” can allow them for more training and simulate exact situations that require additional practice. Demo of our work 2. Supply Chain Warehouse Planning Using Mixed Reality to “field test” modifications Transportation Optimization Capture pallet numbers and volume using object recognition. Automated confirmation of pick-up/delivery by AR after the correct number of parcels is recognized Freight Loading Loader receives a plan and instructions on pallet order and placing directly on their AR device display Parcel Loading & Drop-off Through AR, all parcels are overlaid with custom information such as weight, contents, destination etc. Staff Safety and on-job training 3. Educational industry VR and AR technology helps students concentrate on what is in front of their eyes, they are being ‘forced’ to interact with their studies and exclude any potential side distractions. This is making the books, lectures and exercises more immersive and engaging. That way they are becoming a better solution for seizing students’ focus and attention. Demo of our work 4. Architectural design & construction VR is making solving complex structures more efficient. Now it is possible to determine whether a given structure is practically possible or not, making projects more robust and accurate. Today it has also become common in modern cities to take a tour of homes using VR equipment. VR allows you to step into architectural designs not just by seeing a paper blueprint, now feel the environment in the 3D model. AR in construction allows combining designs with the physical job site. 5. E-commerce and Retail AR allows customers to preview and experience products any time from any environment, before making a purchase. In 2020 retailers are venturing into the virtual world. There, a shopper can walk through a virtual store and look at goods as they would in real life. Businesses can now run shops and ship products to customers without actually owning any physical space. Demo of our work 6. Healthcare AR apps are being used for a variety of tasks, from enabling surgeons to peer inside a patient’s body without making large incisions to helping patients by identifying their symptoms. VR has also proven useful in diagnosing, treating, and easing the symptoms of autism depression dementia, phobias, psychiatric disorders. Mariia Kalashnyk, Qualium Systems, Business Development Manager   Those who adapt to new technologies and take advantage of them earlier are more likely to succeed. Would you like to get ahead of the competitors? Do you need to develop VR or AR-based software?

Recently, more and more companies have started using virtual reality technology for training employees. This is due to the fact that the cost of implementing virtual reality has fallen and the technology itself has become more widespread. In addition, VR has become much more affordable and available thanks to the recent growth in virtual reality (VR) devices. What is virtual reality training? Virtual Reality Training is a digital simulation of learning situations that can occur in real-life conditions. With the help of a special headset and controllers, students operate in a three-dimensional virtual environment, interacting with objects and people. What companies use virtual reality for training? Boeing. UPS. Walmart. Porsche. Henkel. BP. ExxonMobil. UPS. Why is vr training important? We have prepared a small selection of articles that tell about the advantages and disadvantages of using virtual reality for training company employees. How virtual reality is redefining soft skills training Source: PricewaterhouseCoopers Summary: Companies need employees with the right mix of skills, including “soft” skills like leadership and resilience. The prevalence of remote work makes effective digital training approaches more crucial than ever. VR training offers an affordable way to upskill employees faster and with better results. The Growing Impact of Virtual Reality Training Source: HRMagazine Summary: As usage increases and costs drop, the technology is now being used for soft skills, DE&I and leadership training. With in-person learning placed on hold during the pandemic, more organizations turned to VR training because of its increased affordability and proven ability to teach employees working remotely. Learning experts stress that VR training isn’t the right solution for all needs and should be matched to situations that best fit the medium. Why Walmart and other F500 companies are using virtual reality to train the next generation of American workers Source: CNBC Summary: Several F500 companies, such as Boeing, UPS and Walmart, are folding virtual reality into worker education and training programs. Companies have seen retention rates and productivity numbers rise when they use VR as a training tool. Augmented reality is another tech tool companies are opting for to upskill their workforce. Is VR the Future of Corporate Training? Source: Harvard Business Review Summary: VR is increasingly being used to help train employees to do their jobs. VR is being used to train employees in “soft skills” to improve customer service and managerial skills. VR shows a unique balance across experiments — it is immersive enough for people to take the training seriously, but also a safe environment where learners are less self-conscious about speaking frankly compared to talking to real people.