R&D department in extended reality: several examples of experiments and research
December 9, 2021
Extended Reality R&D department: several examples of experiments and research

The field of augmented and virtual reality development is developing by leaps and bounds: Facebook announced its plans to build a metaverse, major market players release new AR / VR / MR devices, new technologies and tools appear regularly. These factors represent both opportunities and challenges. It is very easy to lag behind the development of new directions, to concentrate on the familiar and convenient. Research & Development in VR/AR In order to stay at the peak of new solutions, we at Qualium Systems made a decision about a year ago to create an R&D department in virtual and augmented reality. As part of this department, we master and test new features, tools and capabilities. We use everything that has a perspective to solve the business problems of our clients. Passthrough API For example, we were one of the first to test a then new feature for Oculus Quest 2 – Passthrough API. This technology enables mixed reality experiences that combine real and virtual worlds into one. Immediately after an update became available, we started testing the API. It is an exciting promise by Oculus and has a lot of perspective. We are already brainstorming the ideas of using Passthrough API to solve our clients’ business issues. To test Passthrough API, we used the following Technology stack: Unity SDK, Oculus SDK 31-34, Passthrough API. Our experiment with the Passthrough API was for V31 when the technology was in experimental mode. In the further V34 version of Oculus, the Passthrough API has ceased to be an experimental function and now it does not need to be activated by a user via the console. You can watch our experiment in the video.   Comparison of the Oculus 2 with Passthrough API and HoloLens 2 Also, in continuation of our experiments with the Passthrough API technology, we decided to test the hypothesis – Can the Oculus 2 with Passthrough API take the place of HoloLens 2? After the MRTK library has been adapted to the Oculus Quest 2 and in the ver. 30 of the Operating system we received a pass-through feature, we decided to check if Oculus 2 could be used as an alternative to expensive HoloLens 2. To validate the idea, we’ve made two applications with the same features on the Oculus Quest 2 and on the HoloLens 2. You can see the result in the article http://ad88-46-150-10-153.eu.ngrok.io/blog/ar-vr/can-the-oculus-2-with-passthrough-api-take-the -place-of-hololens-2-checking-the-hypothesis. As part of our experiments, we are trying to highlight the industries that can most benefit from XR technologies, especially during a pandemic and its aftermath. The standalone application with computer vision base on Barracuda and TF model We understood that during the COVID-19 pandemic, many people lost the opportunity to train in the gym with a trainer. Lack of coaching support can lead to improper exercise performing, which in turn can lead to injury. But thanks to modern technology, it has become possible to train correctly. We are creating a standalone application with computer vision based on Barracuda and TF model. You view a recording of an exercise with a trainer and repeat it in real time. The computer vision based on Barracuda and TF model technology compares your movements and displays information on how well you perform the exercise. You can see the result in the video.   Tensorflow lite body recognition As part of testing our hypotheses that can be applied to sports and fitness, we compare Tensorflow lite body recognition based on PoseNet model and Unity Barracuda using tfjs-to-tf and tf2onnx.   Face tracking on PC with Unity SDK and UltraFaceBarracuda One industry that can benefit from XR adoption is Retail. As part of this direction, we tested Face tracking on PC with Unity SDK and UltraFaceBarracuda: depending on the face position, the picture that a person is looking at moves. As a result of this, the effect of a hologram is created. It is an interesting solution for marketing purposes with the ability to track people’s actions and test various marketing activities. To do so, we used the Technology stack: Unity SDK, UltraFaceBarracuda. See the result in the video. This is a small part of our experiments. We continue to research, hypothesize, and help our clients.

Augmented and Virtual Reality News Briefs
December 1, 2021
Augmented and Virtual Reality News Briefs (November)

The AR / VR industry is rapidly evolving. One by one, tech giants announce the release of new devices, solutions and technologies. We decided to make brief reviews of the most interesting news, so that you keep abreast of the latest events. Lynx-R1’S Successful Kickstarter Ends With Over $800,000 Raised The Kickstarter crowd-funding campaign for the Lynx-R1 mixed reality (MR) headset was a success before it even had time to warm up, managing to exceed its $300,000 USD funding goal in less than a day. Now the campaign has concluded with over one thousand backers supporting the project and just over $800,000 raised over one month. https://www.vrfocus.com/2021/11/lynx-r1s-successful-kickstarter-ends-with-over-800000-raised/ Meta and Microsoft announce partnership to integrate Workplace and Teams Meta, the company formerly known as Facebook, announced a partnership with Microsoft that will allow customers to integrate Meta’s Workplace enterprise social network software with Microsoft Teams. The integration gives customers access to Workplace content inside the Teams app. Likewise, users can view Teams video meetings in the Workplace app. https://www.cnbc.com/2021/11/10/meta-and-microsoft-announce-partnership-to-integrate-workplace-and-teams.html Nreal Brings The First AR Glasses To America, Via Verizon Light was previously only available in Germany, Spain, Japan, and South Korea. It weighs around three times a heavy pair of sunglasses, or a third of a Magic Leap One headset. To achieve this form factor Light is powered by your smartphone over a USB cable, there is no battery or full-fledged chip onboard. https://uploadvr.com/nreal-light-ar-glasses-usa-launch/ Ultraleap raises £60 million in Series D fundraise to be the primary interface for the metaverse Ultraleap, the world leader in interface technologies – hand tracking and mid-air haptics – announced it has completed a £60 million ($82 million) Series D round of investment. The raise will enable Ultraleap to further develop and commercialise its revolutionary technologies for existing and next generation computing platforms. https://www.ultraleap.com/company/news/press-release/series-d-fundraise/ Huawei Launches VR Glass 6DoF Headset Speaking at the Huawei Full Scenario Smart Life Conference, the Chinese tech giant said as quoted by Huawei Central it would launch its VR Glass 6 degrees-of-freedom (DoF) game headset, which weighs only 188 grammes and can connect to Huawei smartphones and PCs with a Type-C cable. https://www.xrtoday.com/virtual-reality/huawei-launches-vr-glass-6dof-headset/ Niantic Receives $300 Million Investment From Coatue Niantic Inc., developer of the world’s first and only planet-scale AR platform, announced that Coatue has made a $300 million investment in the company at a valuation of $9 billion. Niantic will use the funds to invest in current games and new apps, expand the Lightship developer platform, and build out its vision for the Real-World Metaverse. https://nianticlabs.com/blog/coatue/

Apple To Launch An Augmented Reality Headset In Late 2022
November 26, 2021
Ming-Chi Kuo’s prediction: Apple to launch an augmented reality headset in late 2022

A renowned analyst Ming-Chi Kuo predicted Apple’s augmented reality headset release in late 2022 in a new research report. According to Kuo, the headset’s main processor will be similar to the M1 chip that Apple introduced to its computers last year, with a second processor operating the sensors of the device. Presumably, the AR headset will work independently, without the need to be tied to a Mac or iPhone, and Apple intends to support a “wide range of applications” with an eye on iPhone replacement within ten years. There is also the possibility that the headset will be able to support the virtual reality function thanks to 4K Micro OLED displays from Sony.

Virtual Reality Training Simulators_Two demo videos for different industries
November 25, 2021
Virtual Reality Training Simulators. Two demo videos for different industries

Virtual reality is a continuously developed technology as a powerful tool for learning in enterprise environments. The main advantage is that virtual reality training allows students to practice working processes with near real-life experience in a suitable time and place. It allows to check a student’s knowledge and trained skills consistently by using well-developed work processes flow scenarios with assessments on the special checkpoints and, what is important, all of that is going in-game. The PwC study found that VR in soft skills training can provide such advantages: Employees in VR courses can be trained up to four times faster. VR learners are more confident in applying what they’re taught. Employees are more emotionally connected to VR content. VR learners are more focused, VR learning can be more cost-effective at scale. In this article, we are providing two case VR simulators overviews that were developed by our company, so based on this information, you could consider whether it’s a good idea for your company training strategy as well. You can consider the VR simulators usage if: You want to train and cooperate in VR despite distance and time. You want to save money and time. You want to make your training effective and engaging. You want to engage employees in a fun like a game way to reduce overwhelming. You want to train safety procedures in a comfortable, safe environment. Let’s go deeper into the specific VR simulators area of usage. Please note that we developed our simulators for Oculus Quest 2. This device has a low price, but it allows you to use all the possibilities of virtual reality. Safety skills training Chemical safety training VR simulator VR can be used to carry out affordable, simple to organize safety skills training of various types under the regulatory requirements. If your company manufactures chemical mixtures in Canada, Europe, or the US, you may be subject to different regulatory requirements, one of which is the presence of chemical safety training modules for the workers. Our VR simulator provides near real-life experience training in the VR environment for the workers and allows them to go through the whole tech process step-by-step. The training provides tips for each step with consistent implementation. The worker gets theoretical knowledge and sharpens practical skills under the safety rules set for this specific industry. Technology: Unity3D, C#, 3DS Max, Photoshop Equipment training VR welding training VR can be really an irreplaceable thing when it comes to training the skills of working with special equipment. VR welding simulator is intended for students as a near real-life training which simulates the whole process of the welding torch set up before starting the work. VR simulator, as an operation and maintenance of welding and cutting equipment, is conformed to the provisions of American National Standard Z49.1, “Safety in Welding and Cutting”. VR allows students to experience real-life experiences without real-life consequences. VR offers a student the opportunity to become completely immersed in a given working situation using equipment that can be set up virtually anywhere. This experience is different to screen-based learning since a student becomes surrounded by the experience. Technology: Unity, UnityXR Interaction Toolkit, Blender, C# Conclusion If you want to avoid mistakes in the working places, save money and time for their correction, you can get on track with the VR cutting edge technologies implementation into your corporate training world which will bring a bunch of benefits for your company.

Сompletion of the Technical skills for Project Managers and Business Analyst course
November 17, 2021
Qualium Systems employees continue to develop their skills

As our business analyst likes to say: If you want to know how developers are working, you need to think like a developer. That’s why he made his twenty-first step in the developer’s shoes with the E5 training center. The result of this path was the successful completion of the Technical skills for Project Managers and Business Analyst course. TRANSLATE with x English Arabic Hebrew Polish Bulgarian Hindi Portuguese Catalan Hmong Daw Romanian Chinese Simplified Hungarian Russian Chinese Traditional Indonesian Slovak Czech Italian Slovenian Danish Japanese Spanish Dutch Klingon Swedish English Korean Thai Estonian Latvian Turkish Finnish Lithuanian Ukrainian French Malay Urdu German Maltese Vietnamese Greek Norwegian Welsh Haitian Creole Persian TRANSLATE with COPY THE URL BELOW Back EMBED THE SNIPPET BELOW IN YOUR SITE Enable collaborative features and customize widget: Bing Webmaster Portal Back

AR/VR_Industry News Brief
November 11, 2021
Why did everyone start developing AR/VR Apps and you need it too? Industry News Briefs (October – November)

The AR / VR industry is rapidly evolving. One by one, tech giants announce the release of new devices, solutions and technologies. We decided to make brief reviews of the most interesting news, so that you keep abreast of the latest events. Qualcomm launches new AR dev kit, acquires Clay AIR Qualcomm today launched a new developer platform for building head-worn augmented reality experiences: the Snapdragon Spaces XR Developer Platform. https://techcrunch.com/2021/11/09/qualcomm-launches-new-ar-dev-kit-acquires-clay-air/ Niantic releases Lightship Augmented Reality Developer Kit AR technology company Niantic has announced that it is opening its Lightship Augmented Reality Developer Kit (ARDK) to developers that will make creating augmented reality experiences more accessible. https://www.financialexpress.com/brandwagon/niantic-releases-lightship-augmented-reality-developer-kit/2366292/ Meta Announces AR Glasses Prototype Project Nazare Alongside the reveal of the new Project Cambria VR headset, Meta (formerly Facebook) has just given a codename to its first pair of consumer AR glasses. Meet Project Nazare. https://uploadvr.com/meta-ar-glasses-project-nazare/ Cisco Launches Webex Hologram For Meetings At WebexOne, Cisco unveiled a preview of its next-generation hybrid work collaboration product. Webex Hologram is the industry’s only real-time meeting solution that takes advantage of augmented reality headsets to combine feature rich Webex meeting functionality with immersive 3D holograms. http://svdaily.com/2021/11/02/cisco-launches-webex-hologram-for-meetings/ Microsoft Teams enters the metaverse race with 3D avatars and immersive meetings Microsoft is entering the race to build a metaverse inside Teams, just days after Facebook rebranded to Meta in a push to build virtual spaces for both consumers and businesses. Microsoft is bringing Mesh, a collaborative platform for virtual experiences, directly into Microsoft Teams next year. https://www.theverge.com/2021/11/2/22758974/microsoft-teams-metaverse-mesh-3d-avatars-meetings-features

VRium
November 5, 2021
VRium study program big update: added 7 important interactive visualizations

VRium is an engaging, interactive VR chemistry simulator that helps students get the most from chemistry theory and practice, developing the needed level of knowledge and honing the skills. Take part in beta testing the VRium App. To do this, please fill out the following form. To provide a real-life experience we have developed a study programme for the VRium using typical curricula of General and Inorganic Chemistry courses used in Ukrainian schools and universities. The first part in this programme is “Atomic Structure and Periodic Table”, which starts from the Topic 1 “Atomic Orbitals in Hydrogen Atom”. For this topic we have prepared the following interactive visualizations. 1.1. Rutherford’s Model of Atom The first model of atomic structure by Thompson postulated that electrons are located in positively charged medium. Famous experiments by Rutherford (1911) disproved this model. In new Rutherford’s model of atom, a light electron moves along a circular orbit around a heavy and small nucleus, which is just the proton in case of Hydrogen atom. Here the model is presented simply as an animation of electron moving in a circle around proton. This model forms a common perception of atomic structure and thus has to be discussed in some more details. 1.2. Rutherford model and Classical Electrodynamics Rutherford’s model was unsatisfactory. It correctly described experimental distributions of charge and mass in atoms. But Rutherford’s atom is unstable in classical electrodynamics, which predicts that an electron has to accelerate while moving on circular orbit, and if there is no external energy supply, it should lose energy by emission of electromagnetic radiation. Decreasing energy of an electron will decrease the radius of its orbit, and thus after some small time (estimated to be about 10-11s) the electron should fall onto the proton and Rutherford’s atom would annihilate. This consideration is illustrated pictorially: an electron emits light and quickly falls onto the proton, moving on some orbit around it. This illustration gives a hint: given that in reality atoms are stable, either the electronic orbits in atoms are more complex, or somehow usual physics laws are not applicable for atoms. 1.3. Unstable Equilibrium in Classical Electrostatics Another problem with classical description of atoms is its complete inability to explain the stability of molecules. Atoms in molecules are held together by chemical bonds, where electrons are located between nuclei. But according to Earnshow’s theorem, the stable static equilibrium cannot exist in any system of point charges. So when an electron is located exactly between 2 protons, attraction forces are compensated, and equilibrium is achieved. But it’s not stable: if an electron is shifted by arbitrarily small distance towards any nucleus, forces will become unbalanced, the electron will fall onto the nucleus and the system will annihilate. 1.4. Bohr’s model Also classical picture could not describe atomic emission spectra. In that model, electron could have any energy, so photon with any wavelength could be emitted or absorbed. This contradicts experimental data – atomic spectra consist of discrete narrow lines. In 1913 Niels Bohr fixed this problem in an ad-hoc manner by letting electron move only on some discrete set on circular orbits. Electron on each such stable orbit has definite energy, so moving between orbits is accompanied by absorption or emission of photon with specific wavelength. This simple picture reproduces lines of atomic spectra, but is self-contradictory and cannot be extended to molecules or even multi-electron atoms. This development is depicted by electron moving on a second circular orbit around proton. After the electron emits a photon it moves to lower orbit. This model is valid for atoms and ions with a single electron: Hydrogen, He+, Li2+, Be3+, but theory cannot account for electron interactions – there’s no place for the second electron. 1.5. Quantum mechanical Hydrogen Atom These problems were solved when in 1925 Schrodinger and other scientists developed modern quantum mechanics. Instead of classical electron that moves on some definite trajectory, it describes electron which can appear everywhere in space. Probability to find it and all physical values that can be measured are governed by a so-called wave function. This wave function is not arbitrary, it must satisfy the Schrodinger equation. This is illustrated as electron that loses its orbit around the nucleus. In experiments when the position of electron is successively measured, results are not located on some line, but can appear everywhere in space. Still, the probability to find electron near the nucleus is much higher than to find it high away from it. 1.6. What is Electronic Cloud? This interactive visualization shows 1s orbital of Hydrogen atom. Here the user observes measured positions of electron and can change the radius of the sphere around the nucleus. Increasing sphere size increases the chance to find electron inside it, but this chance never reaches 100%. This accustoms the user with the nature of atomic orbitals as some kind of distribution of probability to find electron. 1.7. Structure of s-orbitals This interactive visualization shows the inner structure of ns atomic orbitals. It turns out that for orbitals with higher main quantum number n, there are places where electron cannot be located. Number of such places increases as n-1, and these zones separate regions with different signs of wave function. User takes a short quiz after this visualization to memorize the connection between the structure of ns orbital and main quantum number n. After introducing the concept of atomic orbitals (applicable to Hydrogen atom and atomic ions with single electrons), the next logical step is to describe multi-electron atoms. Thus the next topic will include concepts of electronic configurations, rules used to construct them, as well as their relevance to periodic table, chemical properties and chemical bonding.

AR portal, which opens a passage to an unknown and scary place
October 29, 2021
We have made a couple of interesting features to make you feel the Halloween atmosphere even more

Our guys from the Unity department have done a great job. Halloween is coming soon and we have made a couple of interesting features to make you feel the holiday atmosphere even more. Try on scary masks and share pictures with your friends, or enemies, to make you even scarier. Follow the link https://webxr.run/nOGnww05b3JX5 and see for yourself how creepy it all looks and your knees will shake. Be sure to watch our atmospheric video with AR portal, which opens a passage to an unknown and scary place. Just a few seconds will be enough for you to feel a chill of quiet horror running down your spine. Be sure to turn up the volume and do not watch this video alone and in the dark)

Varjo_Aero
October 22, 2021
Varjo unveils Aero VR headset for the consumer market

Finnish company Varjo, supplier of high-end expensive headsets for the enterprise market like the xr3 and the vr3, yesterday announced the Aero VR headset. The main goal of the company is to release a more affordable headset that will find its customers among virtual reality enthusiasts. But at the same time, the cost of Varjo Aero is $ 1990 and this is only for the helmet itself, excluding base stations and controllers. The specifications of the new headset are impressive. The Varjo Aero offers 2,880 x 2,720 per eye resolution through dual mini LED displays with custom-made aspheric variable resolution lenses. It’s also got a 90Hz refresh rate and a 115 degree horizontal field of view (or 134 degrees diagonally). Aero has built-in eye tracking, which not only provides interaction and analytics, but also optimized rendering that further reduces computational requirements. That being said, the new headset does not have front-facing cameras, so there is no hand tracking or mixed reality support. But according to company representatives, this allowed to reduce the weight of the headset – it weighs only 717 grams. Orders for the Varjo Aero begin today, with first deliveries expected in December.