Nreal launches highly-anticipated high-fidelity, controller free hand tracking, announces partnership with Deutsche Telekom
Nreal, developer of ready-to-wear mixed reality glasses and 3D system Nebula, announces the launch of high-fidelity hand tracking powered by Clay AIR to support optical hand controls in conjunction with expanded carrier partnerships with Deutsche Telekom.
Ahead of the sales of the consumer version of Nreal Light, a milestone event that aims to kickstart and follow through a mission to make mass consumer adoption of mixed reality technology a reality, Nreal introduces an extra dimension of convenience through hand tracking in partnership with Clay AIR, a highly accurate and hardware agnostic interaction software solution to support optical hand controls.
In a pursuit of a frictionless user experience, high-fidelity hand tracking on Nreal Light is an intuitive way for users to manipulate or interact with their MR environment using their very own hands to pinch, grab and swipe holographic objects.
Best of all, Clay AIR hand tracking works by using Nreal Light's embedded spatial cameras to overlay a 3D hand model in full HD on top of the physical hand. Real time changes of the fingers and hands are tracked and rendered using state of the art deep learning algorithms. As an added benefit, when tethered to a smartphone using Qualcomm® Snapdragon™ 855 or above, Nreal Light is able to render and run overlaid hand tracking graphics smoothly without draining your power.
With hand tracking in high demand among the 3,500 developers building on Nreal Light, the feature will be made available through the Nreal SDK in the near future and can be deployed onto apps including native Android apps that can run on Nreal's 3D system. Customizations to hand tracking are available to developers through the Nreal SDK including remodeling or rendering full hands, separate fingers, a bounding box, cursor or customized skins. The library of gestures provided by Clay AIR include pinch, point, grab, swipe and zoom, among many other customizable ones.
"By offering hand tracking with Clay AIR, Nreal offers its developers and users of the Nreal Light Consumer Kit an added degree of flexibility in how they might want to interact with their MR environment, whether it's hand tracking, their 5G smartphone as a controller, a third-party 6DoF controller, or even in the near future eye tracking in partnership with 7invensun," said Chi Xu, CEO and founder of Nreal. "In fact, we don't believe that there's a single best way to interact with MR, and in fact could be a combination of control options at once, but we want to offer developers and users the choice to decide what's best for them."
“Clay AIR is proud to participate in the revolution Nreal is triggering. They are the leader in consumer AR and we are looking forward to continuously innovating and creating an industry platform with them,” said Varag Gharibjanian, CRO of Clay AIR.
“Consumer friendly hardware, powered by seamless hand tracking and gesture recognition technology, is a necessary catalyst to make AR accessible and practical on a global scale. This partnership marks an inflection point with the first integration of hand tracking via embedded monochrome cameras already used for spatial tracking in AR,” said Thomas Amilien, CEO of Clay AIR.
Further expanding its carrier network of partners in Europe ahead of the availability of the Nreal Light Consumer Kit and one step closer to delivering MR to mass consumers, Nreal follows its collaboration with EE in the United Kingdom to announce its partnership with Deutsche Telekom (DT). The partnership between DT and Nreal will aim to fully leverage 5G technology in Germany and other European markets on an MR platform by improving work-place efficiencies for businesses and enterprises like remote team collaboration or Field Support, while also introducing innovative MR services and contents like Entertainment and Gaming to the consumers.
“At Deutsche Telekom we believe Mixed Reality will change the way people work, live and interact”says Omar Tazi, SVP Product, Innovation and Customer Service at Deutsche Telekom. “The future of immersive entertainment will be the starting point here. Nreal has made a big step towards bringing this technology to mass market. By providing key technologies, from edge computing to the best connectivity, combined with the best content for entertainment, such as music concerts, sports events or even gaming, Deutsche Telekom together with Nreal will unleash the full potential of mixed reality.”
Following the unveiling of its highly lauded 3D mixed reality system, which for the first time introduced to consumers a familiar, yet multidimensional home screen designed exclusively for the MR environment on Nreal Light, Nebula was introduced at CES 2020 as a way to port and display both 2D native Android apps and interactive 3D content all within an MR environment. Now paired with hand tracking, MR developers and enterprise clients can build even more immersive and truly interactive MR applications for users.
Spatial's workplace collaboration MR app will debut on the Nreal Light platform through Nebula, offering users a mobile remote presence solution that isn’t limited by the physical space. Users can simply put on a pair of Nreal Light glasses, tethered to a Qualcomm-enabled 5G smartphone, and run the Spatial app to experience the first 5G optimized collaborative meeting solution for an MR platform.
“We’ve seen a significant deal of interest from the Fortune 1000 to collaborate virtually and now that we’ve teamed up with Nreal’s powerful and sleek hardware, we are looking forward to expanding this interest far beyond the office, said Spatial Co-Founder and CEO Anand Agarawala. “With 5G-enabled networks plus best in class and software, we are embarking on the next mobile revolution by making this AR technology available to the masses.”
Nreal is also in partnership with Datamesh to explore more MR workspace solutions on Nreal Light.
Learn more about Nreal's partnership with Clay AIR through the press kit here.
Nreal is a fast-growing mixed reality company ushering the next generation user interactions with hardware and software solutions that merge the physical with the digital world. Nreal revolutionized mixed reality experience with its flagship product Nreal Light, accompanied by Nreal's self-developed 3D system Nebula. Fueled by a mission to make MR accessible for everyone, encompassing both consumers and enterprise customers, Nreal's products include the Nreal Light Consumer Kit and Enterprise Edition. Nreal is supported by global partnerships with the world’s leading 5G companies and operators in the US, Europe, Korea, Japan and China and can be demoed in LGU+ and KDDI retail stores.
To learn more about nreal visit nreal.ai
Qualcomm and Snapdragon are trademarks of Qualcomm Incorporated, registered in the United States and other countries. Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc. and/or its subsidiaries.
Clay AIR is a hand tracking and gesture recognition software company that is shaping the way we interact with the digital world. The technology enables hardware and software providers to offer their users immersive and natural interactions with virtual assets. The company has developed a platform agnostic hand tracking and gesture recognition solution through computer vision, machine learning, and advanced cognitive science. Clay AIR’s uniquely impressive performance feels more natural for the user and is less power consuming than its competitors. The company is partnering with some of the largest OEMs to commercialize a new layer of interactivity. Clay AIR is developing next generation software solutions for industry leaders such as Qualcomm, Lenovo, Bose, Renault, Thales, Faurecia and more.
Learn more here https://clayair.io/