Streamers can now show their audience where they are looking on the screen using Eyeware Beam—a technology that uses 3D cameras, AI, and computer vision for accurate and remote head and eye-tracking. You don’t need to buy extra hardware such as headsets, webcams, or glasses; all you need is your iPhone or iPad and an app.
Although it only works for iOS devices, the software counterpart for your PC can work on a Windows 10 and up PC. You can use Eyeware Beam for over 150 games that have Free Track and Open Track integration. You can even add it as an overlay to any content type display when showing your audience what you’re looking at. For instance, you can use the eye gaze overlay to pinpoint details in the action when you’re streaming on Twitch or YouTube.
Eyeware, an eye and head tracking software developer for 3D sensors and webcams, published the Eyeware Beam solution. The company aims to connect people and their devices through machine perception AI and patent-pending computer vision algorithms, making real-world interactions possible. By using this solution, the audience of streamers will feel much more immersed with the gameplay and can better understand the gamer they are watching as they understand what part of the screen they are currently paying attention to.
How to use the app
As mentioned, the Eyeware Beam can only work for iOS, so you should have an iPad or iPhone with iOS 13 and up and Face ID capabilities. You should also have a PC with Windows 10 and up and a phone stand.
First, you need to download and install the Eyeware Beam iOS app on your iPad or iPhone before you can receive the free accompanying iTunes and software installer for the PC. The installer and download link will be sent to your email. You’ll need the iTunes for PC to allow USB connection while the PC software installer enables tracking. If you have multiple monitors, you need to choose one PC monitor as the eye and head tracking only works on one PC monitor.
Next is to open the Eyeware Beam iOS app for the eye and head tracking to work. Then, connect the Windows PC and the iPhone/iPad over WiFi or USB. An onboarding wizard will help you place your iOS device for optimal positioning. Here, you’ll be calibrating the tracking in the PC software to prevent external factors from affecting its quality.
YouTube: The Eyeware Beam Smartphone App Transforms Your iPhone Into A Robust Head & Eye Tracker
Photo credits: The feature image is owned by Eyeware and has been provided for press usage.