How Nex Is Flipping AR Games, and Why Thatâs a Great Thing
Augmented reality has a lot of promise for social and active gaming applications. An AR gameâs use of the individual and their actual surroundings invites a connection to others and to physical space itself that tends to be absent from other kinds of gaming â including VR gaming. However, XR games are typically either social or active. Nex thinks that games should be both.
Meet Nex
Nex is a hardware and software developer making âmotion games.â That is AR games that use motion as the only input. This isnât entirely new. For example, once the level is started, games like Beat Saber only register motion â that motion is tracked with a controller, but the controller doesnât provide other forms of input.
âOur games only require a camera and a device with sufficient processing power,â Nex CEO and co-founder David Lee said in an interview with ARPost. âToday, that processing power is reaching living room entertainment devices.â
That includes connecting compatible televisions to a mobile phone or another connected camera and compute box, but it also increasingly includes televisions with their own built-in cameras. Nex software can recognize multiple people with a single camera for AR games played together and on the same screen.
The two main offerings from Nex are a hardware camera and compute box currently in pre-production, and games created by the companyâs four internal game studios and six outside partners using the âMotion Development Kit.â
Is it XR?
Something about Nex feels like it canât be XR. Thatâs possibly because thereâs no near-to-eye display. Thereâs no head-worn device â thereâs not even an armâs-length screen. However, if we think about the way that weâve always defined XR, those arenât things that we insist on.
We say that AR is virtual elements overlaid over a live view of the physical world. We often think of viewing that through a lens as with head-mounted AR, or through a camera as with mobile-based AR. Nex admittedly flips that standard model â but it still fits the bill. And it has its advantages over âconventional AR.â
âWe flip it around so the phone sees you [âŠ] and leveraging the biggest screen that most people have,â said Lee. âYou can have the effect of a bigger screen by mounting it on your head but thatâs not a communal experience.â
Those who have been around the tech world for a few 24 hours may recognize this approach. Over ten years ago, PlayStation Move used a similar model, as did Xbox Kinect. If the camera-flipped AR game is the future, why is the past littered with these experiences? In part because AR isnât the only tech involved. Nex also relies on artificial intelligence that wasnât around in 2010.
âAt the time, there was no AI, so they had to have a more complicated camera system,â said Lee. âWhat was missing from those previous generations of games was the NPU â the neural processing unit.â
Those games were fun â and ground-breaking at the time â but their reliance on a console limited their success and led to unsustainable upkeep burdens on the companies. Neither of those constraints is true of Nex.
A Look at Nex Games
I havenât yet had the opportunity to play Nex games myself. I did get to watch Lee and one of his colleagues playing some of the games on a live video call.
Party Fowl is a collection of party mini-games that looks similar to JackBox. The package will be available as an annual subscription and includes a mix of AR games and what Lee called âVR-like experiences.â
In one AR game, rotating your hips flies a helicopter. In another game, players represented on screen as a chicken squat to lay eggs and fill a basket.
Another game, Air Racer, is a âflight simulatorâ in which players pilot an airplane through an obstacle course by moving their hands. Controls include direction, speed, and elevation.
While Nex is focused on games at the moment, I might be more interested in a fitness application from the company. Lee doesnât see them as separate experiences.
âMovement is a natural way to play. As human beings, weâve been playing for a very long time, and most of our games involve movement,â said Lee. âThese games invite you to move more and also deliver those benefits in a gamified way.â
One experience really spoke to me as a potential showcase of a whole genre of experiences. The game was an episode of the childrenâs show Peppa Pig, in which gamers chose characters from the show and engaged in their favorite activity â jumping up and down in muddy puddles. The game was created with partner Hasbro.
âItâs not just watching â the family can be invited to join in the fun as well,â said Lee, who described the experience as âproductive, independent playtime for the kids.â
Lee further described âthe highlight of his careerâ as when his daughter got his mother into Nex games so that they could play together.
Experiencing Nex AR Games
I hope to get the opportunity to try out Nex AR games, and it sounds like Iâll get the opportunity soon enough â one way or another.
Nex AR games including Party Fowl and Sky Racers are already shipping as pre-installed apps on the Sky Live interactive camera. In fact, most of the motion games available on the camera are by Nex. For Apple users, Nex also works with the Continuity Camera feature.
Nex Playground â a camera box for Nex games compatible with most modern smart TVs â is currently in pre-order with the first orders scheduled to ship before this yearâs holiday season. But, one day, external devices wonât be necessary at all as televisions ship with cameras and more computing power onboard.
âTVs donât have really good processing yet. The memory is still quite limited but this is the beginning of these use cases,â said Lee. âThis will be in a lot of living rooms and it begins with Nex pioneering this technology and showing the world what is possible.â
âThe iPhone Moment for TVâ
From AR games, to fitness applications, to just using hand gestures to navigate traditional media, Lee and Nex have an exciting vision for the future of television. The whole thing does feel like AI and XR reaching back into history to pull some of entertainmentâs near-misses into the future where they belong.
How Nex Is Flipping AR Games, and Why Thatâs a Great Thing Read More »