Luxid Vue — AR Glasses Companion App
The companion app on the phone, the desktop workspace in the glasses — screenshots from the live Google Play release.
Overview
Luxid Vue is the companion app for Luxid's VueAR smart glasses — India's first 3DOF AR glasses venture. The glasses tether to your phone and project a 180-inch virtual screen; the app turns that screen into a computer. I built the core Android and iOS apps as part of the in-house team, natively in Kotlin and Swift, owning the features that define the product: desktop mode, the voice assistant, and the 3DOF head-tracking pipeline. The app is live on Google Play today.
The Challenge
Tethered display glasses are, out of the box, just a second screen — a mirror of your phone. Making them feel like a computer means building the operating-system layer yourself: window management, a pointing device, spatial awareness, and hands-free control, all running on a phone that was never designed to drive an AR workspace.
Desktop Mode
Select desktop mode and the ecosystem flips: the glasses become the workspace and the phone becomes the input device. A full trackpad implementation — with a real cursor, gestures, and tap-anywhere interaction — drives a multi-display environment rendered into the glasses.
- Four virtual displays, including a dedicated settings screen, arranged in a panel system you swipe between.
- Phone-as-trackpad with a complete cursor implementation — hover, tap, scroll, and panel-switching gestures.
- A full AR browser and app windows running side by side in the workspace.
The Voice Assistant
Desktop mode is hands-occupied by definition — one hand holds the trackpad. So I built a conversational AI voice assistant into the workspace: say “YouTube, search this” and it opens the app, types the query, and plays the result. Full conversational control over the environment, not just canned commands.
The 3DOF Breakthrough
The feature I'm proudest of: the glasses expose raw IMU sensor streams, and I worked out how to fuse them into stable 3-degree-of-freedom head tracking — yaw, pitch, and roll — reliable enough to build experiences on. That single capability turned a static display into a spatial one.
- Sensor fusion from the glasses' raw IMU data into smooth, drift-corrected head orientation.
- Head-tracked games and AR experiences built on top of the pipeline.
- A WebSocket layer that streams the 3DOF orientation to external AR experiences in real time, keeping them in sync with the wearer's head.
The Outcome
The app shipped: Luxid Vue is live on Google Play with the iOS release rolling out, and the glasses are selling — with the desktop mode, cursor, and multi-screen setup the app provides used as headline features in the company's own marketing.