As smartglasses evolve from AI-powered assistants into always-on capture devices, imaging is becoming one of the key technologies that will determine their success. While early generations focused primarily on voice interaction and AI, today’s devices increasingly enable users to capture and instantly share first-person photos and videos, making camera performance a critical differentiator. The imaging industry faces a new challenge: How do you objectively evaluate camera performance across an entirely new form factor?
As this new product category emerges, no standardized methodology currently exists to objectively compare the imaging performance of smartglasses. To address this gap, DXOMARK developed its first dedicated benchmark for smartglasses cameras, benchmarking seven models currently available:
A key aspect of the evaluation was establishing a meaningful performance reference. For this benchmark, we selected the Apple iPhone 13 front camera because its hardware specifications closely match those of the camera systems commonly integrated into today’s smartglasses. Using a reference device with comparable hardware characteristics enables a fair and data-driven comparison between smartglasses cameras and a mature smartphone imaging system.
While the iPhone 13 was introduced nearly five years ago, it remains a relevant benchmark due to its comparable camera hardware. At the same time, this comparison highlights the rapid evolution of smartphone imaging over recent years: a substantial gap still exists compared with today’s flagship smartphones, which benefit from significantly larger sensors, more advanced optics and tuning, and increasingly sophisticated computational photography.
How We Evaluated Smartglasses Imaging Performance
Inspired by DXOMARK’s established methodology, the benchmark combines objective laboratory measurements with perceptual analyses of images and videos captured in real-world scenarios. This comprehensive approach allows us to evaluate not only quantifiable image quality metrics, but also the overall visual experience delivered to end users.
The evaluation encompasses a broad range of photo and video use cases, covering representative everyday scenarios under various lighting conditions, including outdoor daylight, indoor environments, low light, and high-contrast scenes.
In our labs, the assessment was conducted using DXOMARK’s controlled all-in-one portrait laboratory setup, designed to generate accurate and repeatable image quality measurements.
Using the same test environment across all devices ensures direct comparability of results and minimizes variability caused by testing conditions. We completed our lab measurements with real life scenes, including a wide range of typical usages .
To fully characterize their capabilities, the benchmark also includes challenging situations that push imaging systems beyond typical operating conditions. Unlike smartphones, which are intentionally raised to capture a scene, smartglasses are continuously worn and record the world from the user’s perspective. As a result, even natural head movements or small changes in orientation can introduce complex imaging challenges, including exposure variations, motion blur, stabilization issues, and rapidly changing scene composition.
By combining representative everyday scenarios with more demanding test conditions, the benchmark provides a comprehensive assessment of real-world camera performance while highlighting the situations where current smartglasses still have the greatest room for improvement.
The captured photos and videos were analyzed using both objective measurements and perceptual evaluation, focusing on key image quality attributes such as:
-
- Exposure
- Dynamic range
- Texture preservation
- Noise management
- Color rendering
Example of real-life scenes and sequences used for the benchmark :
First insights from our benchmark
The first results of our benchmark highlight both the progress and the current limitations of smartglasses imaging systems.
Bright outdoor scenes
In bright outdoor scenes, in non-challenging conditions, several smartglasses demonstrated promising performance. Some devices surpassed the performance delivered by the iPhone 13 Selfie camera. In particular, they delivered competitive results in areas such as contrast rendering and dynamic range, reflecting significant advances in image processing and camera optimization.
However, performance differences between smartglasses devices remained noticeable, particularly in color rendering, skin tone reproduction, and consistency.
Dominant color on the face skin, in the L*a*b* chromatic plane Using GEA (Golden Eye Assistant), our AI-powered analysis tool
Indoor & Low light
Indoor and low-light conditions proved more challenging. In these scenarios, most smartglasses showed visible limitations in detail retention, noise control, and exposure management. In these scenarios, and in particular in lowlight, compared with the wearable devices evaluated, the iPhone 13 front camera consistently delivered stronger performance under difficult lighting conditions, maintaining cleaner images and more reliable image quality.
Building better imaging devices starts with better measurements
Innovation accelerates when performance can be measured objectively. As new imaging devices continue to emerge, standardized benchmarks provide manufacturers with a common framework to evaluate camera quality, identify optimization opportunities, and track technological progress across generations.
Building on our recognized expertise in smartphone camera evaluation, we support OEMs, chipset vendors, and technology partners with benchmarking solutions designed for the next generation of connected imaging devices, including smartglasses and other AI-powered form factors. Our dedicated smartglasses testing solutions enable manufacturers to objectively evaluate and optimize camera performance, ensuring consistent, reliable, and comparable results across devices.
Discover our Smartglasses Lab Packages
Discover more insights from our benchmark
Join DXOMARK, Qualcomm and Counterpoint Research on July 20th and 23rd for an exclusive webinar bringing together three complementary perspectives on the future of smartglasses:
-
- Market outlook and adoption trends: Explore the latest market dynamics, regional opportunities, AI-driven adoption, competitive landscape and future growth scenarios with Counterpoint Research.
- The first smartglasses benchmark: Discover DXOMARK’s comprehensive evaluation of image quality and AI performance across smartglasses, smartphones and action cameras, including the key technical challenges that still impact the user experience.
- Building the next generation of AI-powered smartglasses: Learn how Qualcomm is enabling the future of smartglasses AI through advances in on-device intelligence, connectivity, imaging and ambient computing.
To accommodate participants across different regions, two live sessions are available:
Session 1
📅 July 20
🕕 Monday | 5:00 PM – 6:00 PM (GMT +2) | 07:00 AM – 08:00 AM (PDT)
Session 2
📅 July 23
🕚 Thursday | 11:00 AM – 12:00 PM (GMT +2) | 05:00 PM – 06:00 PM (CST)
DSLR & Mirrorless
3D Camera
Drone & Action camera