A complete suite for measuring, benchmarking, and optimizing camera image quality

Analyzer is DXOMARK’s continuously updated system for measuring, benchmarking, and optimizing camera image quality. Analyzer is a complete testing system that includes software, hardware, and testing protocols, and ensures repeatable, operator-independent results. It consists of eleven modules, with each one focusing on a different image quality attribute.

Here are a few reasons why Analyzer is the ideal solution for your image quality testing needs:

  • Its modular and highly configurable system works with both RAW and processed data, making it a unique tool to help you tune your Image Signal Processing (ISP).
  • It can evaluate many digital imaging applications in such industries as aerospace, automotive, consumer photo & video, medical, smartphones, action cameras, defense & surveillance, and more.
  • It processes both still images and videos automatically.
  • It is available with such optional premium services as custom testing, lab installation, on-site training, and online image quality support.

What’s new in Analyzer

Raw: A standard for evaluating smartphone camera modules

Great product performance can be achieved only if you select good components. As a camera module maker or phone manufacturer, you need to be able to evaluate the performance of your product before it has been finalized. The Raw module is a unique standard that objectively measures the image quality of smartphone camera modules. Our solution contains test setups and scripts that can generate scores, measurements, and detailed reports. Read more.

Flare Bench: A test setup for measuring flare

While some lens flare can sometimes be desirable for artistic reasons, in most photos it causes image quality problems by reducing contrast and even creating ghosting artifacts. In order to reduce the occurrence of unwanted flare, however, you need to be able to measure it. Our Flare Bench is a hardware setup that can simulate as well as measure flare. The setup contains a bright light source that generates flares that resemble those created by the sun (in terms of their apparent size and color temperature). The bright light source is designed for versatility, and can be rotated vertically, horizontally, and diagonally to produce a flare both within and outside of the camera’s field of view, exactly as a device might face in the real world. Using this setup, you can also measure Flare Accentuation, our proprietary measurement based on RAW images. The flare bench can be used to test cameras from various industries including smartphone, automotive, surveillance and drones among others.

Photoflow

Scripts to automate all DXOMARK image quality objective tests

Scripts for automated image quality testing Camera engineering teams need to efficiently make use their lab operators’ time. Analyzer’s Photoflow is a complete set of scripts for performing DXOMARK’s smartphone rear camera and selfie camera objective test protocols in an automated fashion, and allows you to perform the same lab testing and get same analysis result aggregation as the DXOMARK team. Using Photoflow scripts, you can boost lab efficiency, as lab operators only need to set up the test scenes and align the DUT; Photoflow handles the rest—image transfer, classification, analysis, and aggregation, saving you a lot of lab operation time.

Key features

Raw Module 

Measures image quality of camera modules

H860 Hexapod

Assesses stabilization by simulating the trembling of a human hand.

Dynamic Lighting System (DLS)

Instant lighting intensity changes to perform tests under a multitude of lighting conditions without wasting any time.

Video Analysis

Analyzes video performance in depth, including stabilization, AWB, and other measurements.

Automated Moving Object (AMO)

Uses an automated defocusing object and dynamic scenes to test autofocus.

Workflow Manager

Creates customized and fully automated workflows.

Raw

Selecting the right components plays an important role in the ultimate performance of a smartphone. Raw is a new standard for smartphone camera modules that can help component makers to design better components and phone manufacturers to select better modules for their phones. The test protocol is based on objective measurements of sensor, lens, and module sensitivity on Raw data. This new addition to the Analyzer testing suite contains a dedicated test setup and Raw scripts that generate an overall score for module performance, as well as a detailed report containing test data for various attributes of image quality. And if you have DXOMARK’s experts certify your laboratory setup, your Image Quality engineers will stay updated with the latest features and capabilities of the Raw module.

Measurements

Sensor
  • Color Depth
  • Dynamic Range
  • Low-light ISO
Module Sensitivity
  • SNR10
  • Aperture
Lens
  • Distortion
  • Lateral Chromatic Aberration
  • Vignetting
  • Color Lens Shading
  • Best Sharpness
  • Sharpness in the field

Video RAW

Video Flare

Required equipment

HDR Noise Chart

The HDR Noise chart measures SNR, dynamic and tonal ranges, and tone curves. The chart contains 28 natural density patches that deliver a 120 Ev test scene and 5 polarizers for exposure adjustment. You can also use the ISO saturation method to take measurements that are fully compliant with ISO standard 12232. (Also used with Photo module.)

ColorChecker chart with its grey frame

Chart framed for automatic detection in all scenes; facilitates measurement from RAW data of color response and color sensitivity. (Also used with Video & Stabilization module.)

DOT chart

This glass-supported dot-pattern chart with very flat surface ensures precise optical measurements of lateral chromatic aberration, distortion, and focal length from one shot. Available in various sizes and compatible with most types of cameras. (Also used with Dual-Cam & 3D Camera module.)

MTF Chart

Features a grid of slanted-edge patterns for measuring MTF map across the field, astigmatism, longitudinal chromatic aberrations with one shot. The MTF measurement takes account the chart calibration. Available in various sizes, including sizes that support measuring the device with a field of view of 190° FOV, and high-resolution cameras up to 500MPix.

Gray chart

A uniform gray-colored chart for evaluating lens shading. (Also used with Video & Stabilization module.)

Universal LED Timer

A device with 5 computer-controlled LED arrays for measuring and automatically analyzing (with Analyzer software) exposure time, electronic rolling shutter. (Also used with Selfie module.)

Spectralight QC Setup

The Spectralight QC Setup is our most compact and cost-effective lighting setup solution, ideal for small labs with limited budget. Its metal frame makes it stable, durable, and safe. Its light weight makes it of easy movement and fixation. Its light sources are temperature-adjustable and fully dimmable for a wide range of testing conditions.

Flare Bench

The Flare Bench is a measurement setup that can generate realistic flare images in a lab setup. The setup incorporates a bright light source, close in apparent size and color temperature to the sun. It measures Flare Attenuation by processing RAW images taken on the device being tested. It is an automated compact table-top setup, that is easy to move as it is independent of other lab equipment. With a capacity to rotate from -90° to +90°.

Measurement description

Color Depth

Rich color rendition and color depth matter a lot when shooting portraits. The best image quality metric that correlates with color depth is color sensitivity. Color sensitivity reports in bits the number of colors that the sensor is able to distinguish. The higher the color sensitivity, the more color nuances there can be in the picture.

Noise & Contrast

Unique to Analyzer is its specialized HDR Noise testing hardware that provides accurate measurements of Signal-to-Noise Ratio, Dynamic Range and Tonal Range in scenes with up to 120 Ev (1,000,000:1) contrast between its brightest and its darkest part. All individual density patches of our HDR Noise chart are uniform, so you don’t need to defocus between shots to get accurate results. Furthermore, this chart can be used to measure ISO sensitivity per standard ISO12232.

Vignetting (Luminance & Color Shading)

Analyzer measures vignetting for RAW data (where available) under a variety of lighting conditions. It also measures and characterizes color shading caused by many sources—including IR filter or micro-lens array alignment problems or imperfections, sensor cross-talk, lens tilt or shift, and even sensor design—and generates a complete field map per color channel.

Horizontal & Vertical MTF

Analyzer includes a slanted-edge “checkerboard” chart for measuring MTF across the entire image field both horizontally and vertically. You can use the same test image for measuring astigmatism, longitudinal chromatic aberrations.

SNR10

The SNR10 measurement evaluates the amount of light in the scene the device under test needs to take pictures of acceptable quality. A good device will be able to take acceptable pictueres (meaning, with a good signal-to-noise ratio) with barely a few lux of light, while a less performant device might require a few hundreds. This gives an intuitive alternative view of the SNR measurement, highly correlated with the user experience.

Flare

Analyzer’s Flare Bench can be used to measure the Flare Attenuation Curve, an easy-to-understand metric that evaluates the amount of flare that can be generated by a lens. This measurement is based on RAW images.

Distortion & Lateral Chromatic Aberration

A high-fidelity IEEE-CPIQ dot chart provides the basis for measuring both geometric distortion and lateral chromatic aberration as they vary by field radius. Results are displayed in table, chart, and graph formats.

Low-light ISO

To capture motion in low-light, one has to prioritize exposure time and increase ISO. This results in a decreased Signal-to-Noise ratio (SNR). The low-light ISO metric determines to what extent ISO can be increased without compromising image quality. Measured using Analyzer’s HDR Noise chart, Low-light ISO is the highest ISO setting for a camera that allows it to achieve a SNR of 30dB while keeping a good dynamic range of at least 9 EVs and a color depth of at least 18bits. Low-light ISO is an open scale.

 Specifications: Camera-under-test

Min resolution 5 Mpix
Bits/Pixel >=10
FOV Up to 110°
Focal length Minimum 16mm
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
Aperture Fixed, variable

Photoflow

Camera manufacturers need to perform tests swiftly and efficiently. Camera testing typically is a complex process that requires lab operators to manually intervene and prepare the test setup each time they need to perform a new test. Analyzer’s Photoflow provides testing scripts that can be used to automate the test workflow from data acquisition to test result aggregation through automated control of lighting, various equipment such as Hexapod Shaker, Timer, AMO, and Trigger as well as data transfer and classification on to the master computer. You can improve efficiency by freeingthe time of your lab operators as they need to intervene only in the beginning to prepare the tests.

Photoflow contains all testing scripts used by DXOMARK in its smartphone Camera and Selfie photo test protocols. Using photoflow camera engineers can replicate all still photo objective tests that fall within these test protocols in an automated manner.

Video & Stabilization

Analyzer’s Video & Stabilization module provides all the hardware, software, and charts you need to evaluate video quality stability in changing environments; motion-related issues; overall video quality; and to perform stabilization testing. Further, you can analyze optical and digital stabilization for photo and video.

Measurements

  • Photo stabilization
  • Video stabilization
  • Texture and edge acutance convergence
  • Zoom stability
  • Visual noise
  • Color convergence
  • Spatial and temporal noise
  • AE, AWB convergence

Demo video

Required equipment

Visual Noise chart

The Visual Noise chart is composed of seven large gray patches designed specifically to measure visual noise for video. These measurements complement those taken using the gray chart. You can also use this chart to evaluate various important video quality metrics related to temporal analysis, spatial analysis and noise chromaticity.

Dynamic Lighting System (DLS)

Hand-in-glove with the Automated Lighting System (ALS), this lighting setup takes automation one step further by providing instant lighting intensity changes, thus allowing camera engineers to swiftly perform image quality tests under a multitude of lighting conditions without wasting any time. The DLS is equipped with LED lamps that complement the ALS’s tungsten and fluorescent lighting, and also provides controllable ultra-low-light conditions below 1 lux. You can integrate the Dynamic Lighting system within an automated workflow.

ColorChecker chart

The ColorChecker chart is instrumental for video color measurements. Whether it pertains to skin tones in video calls or scenery in landscape panning shots, color is an integral part of video quality. You can use this chart to evaluate white balance amplitude and intensity as well as color rendering amplitude and intensity. (Also used with Photo module.)

H860 Hexapod Shaker

Camera and subject motion are two of the hardest aspects of video quality to measure in an accurate and repeatable way. Analyzer’s Video and Stabilization module works seamlessly with our purpose-built hexapod shake table and control software to ensure that you’re testing your device against different kinds of camera movement.

This high-precision shaking platform for image stabilization testing provides repeatable motions that simulate real life movements.(Also used with Selfie module.)

Dead Leaves chart

Rapidly changing lighting conditions represent a challenge for the Autoexposure (AE) and Auto White Balance (AWB) features of video capture devices. Analyzer’s Video module uses an included Dead Leaves texture chart to evaluate how quickly and accurately your AE & AWB respond to changes in lighting. The module also measures sharpness and texture-preservation at the same time, for a more efficient testing workflow.

IEEE-CPIQ compliant chart for evaluating texture preservation and noise. (Also used with Autofocus & Timing and Photo modules.)

Gray chart

Consistency of video performance during recording is critical for producing quality results. The Video & Stabilization module comprises an extensive set of tests to perform when recording a uniform background to help you characterize your camera’s video stability. These tests include measuring the variation in exposure and white balance, as well as color shifts, and temporal and spatial noise, including row and column noise. You can also use the gray chart to evaluate such other video metrics as exposure stability and convergence. To facilitate easy measurement, the module automatically handles a variety of input formats, including RAW, AVI, TIFF, JPEG, AE, AWB, as well as handling color rendering, convergence, and stability metrics.

This uniform gray-colored chart helps with exposure analysis, as well as with evaluating shading, defective photosites, flash, and video noise. (Also used with the Optics module fisheye extension.)

Automated Lighting System (ALS)

A multi-illuminant (1 tungsten + 3 fluorescent) lighting system provides uniform lighting between 1 and 1000 lux over a large space. An illuminance feedback loop automatically stabilizes light levels, and the entire system is computer controlled so that you can program your own lighting scenarios, including color temperature. (Also used with Autofocus & Timing, Perceptual Analysis, Selfie, and Photo modules.)

Measurement descriptions

Photo stabilization

The effectiveness of Image stabilization systems—whether optical or electronic—is typically measured in stops, and our Video & Stabilization module follows the CIPA protocol for this test. Combined with our optional shaking platform, these tests are not only simple to complete, but very repeatable and operator-independent. The module can also measure the linear effect of motion blur.

Video stabilization

Measuring video stabilization is a more complex process than measuring it for still images. The Video & Stabilization module helps you characterize your device’s effectiveness by measuring translation, rotation, residual motion, and motion blur. In addition, the module also measures deformation due to Electronic Rolling Shutter.

Video analysis

This module includes essential hardware and software for executing a suite of video quality performance tests. You can analyze the exposure, white balance, color rendering, temporal and spatial noise, and edge and texture preservation of a captured video stream. The module provides two complementary lighting systems—ALS (Automated Lighting System) and DLS (Dynamic Lighting System). The former is a multi-illuminant system providing a wide range of color temperatures between 1 lux and 1000 lux, while the latter is a LED illuminant that provides instant light intensity changes from bright light to ultra-low light (0.5 lux).

 Specifications: Camera-under-test

Min resolution VGA (noise / exposure / white balance) or 1Mpix with distortion < 4% (texture)
Max resolution 4K for video and up to 50 Mpix for photo stabilization
FOV Up to 160°, provided there is a 1 Mpix area with distortion < 4% in the image
Focal length Down to 12mm (in 35 mm format)
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: JPEG, BMP, PNG, TIFF, and many RAW formats (latest release notes include a list of supported RAW formats)

Videos: Windows Media Foundation (WMF) and DirectShow for opening video files. Available video formats depend on the operating system and the DirectShow codecs installed.

Autofocus & Timing

Analyzer lets you characterize your camera’s autofocus effectiveness with the greatest depth and precision.

This module includes essential hardware and software to perform a suite of timing and autofocus performance tests for digital cameras. You can analyze autofocus performance (sharpness, speed, repeatability), electronic rolling shutter (ERS), exposure time, vertical blanking, frame rate, missing frames, and time lags, such as shooting time lag and shutter release time; further, you can perform multiple measurements using the same image or video.

Timing metrics can be used for both video and still camera measurements, including electronic rolling shutter, exposure time, vertical blanking, frame rate, missing frames, and time lags (negative and positive).

Our Timing module lets you measure the time between shutter trigger and release, as well as shot-to-shot time lag—key benchmarks for assessing cameras.

Measurements

  • Autofocus speed
  • Accuracy
  • Repeatability
  • Electronic rolling shutter characterization
  • Frame rate
  • Missing frames
  • Vertical blanking
  • Exposure time
  • Shutter release
  • Shooting time lags

Demo videos

Automated Defocusing Object

Automated ERS and Shutter Time Lag testing

Required equipment

LED Universal Timer

A device with 5 computer-controlled LED arrays for measuring and automatically analyzing (with Analyzer software) exposure time, electronic rolling shutter, frame rate, missing frame, time lags, autofocus time lag, etc. (Also used with Selfie module.)

Autofocus setup

Fully-automated test platform for controlling the synchronization of the AMO and the LED Universal Timer with the device under test. Compatible with all AF technologies. (Also used with Selfie module.)

Dead Leaves chart

IEEE-CPIQ compliant chart for evaluating texture preservation and noise. (Also used with Video & Stabilization and Photo modules.)

Automated Moving Object (AMO)

Two components: (1) Moving Background: Continuously moving chart that simulates scene motion; (2) Defocusing Object: Self-moving chart for resetting cameras to their reference setting.

Autofocus testing requires defocusing multiple times during each photo session, which can be tedious and laborious. AMO’s automated Defocusing Object makes taking measurements easy and rapid with PC-controlled synchronization of the AF setup and automated image capture using a touchscreen digital trigger. Using AMO, you can fully automate autofocus testing from image capture in various lighting conditions to highly repeatable and accurate output. (Also used with Selfie module.)

Automated Lighting System (ALS)

A multi-illuminant (1 tungsten + 3 fluorescent) lighting system provides uniform lighting between 1 and 1000 lux over a large space. An illuminance feedback loop automatically stabilizes light levels, and the entire system is computer-controlled so that you can program your own lighting scenarios, including controlling color temperature. (Also used with Video & Stabilization, Perceptual Analysis, Selfie, and Photo modules.)

 Specifications: Camera-under-test

Min resolution 0.5 Mpix with distortion <2%
Max resolution Up to 50 Mpix
FOV Up to 120°, provided there is a 0.5 Mpix area with distortion <2%
Focal length Minimum 14mm, equivalent to 24×36
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: JPEG, BMP, PNG, TIFF, and many RAW formats (latest release notes include a list of supported RAW formats)

Videos: Windows Media Foundation (WMF) and DirectShow for opening video files; available video formats depend on the operating system and installed DirectShow codecs.

HDR

As HDR is increasingly used in photographic, video surveillance, and ADAS devices (among other applications), brands and manufacturers need to assess their devices’ HDR performance and tune them accordingly. Analyzer’s HDR Module includes a Composite chart for use with automated and controllable lighting so you can measure such essential HDR attributes as color, texture, and contrast in one shot. It also contains a Natural Scene chart for perceptual analysis to complement the measurements of Composite chart, and a HDR Noise chart for dynamic range and noise analysis.

Measurements & Perceptual Analysis

  • Tone mapping: color consistency, contrast preservation, texture preservation
  • Dynamic and tonal range
  • Signal-to-noise ratio
  • Dark signal
  • Tone curve
  • ISO Sensitivity
  • Artifact analysis: texture loss, moiré, aliasing, color shift

Demo video

Required equipment

Composite chart

The Composite chart contains three main patterns—Grayscale, 24-Color Matrix, and Dead Leaves. The chart lets you verify the ability of your camera to accurately reproduce colors, manage noise, and preserve contrast and texture in comparison with an objective reference. Using recommended lighting, you can simulate a dynamic range of up to 15 EV in the test scene. Note that you need to use two Composite charts with this module.

HDR Noise chart

The HDR Noise chart measures SNR, dynamic and tonal ranges, and tone curves. The chart contains 28 natural density patches which deliver a 120 dB test scene and 5 polarizers for exposure adjustment. You can also use the ISO saturation method to take measurements that are fully compliant with ISO standard 12232. (Also used with Photo module.)

Natural Scene chart

A detailed real-life scene for performing lab-based perceptual analyses under controllable HDR conditions; facilitates evaluation of texture loss, moiré, aliasing, color shift, and sharpness. You need to use two Natural Scene charts with this module. (Also used wtih HDR module)

Automated Lighting System (ALS)

A multi-illuminant (1 tungsten + 3 fluorescent) lighting system provides uniform lighting between 1 and 1000 lux over a large space. An illuminance feedback loop automatically stabilizes light levels, and the entire system is computer-controlled so that you can program your own lighting scenarios, including controlling the color temperature. (Also used with Autofocus & Timing, Video & Stabilization, Perceptual Analysis, and Photo modules.)

Specifications: Camera-under-test

Min resolution Full HD (1080p)
Max resolution Up to 50 Mpix
FOV Up to 120°
Focal length Minimum 14 mm, equivalent to 24×36
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: JPEG, BMP, PNG, TIFF

Workflow Manager

Two recurrent issues with image quality testing are the time it takes to test and the necessity of dealing with the limited flexibility of software and equipment. Most testing workflows require dedicated staff to manually intervene during most stages of testing, which is time-consuming. Moreover, doing so manually makes it very challenging to maintain the same level of consistency and precision. Along with our services, Analyzer’s Workflow Manager enables greater automation and customization to help you save precious time and resources every step of the way while maintaining high testing standards.

Key benefits

  • Customize your workflow to fit your testing needs
  • Reduce testing time to 1/30th of what it takes manually
  • Automate testing protocols and liberate testing resources
  • Create your own measurements
  • Design your own automated lab

Contents

  • Python libraries for measurement and equipment control
  • Online help and documentation
  • Training and coaching

Additional equipment and software for fully-automated lab

  • Juke Box for charts
  • Positioning system for lighting
  • Motorized rails for camera positioning
  • Robotic arm
  • Auto-alignment algorithm

Perceptual Analysis

The tests in Analyzer’s Perceptual Analysis module measure such image attributes as detail preservation, color shading, noise, white balance, and computational bokeh, along with a real scene under simulated lighting conditions, including High Dynamic Range (HDR). The equipment includes a proprietary chart with more than 100 components and a special setup for testing bokeh. This module complements quantitative measurements so as to provide a complete assessment of image quality.

Image quality evaluation

  • Image quality attributes (exposure, color, shading, artifacts, etc.)
  • Computational bokeh
  • Artifact analysis: texture loss, moiré, aliasing, color shift

Required equipment

DXOMARK chart

A chart with more than 100 components, including real objects, miniature charts, and portraits that provide a variety of colors, textures, and skin tones. Facilitates the perceptual analysis of such image quality attributes as detail preservation, color shading, noise, white balance, etc.

Realistic mannequin

Use this hyper-realistic mannequin for perceptual analyses of camera quality. Due to the static nature of the mannequin (compared to a real person who moves), test scenes using the mannequin are absolutely identical and therefore the resulting measurements are repeatable and reliable; further, using the mannequin can save precious testing time for a lab operator. We have two mannequins (with more to come), each with a different skin tone.

Bokeh setup

Evaluating the quality of a device’s computational bokeh requires a lab setup that ensures accuracy and repeatability in your testing procedure. Our bokeh setup contains a movable foreground apparatus mounted on a rail that you can adjust according to a device’s FOV. You can use this setup to assess background and foreground blur, sharpness, artifacts, and detail preservation.

Natural Scene chart

A detailed real-life scene for performing lab-based perceptual analyses under controllable HDR conditions; facilitates evaluation of texture loss, moiré, aliasing, color shift, and sharpness. (Also used with HDR module.)

Automated Lighting System (ALS)

A multi-illuminant (1 tungsten + 3 fluorescent) lighting system provides uniform lighting between 1 and 1000 lux over a large space. An illuminance feedback loop automatically stabilizes light levels, and the entire system is computer-controlled so that you can program your own lighting scenarios, including controlling the color temperature. (Also used with Autofocus & Timing, Video & Stabilization, and Photo modules.)

Specifications: Camera-under-test

Min resolution No limitation
Max resolution No limitation
FOV Up to 120°
Focal length Minimum 14mm, equivalent to 24×36
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Any sensor
File formats Images: All file formats

Selfie

Consumers use the front-facing cameras of their smart phones differently than the rear cameras — almost exclusively for self and group portraits. That means that the front-facing camera requires dedicated tools that mimic use cases to test image quality. DXOMARK’s Selfie module, which includes specially-created lifelike mannequins, enables accurate and repeatable front-camera testing.

Measurements & Perceptual Analysis

  • Edge and texture acutance
  • Noise
  • Sharpness
  • Color fidelity and white balance
  • Texture and noise analysis

Required equipment

Focus range chart

Facilitates measuring the focus of a smartphone at various distances.

Mini-ColorChecker chart

A small chart framed for automatic detection in all scenes; facilitates measurement of white balance, color fidelity, and color sensitivity.

Close-up Texture chart

A small-sized Dead Leaves chart for short distance tests such as with a smartphone front camera. Evaluates texture preservation using texture and edge acutance metrics.

LED Universal Timer

A device with 5 computer-controlled LED arrays for measuring and automatically analyzing (with Analyzer software) exposure time, electronic rolling shutter, frame rate, missing frame, time lags, autofocus time lag, etc. (Also used with Autofocus & Timing module.)

Realistic mannequin

Use a hyper-realistic mannequin for perceptual analyses of camera quality. Due to the static nature of the mannequin (compared to a real person who moves), test scenes using the mannequin are absolutely identical and therefore the resulting measurements are repeatable and reliable; further, using the mannequin can save precious testing time for a lab operator. We have two mannequins (with more to come), each with a different skin tone. (Also used with Perceptual Analysis module.)

H860 Hexapod Shaker

High-precision shaking platform for image stabilization testing. Provides repeatable motions that simulate real-life movements. (Also used with Video & Stabilization module.)

Automated Moving Object (AMO)

Two parts: (1) Moving Background: Continuously moving chart that simulates scene motion; (2) Defocusing Object: Self-moving chart for resetting cameras to their reference setting. (Also used with Autofocus & Timing module.)

Automated Lighting System (ALS)

A multi-illuminant (1 tungsten + 3 fluorescent) lighting system provides uniform lighting between 1 and 1000 lux over a large space. An illuminance feedback loop automatically stabilizes light levels, and the entire system is computer-controlled so that users can program their own lighting scenarios, including controlling the color temperature. (Also used with Autofocus & Timing, Video & Stabilization, Perceptual Analysis, and Photo modules.)

Autofocus setup

Fully-automated test platform for controlling the synchronization of the AMO and the LED Universal Timer with the device under test. Compatible with all AF technologies. (Also used with Autofocus & Timing module.)

Measurement descriptions

Close-up Texture and Noise measurement

Using this new texture chart, you can compute texture acutance, texture MTF, edge acutance, edge MTF, visual noise, and exposure time in a close-up setup, typically used for the front (selfie) camera of mobile devices.

Focus Range measurement

The Focus Range chart allows you to measure edge acutance and MTF using a portrait chart.

Selfie portrait test scene

Selfies are all about portraits. To ensure repeatability in Selfie tests, we created a set of realistic mannequins that provide an identical setup for various tests and analyses.

Specifications: Camera-under-test

Min resolution 5 Mpix with distortion <2%
Max resolution Up to 50 Mpix
FOV Up to 97°
Focal length Minimum 19mm, equivalent to 24×36
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: JPEG, BMP, PNG, TIFF

Photo

In tandem with the optics, the sensor and the Image Signal Processing (ISP) in your device will determine overall image quality. Analyzer’s Photo module provides the tools you need to fully evaluate the quality of image capture and processing. By providing a full set of tests for texture, details, noise, and sharpness, the Photo module allows you to make informed trade-offs between them in your camera design — especially about handling low-light situations.

Measurements

  • Edge and texture acutance
  • Dynamic and tonal range
  • Signal-to-noise ratio
  • Dark signal
  • Tone curve
  • ISO Sensitivity
  • Row and column noise
  • Dead and hot pixels
  • Color sensitivity
  • Color fidelity and white balance

Required equipment

Dead Leaves chart

IEEE-CPIQ compliant chart for evaluating texture preservation and noise. (Also used with Autofocus & Timing, and Video & Stabilization modules.)

HDR Noise chart

The Noise chart measures SNR, dynamic and tonal ranges, and tone curves. The chart contains 28 natural density patches which deliver a 120 dB test scene and 5 polarizers for exposure adjustment. You can also use the ISO saturation method to take measurements that are fully compliant with ISO standard 12232. (Also used with HDR module.)

X-rite ColorChecker chart

Chart framed for automatic detection in all scenes; facilitates measurement from RAW data of white balance, color fidelity, and color sensitivity. (Also used with Video & Stabilization module.)

Automated Lighting System (ALS)

A multi-illuminant (1 tungsten + 3 fluorescent) lighting system provides uniform lighting between 1 and 1000 lux over a large space. An illuminance feedback loop automatically stabilizes light levels, and the entire system is computer-controlled so that you can program your own lighting scenarios, including controlling the color temperature. (Also used with Autofocus & Timing, Video & Stabilization, Perceptual Analysis, and Selfie modules.)

Measurement descriptions

Texture & Acutance

One of the most important and visible measurements of image quality is the ability to accurately capture texture and edges. The Photo module contains software and charts (including the IEEE-CPIQ compliant Dead Leaves chart) for measuring texture MTF and acutance, as well as edge MTF and acutance.

Tone curve

If you vary the illumination, the Photo module can give you a complete picture of the tonal response of your device. This is an excellent way to benchmark both the linearity of sensor response and the gamma of the encoded JPEG.

Noise & Contrast

Unique to Analyzer is its specialized HDR testing hardware that provides accurate contrast measurements—including tonal ranges and tone—up to 120dB (1,000,000:1) for testing your device’s extended dynamic range capabilities. All individual density patches of our HDR chart are uniform, so you don’t need to defocus between shots to get accurate results. Further, you can also measure sensitivity per ISO standard 12232.

Row / Column noise

Stripe noise, either in rows or columns, is much more visible than random noise, so controlling it is very important for achieving an effective camera design. Analyzer measures both row and column noise by performing frequency analysis in both dimensions—charting the results and allowing you to easily spot issues.

Color

You can use our ALS lighting control system* with this Analyzer module to automatically calculate the accuracy of your device’s Auto White Balance (AWB). After calculating AWB accuracy, Analyzer also measures the color fidelity and Metamerism Index.

ISO sensitivity

The Photo module measures and charts actual gain compared to changes in light levels, consistent with ISO standard 12232.

*Our proprietary closed-loop lighting control system features a range of industry-standard illuminants and a standard ColorChecker® chart. In addition to the AWB and other tests mentioned above, the lighting system also makes it simple to measure color fidelity and sensitivity under a variety of lighting spectra and illumination, from bright levels down to just a few lux.

Specifications: Camera-under-test

Min resolution VGA (noise / color / ISO) or 1Mpix with distortion < 4% (texture)
Max resolution Up to 50 Mpix
FOV Up to 120°, provided there is a 1 Mpix area with distortion < 4% in the image
Focal length Down to 14mm in 35mm format
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: JPEG, BMP, PNG, TIFF, and many RAW formats (latest release notes include a list of supported RAW formats)

Optics

Whether your device is an embedded imager or a standalone camera, the quality of its optics will play a major part in determining the quality of the images it can capture. Analyzer’s Optics module provides everything you need to fully characterize your optics. The Optics module also provides fisheye MTF measurements up to 190° FOV.

The Optics module also comes with a Flare bench a measurement setup that can simulate and measure Flare as an objective measurement. The Flare bench is a versatile compact table-top test setup which contains a bright light source that can recreate all types of flare that are generated by sun and experience in real life photography.

Measurements

  • Blur/Sharpness
  • Luminance and color shading
  • Lateral chromatic aberration
  • Distortion
  • Effective focal length
  • Horizontal and vertical MTF
  • Fisheye MTF
  • Radial MTF
  • Color fringing
  • Flash
  • Flare Accentuation

Required equipment

DOT chart

This glass-supported dot-pattern chart with very flat surface ensures precise optical measurements of shading, sharpness, lateral chromatic aberration, distortion, and focal length from one shot. Available in various sizes and compatible with most types of cameras. (Also used with Dual-Cam & 3D Camera module.)

MTF chart

Features a grid of slanted-edge patterns for measuring MTF map across the field, astigmatism, longitudinal chromatic aberrations, and ringing with one shot. The MTF measurement is calibrated from the chart resolution. Available in various sizes, including sizes that support measuring fisheye lenses up to 190° FOV, and high-resolution cameras up to 500MPix.

Color Fringing chart

Chart for measuring color fringing; consists of a square pattern positioned on a uniform light table.

CPIQ SFR Chart

An ISO 12232 compliant, low-contrast chart that delivers radial sagittal & tangential MTFs at different positions. The MTF measurement is calibrated from chart resolution.

Gray chart

A uniform gray-colored chart for evaluating shading, defective photosites, flash, and video noise. (Also used with Video & Stabilization module.)

Automated Lighting System (ALS)

A multi-illuminant (1 tungsten + 3 fluorescent) lighting system provides uniform lighting between 1 and 1000 lux over a large space. An illuminance feedback loop automatically stabilizes light levels, and the entire system is computer-controlled so that you can program your own lighting scenarios, including color temperature. (Also used with Video & Stabilization, Perceptual Analysis, Selfie, and Photo modules.)

Fisheye MTF setup

The fisheye setup is an extension of the Optics module. It includes a spherical panoramic head for performing test shots at different viewing angles, baffles to manage auto-exposure adjustment, and a high-quality checkerboard-type MTF chart.

Flare Bench

The Flare Bench is a measurement setup that can generate sun like flare images in a lab setup. The setup incorporates a bright light source, close in apparent size and color temperature to the sun. It measures Flare Accentuation by processing RAW images taken on the device being tested. It is an automated compact table-top setup, that is easy to move as it is independent of other lab equipment. With a capacity to rotate from -90° to +90° it can measure flare from all possible angles.

Measurement description

Blur / Sharpness

Going beyond standard MTF measurements to provide a perceptual measure of image sharpness, Analyzer utilizes its unique BxU (Blur eXperience Unit) to provide a meaningful evaluation of sharpness at 25 locations throughout the image. The resulting output sharpness map is ideal for diagnosing optical alignment issues.

Radial MTF

In addition to traditional horizontal and vertical MTF test charts, Analyzer includes a IEEE-CPIQ and ISO 12233-compliant low-contrast chart for measuring radial MTF.

Vignetting (luminance & color shading)

Making use of the same dot chart images, Analyzer measures vignetting for both RAW data (where available) and the final RGB image under a variety of lighting conditions. It also measures and characterizes color shading caused by many sources—including IR filter or micro-lens array alignment problems or imperfections, sensor cross-talk, lens tilt or shift, and even sensor design—and generates a complete field map per color channel.

Universal LED Timer

A device with 5 computer-controlled LED arrays for measuring and automatically analyzing (with Analyzer software) exposure time, electronic rolling shutter, frame rate, missing frame, time lags, autofocus time lag, etc. (Also used with Selfie module.)

Horizontal & Vertical MTF

Analyzer includes a slanted-edge “checkerboard” chart for measuring MTF across the entire image field both horizontally and vertically. You can use the same test image for measuring astigmatism, longitudinal chromatic aberrations, and ringing. In addition, the Analyzer software compensates for chart-limited MTF.

Ringing & Color Fringing

Using edge profiles on its ISO 12233-compliant MTF chart, the Optics module measures ringing artifacts to help you evaluate and tune your sharpening algorithms. The module also includes a custom Color Fringing transmissive chart to use for measuring color inaccuracies caused by chromatic aberration—a flaw that is especially visible in highly-saturated areas.

Effective Focal Length and Flash

Analyzer measures the effective focal length of your lens across its entire image field by measuring the relative magnification of a field of dots across a test chart.

The Optics module also provides tests to help you evaluate your flash solutions for uniformity and accuracy of White Balance.

Distortion & Lateral Chromatic Aberration

A high-fidelity IEEE-CPIQ dot chart provides the basis for measuring both geometric distortion and lateral chromatic aberration as they vary by field radius. Results are displayed in table, chart, and graph formats.

Flare

Analyzer’s Flare Bench can be used to measure the Flare Accentuation Curve, an easy-to-understand metric which determines the amount of flare that can be generated by a lens. This measurement is based on RAW images.

 Specifications: Camera-under-test

Min resolution VGA
Max resolution Up to 50 Mpix
FOV Up to 190°
Focal length Minimum 12mm, equivalent to 24×36 (no fisheye lenses)

Maximum: Limited by lab depth, 500mm for a 10m shooting distance

Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: JPEG, BMP, PNG, TIFF, and many RAW formats (latest release notes include a list of supported RAW formats)

Dual-Cam & 3D Camera

Traditional image quality measurement and tuning tools are not sufficient for camera modules that include more than a single sensor — for one thing, you have to calibrate the positions of all the imagers. Whether you are planning to use an array of imagers or a pair of cameras to provide a 3D view of the world, or a depth map for advanced gesture-based user interfaces, Analyzer’s Dual-Cam & 3D Camera module will help you benchmark and tune your product.

If you use our proprietary 3D Camera Bench and Dot chart, you can perform all of these measurements with just two test shots — reducing setup time from nearly 30 minutes to just a minute or two.

Measurements

  • Camera pose
  • Focal points, focal lengths
  • Distortion curves

Required equipment

DOT chart

This glass-supported dot-pattern chart with very flat surface ensures precise optical measurements of shading, sharpness, lateral chromatic aberration, distortion, and focal length from one shot. Available in various sizes and compatible with most types of cameras. (Also used with Optics module.)

3D camera bench with accessories

Facilitates the measurement of dual-camera internal and external parameters, distortion, and polynomial coefficients.

Measurement descriptions

Camera pose

External calibration metrics include full 6-axis camera pose measurement (including 3 axes of rotation and 3 axes of translation) to accurately reconstruct 3D scenes.

Distortion curves

The Dual-Cam & 3D Camera module also provides distortion profiles and polynomial models for multiple imagers to let you register image results more precisely.

Focal points & focal lengths

Internal calibration metrics include measuring the actual focal length of each imager as well as the focus points in the image field.

Specifications: Camera-under-test

Min resolution VGA
Max resolution Up to 50 Mpix
FOV Up to 140°
Focal length Down to 14mm (in 35mm format)
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats JPEG, BMP, PNG, TIFF, and many RAW formats (latest release notes include a list of supported RAW formats)