A complete suite for measuring, benchmarking, and optimizing camera image quality

Analyzer is a complete testing system that includes software, hardware, and testing protocols, and ensures repeatable, operator-independent results. It consists of 9 modules, all of which can function independently, and each one focusing on a different image quality attribute. Here is what makes Analyzer the ideal solution for your image quality testing needs:

  • A modular and highly-configurable solution that works with both RAW and JPEG images, making it a unique tool to help you tune your ISP.

  • Suitable for many industries, including Aerospace, Automotive, Consumer Photo & Video, Medical, Smartphones, Action Cameras, Defense & Surveillance, and more.

  • Processes both still images and videos automatically.

  • Makes available optional premium services such as custom testing, lab installation, on-site training, and online image quality support.

Latest in Analyzer

Analyzer 7.1 Upgrade (2019)

The latest version of Analyzer comes with a Selfie module to enable accurate and repeatable front camera testing. Using dedicated equipment, the Selfie module enables various texture and noise measurements for photo and video. The update to Workflow Manager is a step forward toward increased control and customization of testing workflows for objective measurements. The new H860 Hexapod Shaker is available in the Selfie module as well as in the video and stabilization module of Analyzer.

  • Selfie module: new charts, H860 hexapod shaker, and realistic mannequins
  • Workflow manager with more hardware control
  • Autofocus testing setup with improved control of lighting and the Automated Moving Object (AMO)

Close-Range Texture chart

Realistic Mannequin

Focus Range chart

H860 Hexapod Shaker

Key Features

HDR Module Setup

HDR Module 

Measures HDR on all types of devices, irrespective of their technology.

H860 Hexapod

To assess stabilization, simulates the trembling of a human hand.

Automated Lighting System (ALS)

Simulates varying intensities and temperatures of LED and tungsten lighting.

Video Analysis

Analyzes video performance in depth, including stabilization, AWB, and other measurements.

Automated Moving Object (AMO)

Tests autofocus using an automated defocusing object and dynamic scenes.

Workflow Manager

Creates customized and fully automated workflows.

Analyzer Modules

Selfie Module

Consumers use the front cameras of mobile phones differently than the rear cameras, which means that you need dedicated tools that mimic selfie use cases to test front-camera image quality. The Selfie modules enable accurate and repeatable front-camera testing.

Close-up Texture and Noise measurement

Using this new texture chart, you can compute texture acutance, texture MTF, edge acutance, edge MTF, visual noise, and exposure time in a close-up setup, typically used for the front (selfie) camera of mobile devices.

Focus Range measurement

The Focus Range chart allows you to measure edge acutance and MTF using a portrait chart.

Selfie Portrait Test Scene

Selfies are all about portraits. To ensure repeatability in Selfie tests, we created a set of realistic mannequins that provide an identical setup for various tests and analyses.

Required Equipment

  • Close-up texture chart
  • Automated Moving Object (AMO)
  • H860 Hexapod
  • Automated Lighting System (ALS)
  • Universal Timer

Measurements

  • Texture acutance
  • Edge acutance
  • Visual acutance
  • Chroma noise
  • Luminance noise
  • Exposure time
  • Color fidelity

Specifications: Camera-under-test

Min resolution 5 Mpix with distortion <2%
Max resolution Up to 50 Mpix
FOV Up to 97°
Focal length Minimum 19mm, equivalent to 24×36
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: jpeg, bmp, png, tif

Autofocus & Timing Module

Analyzer lets you characterize your camera’s autofocus effectiveness with the greatest depth and precision.

This module includes essential hardware and software to perform a suite of timing and autofocus performance tests for digital cameras. You can analyze autofocus performance (sharpness, speed, repeatability), electronic rolling shutter (ERS), exposure time, vertical blanking, frame rate, missing frames, and time lags such as shooting time lag and shutter release time; further, you can perform multiple measurements using the same image or video.

Timing for photo and video

This measurement delivers relevant timing metrics for both video and still camera: electronic rolling shutter, exposure time, vertical blanking, frame rate, missing frames, and time lags (negative and positive).

LED Universal Timer

Coupled with specialized electronic triggers that work with both touchscreen and mechanical-shutter cameras, our unique Universal LED Timer enables automated testing of your camera’s timing. This includes measuring shutter lag, shooting time lag (including focusing time, shutter open and close times), and rolling shutter issues.

Still timing measurement

Our Timing Module lets you measure the time between shutter trigger and release, as well as shot-to-shot time lag—key benchmarks for assessing cameras.

AF testing

Characterizes camera AF sharpness, repeatability, time lag, and acutance irregularity. Compatible with all AF technologies.

Automated Moving Object (AMO) in AF testing

Autofocus testing requires defocusing multiple times during each photo session, which can be tedious and laborious. AMO’s automated Defocusing Object makes taking measurements easy and rapid with PC-controlled synchronization of the AF setup and automated image capture using a touchscreen digital trigger. Using AMO, you can fully automate autofocus testing from image capture in various lighting conditions to highly repeatable and  accurate output.

Required equipment 

  • Automated Lighting System (ALS)
  • Autofocus setup
  • Dead Leaves Chart (IEEE-CPIQ compliant)
  • LED Universal Timer
  • Digital trigger
  • Automated Moving Object (AMO)

Module measurements

Autofocus

  • Average sharpness
  • Sharpness repeatability
  • Average shooting time lag  (including autofocus delay)
  • Shooting time lag standard deviation

Timing

  • Electronic Rolling Shutter
  • Exposure time
  • Vertical blanking
  • Frame rate (auto-detection of missing frames)
  • Time lags: shooting time lag, shutter release time lag, and other latency measurements

Specifications: Camera-under-test

Min resolution 0.5 Mpix with distortion <2%
Max resolution Up to 50 Mpix
FOV Up to 120°, provided there is a 0.5 Mpix area with distortion <2%
Focal length Minimum 14mm, equivalent to 24×36
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: jpeg, bmp, png, tif, and many RAW formats (latest release notes provides a list of supported RAW formats)

Videos: Uses Windows Media Foundation (WMF) and DirectShow to open video files. Available video formats depend on the operating system and installed DirectShow codecs

Demo videos

Automated Defocusing Object

Automated ERS and Shutter Time Lag testing

Video & Stabilization Module

Analyzer’s Video & Stabilization module provides all the hardware, software, and charts you need to evaluate video quality stability in changing environments, motion-related issues, overall video quality, and to perform stabilization testing. Further, you can analyze optical and digital stabilization for photo and video.

Photo stabilization

The effectiveness of Image stabilization systems—whether optical or electronic—is typically measured in stops, and our Video & Stabilization module follows the CIPA protocol for this test. Combined with our optional shaking platform, the tests are not only simple to complete, but very repeatable and operator-independent. The module can also measure the linear effect of motion blur.

Video stabilization

Measuring video stabilization is a more complex process than measuring it for still images. The Video & Stabilization module helps you characterize your device’s effectiveness by measuring translation, rotation, residual motion, and motion blur. In addition, the module also measures deformation due to Electronic Rolling Shutter.

Shaking (stabilization) platform

Camera and subject motion are two of the hardest aspects of video quality to measure in an accurate and repeatable way. Analyzer’s Video and Stabilization module works seamlessly with our purpose-built Hexapod shake table and control software to ensure that you’re testing your device against different kinds of camera movement.

Video analysis using Dead Leaves chart

Rapidly changing lighting conditions represent a challenge for the Autoexposure (AE) and Auto White Balance (AWB) features of video capture devices. Analyzer’s Video module uses an included Dead Leaves texture chart to evaluate how quickly and accurately your AE & AWB respond to changes in lighting. The module also measures sharpness and texture-preservation at the same time, for a more efficient testing workflow.

Video analysis using Gray chart

Consistency of video performance during recording is critical for producing quality results. The Video & Stabilization module performs an extensive set of tests during the recording of a uniform background to help you characterize your camera’s video stability. These tests include measuring the variation in exposure and white balance, as well as color shifts, and temporal and spatial noise, including row and column noise. To facilitate easy measurement, the module automatically handles a variety of input formats, including RAW, AVI, TIFF, and JPEG.

Required equipment

  • Dead Leaves chart

  • Gray chart

  • Hexapod stabilization platform + controller

  • Automated Lighting System (ALS)

Measurements

Video

  • Video texture actuance
  • Zoom factor
  • AWB and AE stability
  • Temporal noise
  • Spatial noise: FPN, dead pixels, hot pixels

Stabilization

  • Motion blur
  • Residual motions (rotations, translations)
  • Rolling shutter distortions
  • Image stabilization performance in stops

Specifications: Camera-under-test

Min resolution VGA (noise / exposure / white balance) or 1Mpix with distortion < 4% (texture)
Max resolution 4K for video and up to 50 Mpix for photo stabilization
FOV Up to 160°, provided it exists a 1Mpix area with distortion < 4% in image
Focal length Down to 12mm (in 35 mm format)
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: jpeg, bmp, png, tif, and many RAW formats (latest release notes provides a list of supported RAW formats)

Videos: Windows Media Foundation (WMF) and DirectShow are used to open video files. Available video formats depend on the operating system and the DirectShow codecs installed.

Demo video

Perceptual Analysis Module

DXOMARK Chart

The DXOMARK chart is made up of more than 100 components, including real objects and miniature charts that provide a variety of color and textures, as well as portraits with different skin tones. The chart allows you to perceptually analyze various image quality attributes such as detail preservation, color shading, noise, and white balance, among others.

Bokeh setup

Evaluating the quality of a device’s computational bokeh requires a lab setup that ensures accuracy and repeatability in your testing procedure. Our bokeh setup contains a movable foreground apparatus, mounted on a rail, that you can adjust according to a device’s FOV. You can use this setup to assess background and foreground blur, sharpness, artifacts, and detail preservation.

Natural Scene chart 

The Natural Scene chart allows you to visually evaluate a real scene in simulated lighting conditions such as High Dynamic Range scene.

Natural Scene Chart for HDR Module

Required equipment 

Photo and Video perceptual evalutation

  • DXOMARK chart
  • Automated Lighting System (ALS)

Computational Bokeh evaluation

  • Bokeh setup: Foreground apparatus with mobile easel, Background chart
  • Automated Lighting System (ALS)
  • FOBA DSS camera stand with 4m guide rail
  • Manfrotto paper background system
  • 1 KinoFlo Celeb 250 LED panel with tripod

Natural Scene evaluation

  • Set of 2 Natural Scene charts
  • 2 KinoFlo Celeb 250 LED panels
  • DMX Controller for KinoFlo Celeb 250

Image quality attributes assessed:

  • DXOMARK chart for photo & video: Noise, color, texture, exposure, white balance, fine details, shading, artifacts, etc.
  • Bokeh setup: Depth estimation artifact, repeatability, noise consistency, shape of bokeh
  • Natural Scene chart: Color, details, and artifacts (color shift, texture loss, sharpness, moiré, aliasing, etc.)

Specifications: Camera-under-test

Min resolution No limitation
Max resolution No limitation
FOV Up to 120°
Focal length Minimum 14mm, equivalent to 24×36
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Any sensor
File formats Images: any file format

HDR Module

As HDR is increasingly used in photographic, video surveillance, and ADAS devices (among other applications), brands and manufacturers need to assess their devices’ HDR performance and tune them accordingly. Analyzer’s HDR Module includes a Composite chart for use with automated and controllable lighting so you can measure such essential HDR attributes as color, texture, and contrast in one shot. It also contains a Natural Scene chart for perceptual analysis to complement the measurements of Composite chart, and a HDR Noise chart for dynamic range and noise analysis.

Composite chart

The Composite chart contains three main patterns—Grayscale, 24-Color Matrix, and Dead Leaves. The chart lets you verify the ability of your camera to accurately reproduce colors, manage noise, and preserve contrast and texture in comparison with an objective reference. Using recommended lighting, you can simulate a dynamic range of up to 15 EV in the test scene.

HDR Module Setup

Perceptual analysis with HDR Module

Our unique Natural Scene chart allows you to perform perceptual analysis of a detailed real life scene under controllable lighting conditions in your lab.

Natural Scene Chart for HDR Module

Noise chart

The Noise chart measures SNR, dynamic and tonal ranges, and tone curves. The chart contains 28 natural density patches which deliver a 120 dB test scene and 5 polarizers for exposure adjustment. You can also use the ISO saturation method to take measurements that are fully compliant with ISO standard 12232.

Required equipment

  • 2 Composite charts
  • 1 HDR Noise chart
  • 2 Natural Scene charts
  • 2 Kino Flo LED Celeb 200 light boxes
  • 1 DMX Controller for KinoFlo Celeb 250

Measurements

HDR noise chart

  • Noise
  • Dynamic range / Tonal range
  • Tone curve (OECF)
  • Dark signal
  • ISO sensitivity

Composite chart

  • Color consistency
  • Contrast
  • Texture preservation
  • Visual Noise

Specifications: Camera-under-test

Min resolution Full HD (1080p)
Max resolution Up to 50 Mpix
FOV Up to 120°
Focal length Minimum 14 mm, equivalent to 24×36
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: jpeg, bmp, png, tif

Demo video

Workflow Manager

Two recurrent issues with image quality testing are the time it takes to test and the necessity of dealing with the limited flexibility of software and equipment.  Most testing workflows require dedicated staff to manually intervene during most stages of testing, which is time consuming. Moreover, doing so manually makes it very challenging to maintain the same level of consistency and precision. Along with our services, Analyzer’s Workflow Manager enables greater automation and customization to help you save precious time and resources every step of the way while maintaining high testing standards.

Key benefits

  • Customize your workflow to fit your testing needs
  • Reduce testing time to 1/30th of what it takes manually
  • Automate testing protocols and liberate testing resources
  • Create your own measurements
  • Design your own automated lab

Contents 

  • Python libraries for measurement and equipment control
  • Online help and documentation
  • Training and coaching

Additional equipment and software for fully-automated lab

  • Juke Box for charts
  • Positioning system for lighting
  • Rails
  • Robotic arm
  • Auto-alignment algorithm

Photo Module

In tandem with the optics, the sensor and the Image Signal Processing (ISP) in your device will determine overall image quality. Analyzer’s Photo module provides the tools you need to fully evaluate the quality of image capture and processing. By providing a full set of tests for texture, details, noise, and sharpness, the Photo module allows you to make informed trade-offs between them in your camera design − especially how it handles low-light situations.

Texture & Acutance

One of the most important and visible measurements of image quality is the ability to accurately capture texture and edges. The Photo module contains software and charts (including the IEEE-CPIQ-compliant Dead Leaves chart) for measuring texture MTF and acutance, as well as edge MTF and acutance.

Tone curve

If you vary the illumination, the Photo module can give you a complete picture of the tonal response of your device. This is an excellent way to benchmark both the linearity of sensor response and the gamma of the encoded JPEG.

Dead / hot pixels (RAW)

The Photo module identifies both dead and hot pixels found in RAW image captures so you can gather quality statistics or map them out as needed.

Color sensitivity

By extending the notion of dynamic range to color, Analyzer provides a measure of the color sensitivity of a sensor by calculating the total number of colors it can distinguish, subject to noise. The value is reported as the number of bits required to encode all those colors.

Noise & Contrast

Unique to Analyzer is its specialized HDR testing hardware that provides accurate contrast measurements—including tonal ranges and tone—up to 120dB (1,000,000:1) for testing your device’s extended dynamic range capabilities. All individual density patches of our HDR chart are uniform, so you don’t need to defocus between shots to get accurate results. Further, you can also measure sensitivity per ISO standard 12232.

Row / Column noise

Stripe noise, either in rows or columns, is much more visible than random noise, so controlling it is very important for achieving an effective camera design. Analyzer measures both row and column noise by performing frequency analysis in both dimensions—charting the results and allowing you to easily spot issues.

ISO sensitivity

The Photo module measures and charts actual gain compared to changes in light levels, consistent with ISO standard 12232.

Color

You can use our lighting control system* with this Analyzer module to automatically calculate the accuracy of your device’s Auto White Balance (AWB). After calculating AWB accuracy, Analyzer also measures the color fidelity and Metamerism Index.

*Our proprietary closed-loop lighting control system features a range of industry-standard illuminants and a standard ColorChecker® chart. In addition to the AWB and other tests mentioned above, the lighting system also makes it simple to measure color fidelity and sensitivity under a variety of lighting spectra and illumination from bright levels down to just a few Lux.

Required equipment

  • Dead Leaves chart

  • ColorChecker® Classic chart (X-rite) with frame

  • HDR Noise chart (120dB)

  • Kinoflo Celeb 250 DMX (LED light-table)

  • Automated Lighting System (ALS)

Measurements

ColorChecker® chart

  • Noise
  • Color fidelity
  • Color sensitivity

HDR Noise chart

  • Noise
  • ISO sensitivity
  • Dark Signal
  • Tone curve

Dead Leaves chart

  • Texture preservation
  • Visual noise

Black picture

  • Hot pixels
  • Row/ Column noise

Specifications: camera-under-test 

Min resolution VGA (noise / color / ISO) or 1Mpix with distortion < 4% (texture)
Max resolution Up to 50 Mpix
FOV Up to 120°, provided there is a 1 Mpix area with distortion < 4% in the image
Focal length Down to 14mm in 35mm format
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: jpeg, bmp, png, tif, and many RAW formats (latest release notes provides a list of supported RAW formats)

Optics Module

Whether your device is an embedded imager or a standalone camera, the quality of its optics will play a major part in determining the quality of the images it can capture. Analyzer’s Optics module provides everything you need to fully characterize your optics. The Optics module also provides Fisheye MTF measurements up to 190° FOV.

Blur / Sharpness

Going beyond standard MTF measurements, to provide a perceptual measure of image sharpness, Analyzer utilizes its unique BxU (Blur eXperience Unit) to provide a meaningful measure of sharpness at twenty-five locations throughout the image. The resulting output sharpness map is ideal for diagnosing optical alignment issues.

Radial MTF

In addition to traditional horizontal and vertical MTF test charts, Analyzer includes a IEEE-CPIQ and ISO 12233-compliant low-contrast chart for measuring radial MTF.

Vignetting (Luminance & Color Shading)

Making use of the same dot chart images, Analyzer measures vignetting for both RAW data (where available) and the final RGB image under a variety of lighting conditions. It also measures and characterizes color shading caused by many sources—including IR filter or micro-lens array alignment or imperfections, sensor cross-talk, lens tilt or shift, or even sensor design—and generates complete field map per color channel.

Horizontal & Vertical MTF

Analyzer includes a slanted-edge “checkerboard” chart for measuring MTF across the entire image field both horizontally and vertically. You can use the same test image for measuring astigmatism, longitudinal chromatic aberrations, and ringing. In addition, the Analyzer software compensates for chart-limited MTF.

Ringing & Color Fringing

Using edge profiles on its ISO 12233-compliant MTF chart, the Optics module measures ringing artifacts to help you evaluate and tune your sharpening algorithms. The module also includes a custom Color Fringing transmissive chart to use for measuring color inaccuracies caused by chromatic aberration—a flaw that is especially visible in highly-saturated areas.

Effective Focal Length and Flash

Analyzer measures the effective focal length of your lens across its entire image field by measuring the relative magnification of a field of dots across a test chart.

The Optics module also provides tests to help you evaluate your flash solutions for uniformity and accuracy of White Balance.

Distortion & Lateral Chromatic Aberration

A high-fidelity IEEE-CPIQ dot chart provides the basis for measuring both geometric distortion and lateral chromatic aberration as they vary by field radius. Results are displayed in table, chart, and graph formats.

Required equipment

  • Dot chart

  • MTF chart

  • Radial MTF chart (CPIQ-compliant)

  • Color Fringing chart

  • Gray chart

  • Automated Lighting System (optional)

Measurements

Dot chart

  • Distortion
  • Lateral chromatic aberrations
  • Blur/ Sharpness (BxU)
  • Luminance and color shading
  • Flash
  • Effective focal length

Gray chart

  • Luminance and color shading
  • Flash

MTF chart

  • Axial chromatic aberrations
  • Modular Transfer Function (MTF)

Color fringing chart

  • Color fringing

Specifications: camera testing

Min resolution VGA
Max resolution Up to 50 Mpix
FOV Up to 190°
Focal length Minimum 12mm, equivalent to 24×36 (no fisheye lenses)

Maximum: Limited by lab depth, 500mm for a 10m shooting distance

Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats Images: jpeg, bmp, png, tif, and many RAW formats (latest release notes provides a list of supported RAW formats)

Demo videos

Dual-Cam & 3D Camera Module

Traditional image quality measurement and tuning tools are not sufficient for camera modules that include more than a single sensor—for one thing, you have to calibrate the positions of all the imagers. Whether you are planning to use an array of imagers or a pair of cameras to provide a 3D view of the world, or a depth map for advanced gesture-based user interfaces, Analyzer’s Dual-Cam & 3D Camera module will help you benchmark and tune your product.

If you use our proprietary 3D Camera Bench and Dot chart, you can perform all of these measurements with just two test shots—reducing setup time from nearly 30 minutes to just a minute or two.

Camera pose

External calibration metrics include full 6-axis camera pose measurement (including 3 axes of rotation & 3 axes of translation) to accurately reconstruct 3D scenes.

Distortion curves

The Dual-Cam & 3D camera module also provides distortion profiles and polynomial models for multiple imagers to let you register image results more precisely.

Focal points & focal lengths

Internal calibration metrics include measuring the actual focal length of each imager as well as the focus points in the image field.

Required equipment

  • Dot chart

  • 3D camera bench with accessories

Measurements

  • Baseline parameters
  • Rotations and translations between cameras (external parameters)
  • Focal length, principal point (internal parameters)
  • Distortion curves with polynomial model coefficients

Specifications: Camera-under-test

Min resolution VGA
Max resolution Up to 50 Mpix
FOV Up to 140°
Focal length Down to 14mm (in 35mm format)
Spectral sensitivity Measurements are designed for visible-spectrum cameras
Sensor Bayer filter sensor
File formats jpeg, bmp, png, tif, and many RAW formats (latest release notes provides a list of supported RAW formats)