Test aparatu Google Pixel 8

Na potrzeby oceny i analizy inżynierowie firmy SBMARK przechwytują i oceniają ponad 2,600 obrazów testowych zarówno w kontrolowanych środowiskach laboratoryjnych, jak i w naturalnych scenach na zewnątrz, w pomieszczeniach i przy słabym oświetleniu, przy użyciu domyślnych ustawień aparatu. Protokół fotograficzny został zaprojektowany z myślą o kluczowych przypadkach użycia i opiera się na typowych scenariuszach fotografowania, takich jak fotografia portretowa, rodzinna i krajobrazowa. Ocena odbywa się poprzez wizualne badanie obrazów w kontekście odniesienia do naturalnej sceny i przeprowadzanie obiektywnych pomiarów na laboratoryjnie zarejestrowanych obrazach graficznych w różnych warunkach oświetlenia od 1 do 1,000+ luksów i temperaturach barwowych od 2,300 K do 6,500 K.

Exposure and color are the key attributes for technically good images. For exposure, the main attribute evaluated is the brightness of the main subject across various use cases such as landscape, portrait or still life. Other factors evaluated are contrast and dynamic range, e.g. the ability to make details visible in both bright and dark areas of the image. Repeatability is also important because it demonstrates the camera’s ability to provide the same rendering when shooting multiple images of the same scene.
Regarding color, the image quality attributes analyzed are skin tone rendering, white balance, color shading and repeatability. Regarding color and skin tone rendering, we penalize unnatural colors but respect the manufacturer’s choice of color signature.

Autofocus tests focus on focus accuracy, focus repeatability, shutter lag, and depth of field. Shutter delay is the difference between when the user presses the capture button and when the image is actually taken. It includes focusing speed and the device’s ability to capture images at the right time, the so-called “zero shutter lag” capability. While a shallow depth of field can be nice for single-subject portraits or close-ups, it can also pose a problem in some specific conditions such as group portraits; Both situations are tested. Focus accuracy is also evaluated in all real-world images taken, from infinity to close-up objects and low-light to outdoor conditions.

Texture tests analyze the level of detail and texture of subjects in images taken in the lab and in real-life scenarios. For natural shots, special attention is paid to the level of detail in the light and dark areas of the image. Objective measurements are performed on map images taken under various lighting conditions from 1 to 1000 lux and different types of dynamic range conditions. The papers used are the proprietary SBMARK (DMC) paper and the Dead Leaves paper.

Noise tests analyze various noise attributes such as intensity, chromaticity, grain, texture on real-life images and on graph images taken in the laboratory. For natural images, particular attention is paid to noise on faces, landscapes, but also on dark areas and high dynamic range conditions. Noise on moving objects is also evaluated on natural images. Objective measurements are performed on graph images taken under various conditions from 1 to 1000 lux and different types of dynamic range conditions. The graph used is the dead leaf graph and standardized measurement such as visual noise derived from ISO 15739.

Artifact evaluation examines lens shading, chromatic aberrations, geometric distortion, ringing edges, halos, ghosting, quantization, unexpected color tone changes, among other types of possible unnatural effects on the photos. The more severe and frequent the artifact, the greater the point deduction from the score. The main artifacts observed and the corresponding point loss are listed below.

Bokeh is tested in a dedicated mode, usually portrait or aperture mode, and analyzed by visually inspecting all images captured in the laboratory and in natural conditions. The goal is to reproduce a portrait photograph comparable to one taken with a DLSR and a wide aperture. The main image quality attributes that were paid attention to are depth estimation, artifacts, blur gradient, and the shape of the bokeh blur spotlights. The quality attributes of the portrait image (exposure, color, texture) are also taken into account.

Preview tests analyze the quality of the camera app’s image preview, with a focus on the difference between capture and preview, particularly regarding dynamic range and the application of bokeh. The smoothness of exposure, color and focus adaptation when switching from the minimum to the maximum available zoom factor is also evaluated. The preview frame rate is measured using the LED universal timer.

Inżynierowie firmy SBMARK przechwytują i oceniają ponad 400 obrazów testowych w kontrolowanych warunkach laboratoryjnych oraz w naturalnych scenach na zewnątrz, w pomieszczeniach i przy słabym oświetleniu, korzystając z domyślnych ustawień aparatu i zoomu typu pinch przy różnych współczynnikach powiększenia, od bardzo szerokiego powiększenia do powiększenia o dużym zasięgu. Ocena dokonywana jest poprzez wizualne zbadanie obrazów odnoszących się do scen naturalnych i dokonanie obiektywnych pomiarów obrazów map zarejestrowanych w laboratorium w różnych warunkach od 20 do 1000 luksów i temperaturach barwowych od 2300 K do 6500 K.

These tests analyze the performance of the ultra-wide camera at different focal lengths from 12mm to 20mm. All image quality attributes are evaluated, with particular attention to artifacts such as chromatic aberrations, lens softness and distortion. The images below are an excerpt of the tested scenes.

All image quality attributes are evaluated at focal lengths between approximately 40mm and 300mm, with particular attention to texture and detail. The score is derived from a series of objective measurements in the laboratory and perceptual analysis of real-life images.

Inżynierowie SBMARK przechwytują i oceniają ponad 2.5 godziny materiału wideo w kontrolowanych warunkach laboratoryjnych oraz w naturalnych scenach przy słabym oświetleniu, zarówno w pomieszczeniach, jak i na zewnątrz, przy użyciu domyślnych ustawień aparatu. Ocena polega na oględzinach filmów naturalnych zarejestrowanych w różnych warunkach oraz dokonaniu obiektywnych pomiarów na filmach z wykresami zarejestrowanymi w laboratorium w różnych warunkach od 1 do 1000+ luksów i temperaturach barwowych od 2,300 K do 6,500 K.

Exposure tests evaluate the brightness of the main subject and the dynamic range, e.g. the ability to make details visible in both bright and dark areas of the image. The stability and temporal adaptation of the exposure are also analyzed.
Analiza kolorów jakości obrazu bada oddawanie barw, oddawanie odcieni skóry, balans bieli, cieniowanie kolorów, stabilność balansu bieli i jego adaptację przy zmianie światła.

Texture tests analyze the level of detail and texture of real videos and graphics videos recorded in the lab. Natural video footage is assessed visually, paying particular attention to the level of detail in bright and dark areas. Objective measurements are performed on chart images taken under various conditions from 1 to 1000 lux. The cards used are SBMARK (DMC) card and Dead Leaves card.

Noise tests analyze various noise attributes such as intensity, chromaticity, grain, structure, temporal aspects on real video recordings and on videos of graphs taken in the laboratory. Natural videos are evaluated visually, with particular attention to noise in dark areas and high dynamic range conditions. Objective measurements are performed on graph videos recorded under various conditions from 1 to 1000 lux. The graph used is the SBMARK visual noise graph.

The stabilization rating checks the device’s ability to stabilize footage thanks to software or hardware technologies such as OIS, EIS or any other means. The evaluation examines residual motion, smoothness, yellow artifacts, and residual motion blur in walking and running use cases under various lighting conditions. The video below is an excerpt of one of the scenes tested.

Artifacts are evaluated with MTF and ringing measurements on the SFR graph in the lab, as well as frame rate measurements using the LED universal timer. Natural videos are visually evaluated paying particular attention to artifacts such as aliasing, quantization, blocking, and hue shift, among others. The more severe and frequent the artifact, the greater the deduction of points from the score. The main artifacts and the corresponding point loss are listed below.