We put the Asus Zenfone 11 Ultra through our rigorous DXOMARK Camera test suite to measure its performance in photo, video, and zoom quality from an end-user perspective. This article breaks down how the device fared in a variety of tests and several common use cases and is intended to highlight the most important results of our testing with an extract of the captured data.
Overview
Key camera specifications:
- Primary: 50MP 1/1.56″ sensor, 1.0µm pixels, 24mm equivalent f/1.9-aperture lens, PDAF, gimbal OIS
- Ultra-wide:13MP 1/3.0″ sensor, 1.12µm pixels, 13mm equivalent f/2.2-aperture lens
- Tele: 32MP 1/3.2″ sensor, 0.7µm pixels, 65mm equivalent f/2.4-aperture lens, PDAF, OIS
Scoring
Sub-scores and attributes included in the calculations of the global score.
Asus Zenfone 11 Ultra
Use cases & Conditions
Use case scores indicate the product performance in specific situations. They are not included in the overall score calculations.
Outdoor
Photos & videos shot in bright light conditions (≥1000 lux)
Indoor
Photos & videos shot in good lighting conditions (≥100lux)
Lowlight
Photos & videos shot in low lighting conditions (<100 lux)
Friends & Family
Portrait and group photo & videos
Pros
- Good exposure for daylight landscape shots
- Fairly accurate white balance in daylight and indoors
- Image noise fairly well under control in bright light
- Accurate autofocus
- Good exposure and white balance, low noise in bright light videos
- Effective video stabilization in most cases
Cons
- Occasional inaccurate skin tone rendering
- Local noise in often in indoor and low light scenes
- Lack of texture in low light
- Lack of detail in most zoom shots
- Exposure, color and autofocus instabilities in video
- Limited dynamic range
- Low levels of video detail
- Inaccurate color rendering and lack of saturation in video
The Asus Zenfone 11 Ultra is capable of delivering decent photos and video clips in everyday use but could not quite match the best Ultra Premium competitors in the DXOMARK Camera tests, achieving lower scores pretty much across the board. Exposure was good when capturing landscape photos and our testers liked the fairly accurate white balance and low noise levels in bright light conditions. However, they also noticed inaccurate skin tones, as well as noise and a lack of detail and in low light. Zoom shots lacked detail and could be noisy at most focal length setting and while video clips were stable and smooth in most scenarios, video detail was low and exposure, color and autofocus were all unstable in some conditions.
Test summary
About DXOMARK Camera tests: DXOMARK’s Camera evaluations take place in laboratories and in real-world situations using a wide variety of subjects. The scores rely on objective tests for which the results are calculated directly by measurement software on our laboratory setups, and on perceptual tests in which a sophisticated set of metrics allow a panel of image experts to compare aspects of image quality that require human judgment. Testing a smartphone involves a team of engineers and technicians for about a week. Photo, Zoom, and Video quality are scored separately and then combined into an Overall score for comparison among the cameras in different devices. For more information about the DXOMARK Camera protocol, click here. More details on smartphone camera scores are available here. The following section gathers key elements of DXOMARK’s exhaustive tests and analyses. Full performance evaluations are available upon request. Please contact us on how to receive a full report.
Photo
Asus Zenfone 11 Ultra
169
For scoring and analysis, DXOMARK engineers capture and evaluate more than 2,600 test images both in controlled lab environments and in outdoor, indoor and low-light natural scenes, using the camera’s default settings. The photo protocol is designed to take into account the main use cases and is based on typical shooting scenarios, such as portraits, family, and landscape photography. The evaluation is performed by visually inspecting images against a reference of natural scenes, and by running objective measurements on images of charts captured in the lab under different lighting conditions from 1 to 1,000+ lux and color temperatures from 2,300K to 6,500K.
In Photo mode, the Zenfone 11 Ultra was capable of capturing pleasant images in most test conditions, even in difficult backlit scenes, or when shooting in low light. However, the overall photo performance remained below the best competitors in its price segment. Our testers sometimes found subject exposure to be slightly dark and skin tone rendering could be slightly off. While the trade-off between detail retention and noise reduction was pretty good in bright light, the level of captured detail could not quite match the best in class devices. Image noise levels increased under typical indoor lighting and in dim conditions. Our testers also observed some shadow noise. In terms of image artifacts, ghosting effects could often be seen on moving subjects.
Exposure
Asus Zenfone 11 Ultra
130
Color
Asus Zenfone 11 Ultra
130
Exposure and color are the key attributes for technically good pictures. For exposure, the main attribute evaluated is the brightness of the main subject through various use cases such as landscape, portrait, or still life. Other factors evaluated are the contrast and the dynamic range, eg. the ability to render visible details in both bright and dark areas of the image. Repeatability is also important because it demonstrates the camera's ability to provide the same rendering when shooting several images of the same scene.
For color, the image quality attributes analyzed are skin-tone rendering, white balance, color shading, and repeatability. For color and skin tone rendering, we penalize unnatural colors but we respect a manufacturer's choice of color signature.
Autofocus
Asus Zenfone 11 Ultra
125
Autofocus tests concentrate on focus accuracy, focus repeatability, shooting time delay, and depth of field. Shooting delay is the difference between the time the user presses the capture button and the time the image is actually taken. It includes focusing speed and the capability of the device to capture images at the right time, what is called 'zero shutter lag' capability. Even if a shallow depth of field can be pleasant for a single subject portrait or close-up shot, it can also be a problem in some specific conditions such as group portraits; Both situations are tested. Focus accuracy is also evaluated in all the real-life images taken, from infinity to close-up objects and in low light to outdoor conditions.
Texture
Asus Zenfone 11 Ultra
124
Texture tests analyze the level of details and the texture of subjects in the images taken in the lab as well as in real-life scenarios. For natural shots, particular attention is paid to the level of details in the bright and dark areas of the image. Objective measurements are performed on chart images taken in various lighting conditions from 1 to 1000 lux and different kinds of dynamic range conditions. The charts used are the proprietary DXOMARK chart (DMC) and the Dead Leaves chart.
Noise
Asus Zenfone 11 Ultra
117
Noise tests analyze various attributes of noise such as intensity, chromaticity, grain, structure on real-life images as well as images of charts taken in the lab. For natural images, particular attention is paid to the noise on faces, landscapes, but also on dark areas and high dynamic range conditions. Noise on moving objects is also evaluated on natural images. Objective measurements are performed on images of charts taken in various conditions from 1 to 1000 lux and different kinds of dynamic range conditions. The chart used is the Dead Leaves chart and the standardized measurement such as Visual Noise derived from ISO 15739.
Artifacts
Asus Zenfone 11 Ultra
82
The artifacts evaluation looks at lens shading, chromatic aberrations, geometrical distortion, edges ringing, halos, ghosting, quantization, unexpected color hue shifts, among others type of possible unnatural effects on photos. The more severe and the more frequent the artifact, the higher the point deduction on the score. The main artifacts observed and corresponding point loss are listed below.
Bokeh
Asus Zenfone 11 Ultra
85
Bokeh is tested in one dedicated mode, usually portrait or aperture mode, and analyzed by visually inspecting all the images captured in the lab and in natural conditions. The goal is to reproduce portrait photography comparable to one taken with a DLSR and a wide aperture. The main image quality attributes paid attention to are depth estimation, artifacts, blur gradient, and the shape of the bokeh blur spotlights. Portrait image quality attributes (exposure, color, texture) are also taken into account.
Preview
Asus Zenfone 11 Ultra
93
Preview tests analyze the image quality of the camera app's preview of the image, with particular attention paid to the difference between the capture and the preview, especially regarding dynamic range and the application of the bokeh effect. Also evaluated is the smoothness of the exposure, color and focus adaptation when zooming from the minimal to the maximal zoom factor available. The preview frame rate is measured using the LED Universal Timer.
Zoom
Asus Zenfone 11 Ultra
164
DXOMARK engineers capture and evaluate over 400 test images in controlled lab environments and in outdoor, indoor, and low-light natural scenes, using the camera’s default settings and pinch zoom at various zoom factors from ultra wide to very long-range zoom. The evaluation is performed by visually inspecting the images against a reference of natural scenes, and by running objective measurements of chart mages captured in the lab under different conditions from 20 to 1000 lux and color temperatures from 2300K to 6500K.
The Zenfone 11 Ultra’s 3x optical tele zoom offered decent image results when shooting in bright light, but lacked quality at close and long range settings. In more challenging conditions, such as low light, noise could be quite intrusive and images lacked detail. In addition, our testers observed some exposure errors, resulting in underexposed images. The ultra-wide camera delivered a good performance in bright light, but showed limitations indoors and in low light. Skin tones often looked unnatural and white balance casts could be noticeable.
Wide
Asus Zenfone 11 Ultra
122
These tests analyze the performance of the ultra-wide camera at several focal lengths from 12 mm to 20 mm. All image quality attributes are evaluated, with particular attention paid to such artifacts as chromatic aberrations, lens softness, and distortion. Pictures below are an extract of tested scenes.
Tele
Asus Zenfone 11 Ultra
120
All image quality attributes are evaluated at focal lengths from approximately 40 mm to 300 mm, with particular attention paid to texture and detail. The score is derived from a number of objective measurements in the lab and perceptual analysis of real-life images.
Video
Asus Zenfone 11 Ultra
159
DXOMARK engineers capture and evaluate more than 2.5 hours of video in controlled lab environments and in natural low-light, indoor and outdoor scenes, using the camera’s default settings. The evaluation consists of visually inspecting natural videos taken in various conditions and running objective measurements on videos of charts recorded in the lab under different conditions from 1 to 1000+ lux and color temperatures from 2,300K to 6,500K.
Overall, the Zenfone 11 Ultra’s video mode left quite some room for improvement. The camera often got exposure wrong when recording in bright light or indoors. While white balance was neutral, some exposure and color transition issues were noticeable. The autofocus generally did a good job at keeping the subject in focus, but was unstable with some stepping. Video noise levels were low, but so was the level of recorded detail. While video stabilization was generally quite good at counteracting camera motion, some camera shake tended to be noticeable in the most challenging scenes.
Exposure
Asus Zenfone 11 Ultra
116
Color
Asus Zenfone 11 Ultra
120
Exposure tests evaluate the brightness of the main subject and the dynamic range, eg. the ability to render visible details in both bright and dark areas of the image. Stability and temporal adaption of the exposure are also analyzed.
Image-quality color analysis looks at color rendering, skin-tone rendering, white balance, color shading, stability of the white balance and its adaption when light is changing.
Some adaptation issues are visible with exposure and white balance in most conditions, but mostly in indoor and lowlight.
Texture
Asus Zenfone 11 Ultra
118
Texture tests analyze the level of details and texture of the real-life videos as well as the videos of charts recorded in the lab. Natural videos recordings are visually evaluated, with particular attention paid to the level of details in the bright and areas as well as in the dark. Objective measurements are performed of images of charts taken in various conditions from 1 to 1000 lux. The charts used are the DXOMARK chart (DMC) and Dead Leaves chart.
Noise
Asus Zenfone 11 Ultra
120
Noise tests analyze various attributes of noise such as intensity, chromaticity, grain, structure, temporal aspects on real-life video recording as well as videos of charts taken in the lab. Natural videos are visually evaluated, with particular attention paid to the noise in the dark areas and high dynamic range conditions. Objective measurements are performed on the videos of charts recorded in various conditions from 1 to 1000 lux. The chart used is the DXOMARK visual noise chart.
Stabilization
Asus Zenfone 11 Ultra
119
Stabilization evaluation tests the ability of the device to stabilize footage thanks to software or hardware technologies such as OIS, EIS, or any others means. The evaluation looks at residual motion, smoothness, jellow artifacts and residual motion blur on walk and run use cases in various lighting conditions. The video below is an extract from one of the tested scenes.
Artifacts
Asus Zenfone 11 Ultra
86
Artifacts are evaluated with MTF and ringing measurements on the SFR chart in the lab as well as frame-rate measurements using the LED Universal Timer. Natural videos are visually evaluated by paying particular attention to artifacts such as aliasing, quantization, blocking, and hue shift, among others. The more severe and the more frequent the artifact, the higher the point deduction from the score. The main artifacts and corresponding point loss are listed below.