Our 2022 test suite for Windows 11-based systems carries over some of the standard benchmarks we have been using over the last several years, including UL's PCMark and BAPCo's SYSmark. Starting this year, we are also including BAPCo's CrossMark multi-platform benchmarking tool.
PCMark 10
UL's PCMark 10 evaluates computing systems for various usage scenarios (generic / essential tasks such as web browsing and starting up applications, productivity tasks such as editing spreadsheets and documents, gaming, and digital content creation). We benchmarked select PCs with the PCMark 10 Extended profile and recorded the scores for various scenarios. These scores are heavily influenced by the CPU and GPU in the system, though the RAM and storage device also play a part. The power plan was set to Balanced for all the PCs while processing the PCMark 10 benchmark.
As expected, Atlas Canyon comes out on top in all sections. Not surprising, given that it has the highest PL1 (15W) and PL2 (25W) settings, is equipped with the fastest possible DDR4-2933 RAM in dual-channel configuration, and comes with active cooling. The MiniAir 11 compares favorably against the June Canyon NUC in all except the Gaming component (where it loses out due to a combination of lesser number of EUs in the GPU and lack of dual channel memory). Additionally, it loses out against the CI331 nano consistently and against the JSLM-MINI in the Essentials and Productivity components - again, due to the lack of dual-channel memory.
BAPCo SYSmark 25
BAPCo's SYSmark 25 is an application-based benchmark that uses real-world applications to replay usage patterns of business users in the areas of productivity, creativity, and responsiveness. The 'Productivity Scenario' covers office-centric activities including word processing, spreadsheet usage, financial analysis, software development, application installation, file compression, and e-mail management. The 'Creativity Scenario' represents media-centric activities such as digital photo processing, AI and ML for face recognition in photos and videos for the purpose of content creation, etc. The 'Responsiveness Scenario' evaluates the ability of the system to react in a quick manner to user inputs in areas such as application and file launches, web browsing, and multi-tasking.
Scores are meant to be compared against a reference desktop (the SYSmark 25 calibration system, a Lenovo Thinkcenter M720q with a Core i5-8500T and 8GB of DDR4 memory to go with a 256GB M.2 NVMe SSD). The calibration system scores 1000 in each of the scenarios. A score of, say, 2000, would imply that the system under test is twice as fast as the reference system.
SYSmark 25 also adds energy measurement to the mix. A high score in the SYSmark benchmarks might be nice to have, but potential customers also need to determine the balance between power consumption and the performance of the system. For example, in the average office scenario, it might not be worth purchasing a noisy and power-hungry PC just because it ends up with a 2000 score in the SYSmark 25 benchmarks. In order to provide a balanced perspective, SYSmark 25 also allows vendors and decision makers to track the energy consumption during each workload. In the graphs below, we find the total energy consumed by the PC under test for a single iteration of each SYSmark 25 workload. For reference, the calibration system consumes 8.88 Wh for productivity, 10.81 Wh for creativity, and 19.69 Wh overall.
Almost all the observations made for the PCMark 10 benchmarks hold true here too. The Atlas Canyon NUC is on top, and the ZBOX CI331 nano manages to sneak in ahead of the MiniAir 11 despite being passively cooled. The MiniAir 11 pays the penalty for prioritizing cooling requirements / silence (by lowering PL1 and PL2), and cost (by configuring the system with single-channel memory). However, the same aspects help the system in delivering very good energy efficiency - yes, it does perform slower in the benchmarks, but it makes up for it by consuming very less power for the workload duration. The comparison for the June Canyon and Atlas Canyon on the energy front is more interesting. The Atlas Canyon NUC delivers approximately 60% better performance at the cost of 18% additional energy.
BAPCo CrossMark 1.0.1.86
BAPCo's CrossMark aims to simplify benchmark processing while still delivering scores that roughly tally with SYSmark. The main advantage is the cross-platform nature of the tool - allowing it to be run on smartphones and tablets as well.
The relative performance seen in SYSmark 25 translate to CrossMark also, as expected. The responsiveness ratings vary significantly due to the usage of SATA SSDs in the MiniAir 11 and the ZBOX CI331 nano, compared to NVMe ones in others.
ncG1vNJzZmivp6x7orrAp5utnZOde6S7zGiqoaenZH54gJdxZqKmpJq5bq3TpZisZZOWu7q7zWalrpthZq61t8%2BeZJqmlGK0prHKqKRmpZmjtqK10WZoamWlmLOnec%2Bcqmaqlau2psOMnZyso6SkvW62wKynnqpdoa6ssYyipKmqlajApr%2BObA%3D%3D