VMmark

 View Only

 some question about the Reference Scores and test result

jiang jianfeng's profile image
jiang jianfeng posted Feb 19, 2025 09:54 AM

I saw the VMmark 4.x reference scores were obtained using the specified environment,and the Processor is AMD EPYC™ 9354P 3.25 GHz 32-core.

Is that mean If I use a CPU with performance inferior to AMD EPYC™ 9354P for testing, the resulting score will lower than 1?

because i use two INTEL(R) XEON(R) GOLD 6530 2.1GHz  32-core per host(four processors total) do the vmmark4 test run one tile,and the result score is 0.88 not compliant.

if not,holp to know how to make the score higher than 1.

the result like below:

TILE_0_Scores:       WVAuctionVM    WVAuctionK8S   DVDStoreA   DVDStoreB   DVDStoreC   NoSQLBenchA   NoSQLBenchB   NoSQLBenchC   SocialNetwork   Standby
p0                      13158.87         9261.58     2601.25     1929.12     1351.80      43760.24      43758.45      43759.60           71.96      1.00
p1                      13068.85         9249.36     2629.57     1950.28     1441.15      43490.80      43491.88      43489.75           71.85      1.00
p2                      12233.08         9158.95     2518.85     1847.47     1297.05      40677.75      40678.51      40677.55           71.87      1.00

TILE_0_Ratios:       WVAuctionVM    WVAuctionK8S   DVDStoreA   DVDStoreB   DVDStoreC   NoSQLBenchA   NoSQLBenchB   NoSQLBenchC   SocialNetwork   Standby   Geo.Mean
p0                          0.94            1.01        0.90        0.90        0.88          0.77          0.77          0.77            1.00      1.00       0.88
p1                          0.93            1.01        0.91        0.91        0.94          0.77          0.77          0.77            1.00      1.00       0.88
p2                          0.87            1.00        0.87        0.86        0.85          0.72          0.72          0.72            1.00      1.00       0.84

TILE_0_QoS:         WVAuctionVM%   WVAuctionK8S%   DVDStoreA   DVDStoreB   DVDStoreC   NoSQLBenchA   NoSQLBenchB   NoSQLBenchC
p0                11.71 | 12.50*     0.93 | 0.16      613.07      629.09      719.10          0.63          0.64          0.64
p1                12.14 | 12.77*     1.05 | 0.30      602.49      625.17      690.49          0.69          0.70          0.69
p2                19.51 | 14.92*    1.69 | 0.72*      710.10      762.40      850.38          0.73          0.73          0.74

p0_score =   0.88
p1_score =   0.88
p2_score =   0.84

Infrastructure_Operations_Scores:   vMotion   SVMotion   XVMotion   Deploy
Completed_Ops_PerHour                 28.00      13.00      13.00     8.50
Avg_Seconds_To_Complete                6.71      59.54      55.85   373.53
Failures                               0.00       0.00       0.00     0.00
Ratio                                  0.95       1.00       1.00     0.59
Number_Of_Threads                         1          1          1        1

Warnings Messages::
  p0 : WVAuctionVM0 Exceptions : 33967
  p0 : WVAuctionK8S0 Exceptions : 29
  p1 : WVAuctionVM0 Exceptions : 44082
  p1 : WVAuctionK8S0 Exceptions : 34
  p2 : WVAuctionVM0 Exceptions : 101028
  p2 : WVAuctionK8S0 Exceptions : 2218
  rampdown : WVAuctionVM0 Exceptions : 67137
  rampdown : WVAuctionK8S0 Exceptions : 8933

Summary ::
Run_Is_NOT_Compliant
Turbo_Setting : False
Number_of_Workloads_Missing : 0
Number_of_Compliance_Issues (identified by '*' or '+') : 4
Issues Found : 
    Tile0-WVAuctionVM-p0
    Tile0-WVAuctionVM-p1
    Tile0-WVAuctionVM-p2
    Tile0-WVAuctionK8S-p2
Median_Phase : p0

Unreviewed_VMmark4_Applications_Score    :     0.88
Unreviewed_VMmark4_Infrastructure_Score  :     0.86
Unreviewed_VMmark4_Score                 :     0.88 @ 1 Tiles (NC)

Benjamin Hoflich's profile image
Broadcom Employee Benjamin Hoflich

For these score results, it is marked as non-compliant (NC).
It looks likes this is due to the WVAuction workloads QoS metrics, that are marked as non-compliant with the asterisk symbol.
Probably this resulted from insufficient CPU performance from the two systems under test for this 1 tile load level.

jiang jianfeng's profile image
jiang jianfeng

if i use this cpu (INTEL(R) XEON(R) GOLD 6530 2.1GHz  32-core,two processors for one server,four processors total) to do the test , i wanna know is there any chance that the test results will meet the requirements?or i must change the cpu to finish the test.

Benjamin Hoflich's profile image
Broadcom Employee Benjamin Hoflich

I don't know what the score is that can be obtained with the current hardware.  To achieve a 1 tile VMmark4 run that is compliant, you might need more and/or faster hardware.
The existing published VMmark4 and VMmark3 results could be used for guidance on the level of scores achievable with different configurations of hardware.