Performance: VUPS Procedure

  • Bruce Claremont
  • Topic Author
  • Visitor
  • Visitor
14 years 10 months ago #4677 by Bruce Claremont
Performance: VUPS Procedure was created by Bruce Claremont
We currently use the following DCL procedure on VMS systems to take a quick swag at performance. Using this VUPS procedure, a real AlphaServer 400/166 with 384MB of memory runs at 27.1 VUPs.

FreeAXP performance is highly dependent upon the Host O/S (x86 vx x64) and the speed of the underlying hardware. The beta releases of FreeAXP (1.n.n.n) will be slower than the production releases (2.0 and higher).

$! CALCULATE_VUPS
$! Use at your own risk.
$!
$ set noon
$ orig_privs = f$setprv("ALTPRI")
$ process_priority = f$getjpi(0,"PRIB")
$ cpu_multiplier = 10 ! VAX = 10 - Alpha/AXP = 40
$ cpu_round_add = 1 ! VAX = 1 - Alpha/AXP = 9
$ cpu_round_ide = cpu_round_add + 1
$ init_counter = cpu_multiplier * 525
$ init_loop_maximum = 205
$ start_cputime = f$getjpi(0,"CPUTIM")
$ loop_index = 0
$ 10$:
$ loop_index = loop_index + 1
$ if loop_index .ne. init_loop_maximum then goto 10$
$ end_cputime = f$getjpi(0,"CPUTIM")
$ init_vups = ((init_counter / (end_cputime - start_cputime) + -
cpu_round_add) / cpu_round_ide) * cpu_round_ide
$ loop_maximum = (init_vups * init_loop_maximum) / 10
$ base_counter = (init_counter * init_vups) / 10
$ vups = 0
$ times_through_loop = 0
$ 20$:
$ start_cputime = f$getjpi(0,"CPUTIM")
$ loop_index = 0
$ 30$:
$ loop_index = loop_index + 1
$ if loop_index .ne. loop_maximum then goto 30$
$ end_cputime = f$getjpi(0,"CPUTIM")
$ new_vups = ((base_counter / (end_cputime - start_cputime) + -
cpu_round_add) / cpu_round_ide) * cpu_round_ide
$ if new_vups .eq. vups then goto 40$
$ vups = new_vups
$ times_through_loop = times_through_loop + 1
$ if times_through_loop .le. 5 then goto 20$
$ 40$:
$ new_privs = f$setprv(orig_privs)
$ set message /nofacility/noidentification/noseverity/notext
$ ASSIGN/SYSTEM/EXEC 'vups' MACHINE_VUPS_RATING
$ set message /facility/identification/severity/text
$ write sys$output "Approximate System VUPs Rating : ", -
vups / 10,".", vups - ((vups / 10) * 10)
$ exit<hr>

Please Log in or Create an account to join the conversation.

  • astrodanco
  • Topic Author
  • Visitor
  • Visitor
14 years 10 months ago #4678 by astrodanco
Replied by astrodanco on topic RE: Performance: VUPS Procedure
I just ran that on an Intel Core I7 920 and get:
Approximate System VUPs Rating : 29.4

But at least I could run several of these in parallel and get the same rating from each of them.

I'm not sure that using DCL for benchmarking makes for a very reliable benchmark...

Please Log in or Create an account to join the conversation.

  • Bruce Claremont
  • Topic Author
  • Visitor
  • Visitor
14 years 10 months ago #4679 by Bruce Claremont
Replied by Bruce Claremont on topic RE: Performance: VUPS Procedure
Our target for FreeAXP performance is about 30% faster than the beta 254 release is currently running.

I'm open to a better benchmark is one is available.

Please Log in or Create an account to join the conversation.

  • astrodanco
  • Topic Author
  • Visitor
  • Visitor
14 years 10 months ago #4680 by astrodanco
Replied by astrodanco on topic RE: Performance: VUPS Procedure
I don't think there is one publicly available to measure VUPS and never was unless you're were a DEC insider. But you could compile and run the old open source drystone benchmark on the real machines and compare it to the emulated ones.

Please Log in or Create an account to join the conversation.

  • VolkerHalle
  • Topic Author
  • Visitor
  • Visitor
14 years 10 months ago #4681 by VolkerHalle
Replied by VolkerHalle on topic RE: DCL procedure is fine for easy measurement
< class='quote'>[b:]astrodanco wrote:[/b:]
I'm not sure that using DCL for benchmarking makes for a very reliable benchmark...


Performance is a complex thing, real benchmarking as well. But for an overview and an easy measurement of the relative CPU performance, this little DCL procedure seems to be fine. DCL as an interpreter needs lots of CPU cycles to run this procedure. Not much IOs (maybe just 1) and few pagefaults.

Important thing is, everybody has to run the SAME procedure. Don't start 'optimzing' it to get 'better' VUPS numbers.

Volker.

Please Log in or Create an account to join the conversation.

  • astrodanco
  • Topic Author
  • Visitor
  • Visitor
14 years 9 months ago #4682 by astrodanco
Replied by astrodanco on topic RE: Performance: VUPS Procedure
With the April 15th update I'm now getting 33 on the same hardware, so I guess I can confirm seeing the 10% performance improvement.

Please Log in or Create an account to join the conversation.

Moderators: iamcamiel
Time to create page: 0.225 seconds
Powered by Kunena Forum