local ref benchmarks

Matthew Fluet Matthew Fluet <fluet@CS.Cornell.EDU>
Fri, 30 Nov 2001 17:34:21 -0500 (EST)


Compile times still disappointing; run times unchanged.

MLton0 -- mlton -drop-pass localRef
MLton1 -- mlton 
compile time
benchmark         MLton0 MLton1
barnes-hut          2.55   2.57
checksum            0.62   0.64
count-graphs        1.68   1.72
DLXSimulator        5.07   5.56
fft                 1.31   1.32
fib                 0.60   0.59
hamlet             64.41  69.48
knuth-bendix        2.27   2.28
lexgen              5.90   6.45
life                1.31   1.32
logic               3.52   3.53
mandelbrot          0.60   0.62
matrix-multiply     0.64   0.66
md5                 1.30   1.30
merge               0.70   0.70
mlyacc             55.79  58.04
mpuz                0.93   0.94
nucleic             3.16   3.21
peek                1.20   1.19
psdes-random        0.71   0.72
ratio-regions       2.94   3.07
ray                 4.51   4.51
raytrace           12.86  13.40
simple              9.22   9.49
smith-normal-form   9.33   9.63
tailfib             0.63   0.64
tak                 0.65   0.65
tensor              3.55   3.86
tsp                 1.75   1.74
tyan                4.63   4.72
vector-concat       0.72   0.71
vector-rev          0.71   0.69
vliw               17.43  18.03
wc-input1           1.98   1.93
wc-scanStream       2.04   1.96
zebra              20.70  21.32
zern                1.23   1.22
run time
benchmark         MLton0 MLton1
barnes-hut          4.23   4.22
checksum            3.09   3.09
count-graphs        4.92   5.06
DLXSimulator       15.83  15.99
fft                 9.71   9.72
fib                 3.40   3.40
hamlet              8.39   8.48
knuth-bendix        6.65   6.64
lexgen             10.59  10.33
life                6.69   6.65
logic              20.75  20.70
mandelbrot          6.93   6.46
matrix-multiply     3.98   3.94
md5                 2.03   2.03
merge              62.47  63.19
mlyacc             10.92  10.93
mpuz                4.61   4.60
nucleic             8.56   8.56
peek                3.58   3.25
psdes-random        3.40   3.20
ratio-regions      10.15  10.39
ray                 3.96   3.95
raytrace            5.07   5.08
simple              6.94   6.91
smith-normal-form   1.05   1.05
tailfib            16.29  15.48
tak                 8.69   8.69
tensor              7.00   6.99
tsp                 9.29   9.15
tyan               23.52  23.50
vector-concat       6.13   5.63
vector-rev          5.15   5.15
vliw                7.25   7.27
wc-input1           2.20   1.99
wc-scanStream       3.36   3.72
zebra               2.58   2.62
zern               42.24  42.38
run time ratio
benchmark         MLton1
barnes-hut          1.00
checksum            1.00
count-graphs        1.03
DLXSimulator        1.01
fft                 1.00
fib                 1.00
hamlet              1.01
knuth-bendix        1.00
lexgen              0.98
life                0.99
logic               1.00
mandelbrot          0.93
matrix-multiply     0.99
md5                 1.00
merge               1.01
mlyacc              1.00
mpuz                1.00
nucleic             1.00
peek                0.91
psdes-random        0.94
ratio-regions       1.02
ray                 1.00
raytrace            1.00
simple              1.00
smith-normal-form   1.00
tailfib             0.95
tak                 1.00
tensor              1.00
tsp                 0.98
tyan                1.00
vector-concat       0.92
vector-rev          1.00
vliw                1.00
wc-input1           0.90
wc-scanStream       1.11
zebra               1.02
zern                1.00
size
benchmark            MLton0    MLton1
barnes-hut           67,968    67,024
checksum             21,592    21,304
count-graphs         43,536    43,536
DLXSimulator         90,192    89,024
fft                  32,956    32,700
fib                  21,600    21,320
hamlet            1,497,163 1,496,059
knuth-bendix         66,849    65,721
lexgen              151,032   150,760
life                 41,568    41,280
logic                89,768    89,480
mandelbrot           21,584    21,280
matrix-multiply      21,992    21,712
md5                  32,745    31,625
merge                22,800    22,528
mlyacc              546,312   542,488
mpuz                 26,424    26,136
nucleic              63,688    63,408
peek                 32,177    31,193
psdes-random         22,672    22,192
ratio-regions        44,416    44,456
ray                  85,883    84,091
raytrace            207,496   206,264
simple              185,100   184,940
smith-normal-form   147,348   146,548
tailfib              21,256    20,976
tak                  21,696    21,424
tensor               69,171    67,811
tsp                  37,913    36,921
tyan                 92,729    91,449
vector-concat        22,296    22,024
vector-rev           22,120    21,840
vliw                335,948   334,732
wc-input1            46,305    45,289
wc-scanStream        48,921    46,585
zebra               130,545   129,161
zern                 28,571    28,283
make[1]: Entering directory `/tmp/mlton.18165/mlton/src/benchmark/tests'
../../bin/clean
make[1]: Leaving directory `/tmp/mlton.18165/mlton/src/benchmark/tests'