[MLton-devel] benchmarks with -profile {no,alloc,time}

Stephen Weeks MLton@mlton.org
Sat, 2 Nov 2002 18:02:55 -0800


> There is some bug with time profiling that causes the profiled
> executable to fail fairly often.

That checkin fixed the bug.  Below are the new benchmark results.
-profile time has almost no impact on code size and time.

MLton0 -- mlton -profile no
MLton1 -- mlton -profile alloc
MLton2 -- mlton -profile time
compile time
benchmark         MLton0 MLton1 MLton2
barnes-hut           1.5    1.7    1.7
boyer                3.2    3.7    3.6
checksum             0.4    0.5    0.5
count-graphs         1.1    1.3    1.2
DLXSimulator         2.5    2.9    2.9
fft                  0.8    1.0    1.0
fib                  0.4    0.5    0.5
hamlet              33.7   38.7   36.8
imp-for              0.4    0.5    0.5
knuth-bendix         1.3    1.5    1.5
lexgen               3.6    4.0    4.0
life                 0.8    1.0    1.1
logic                2.0    2.4    2.1
mandelbrot           0.4    0.5    0.5
matrix-multiply      0.5    0.6    0.6
md5                  0.8    0.9    1.0
merge                0.4    0.6    0.5
mlyacc              15.6   18.0   16.6
model-elimination   14.3   17.0   16.3
mpuz                 0.5    0.7    0.7
nucleic              3.7    3.8    4.0
peek                 0.7    0.7    0.8
psdes-random         0.4    0.5    0.6
ratio-regions        1.7    1.9    1.8
ray                  2.4    2.6    2.3
raytrace             6.7    7.8    7.7
simple               4.4    5.5    5.1
smith-normal-form    5.7    5.5    5.2
tailfib              0.4    0.5    0.5
tak                  0.4    0.5    0.5
tensor               2.0    2.2    2.2
tsp                  1.0    1.2    1.1
tyan                 2.7    2.9    2.9
vector-concat        0.5    0.6    0.6
vector-rev           0.4    0.6    0.6
vliw                 8.1   10.2    9.5
wc-input1            1.1    1.3    1.3
wc-scanStream        1.1    1.2    1.2
zebra                4.3    5.1    4.9
zern                 0.7    0.8    0.8
run time
benchmark         MLton0 MLton1 MLton2
barnes-hut          30.8   31.9   31.2
boyer               37.5   36.9   45.9
checksum            46.7   46.7   46.8
count-graphs        30.9   36.9   32.3
DLXSimulator        73.5   79.3   73.9
fft                 41.3   41.6   41.7
fib                 27.3   31.1   28.2
hamlet              35.2   39.6   37.9
imp-for             35.0   31.9   31.8
knuth-bendix        31.4   32.3   31.8
lexgen              29.8   34.8   30.5
life                37.6   43.9   40.2
logic               43.1   44.2   40.6
mandelbrot          36.3   39.6   39.6
matrix-multiply     34.0   34.1   34.1
md5                 96.8  105.4  105.4
merge               65.5   64.4   57.9
mlyacc              31.8   34.0   32.6
model-elimination   46.3   50.4   47.7
mpuz                24.5   25.1   25.3
nucleic             38.6   42.1   43.5
peek                18.8   18.8   18.8
psdes-random        16.7   17.3   16.9
ratio-regions       33.2   34.1   33.8
ray                 16.2   16.3   15.9
raytrace            22.6   24.0   22.9
simple              31.7   34.4   32.5
smith-normal-form   35.1   35.0   32.8
tailfib             29.6   24.4   24.4
tak                 55.4   59.2   59.7
tensor              20.3   18.4   18.6
tsp                 37.3   37.8   38.0
tyan                38.9   42.6   39.2
vector-concat       64.5   66.2   65.4
vector-rev          83.6   84.6   79.9
vliw                30.7   33.6   32.7
wc-input1           34.0   35.5   35.7
wc-scanStream       31.5   31.1   31.3
zebra               36.6   44.7   37.8
zern                42.4   43.9   42.8
run time ratio
benchmark         MLton1 MLton2
barnes-hut           1.0    1.0
boyer                1.0    1.2
checksum             1.0    1.0
count-graphs         1.2    1.0
DLXSimulator         1.1    1.0
fft                  1.0    1.0
fib                  1.1    1.0
hamlet               1.1    1.1
imp-for              0.9    0.9
knuth-bendix         1.0    1.0
lexgen               1.2    1.0
life                 1.2    1.1
logic                1.0    0.9
mandelbrot           1.1    1.1
matrix-multiply      1.0    1.0
md5                  1.1    1.1
merge                1.0    0.9
mlyacc               1.1    1.0
model-elimination    1.1    1.0
mpuz                 1.0    1.0
nucleic              1.1    1.1
peek                 1.0    1.0
psdes-random         1.0    1.0
ratio-regions        1.0    1.0
ray                  1.0    1.0
raytrace             1.1    1.0
simple               1.1    1.0
smith-normal-form    1.0    0.9
tailfib              0.8    0.8
tak                  1.1    1.1
tensor               0.9    0.9
tsp                  1.0    1.0
tyan                 1.1    1.0
vector-concat        1.0    1.0
vector-rev           1.0    1.0
vliw                 1.1    1.1
wc-input1            1.0    1.1
wc-scanStream        1.0    1.0
zebra                1.2    1.0
zern                 1.0    1.0
size
benchmark            MLton0    MLton1    MLton2
barnes-hut          104,064   110,810   110,762
boyer               141,119   165,049   159,649
checksum             44,375    50,457    50,977
count-graphs         65,399    75,481    73,529
DLXSimulator        103,056   118,434   115,490
fft                  53,547    60,437    59,181
fib                  44,415    50,537    51,049
hamlet            1,228,776 1,456,320 1,312,872
imp-for              44,431    50,553    51,105
knuth-bendix         86,928    97,538    92,106
lexgen              173,677   196,045   184,405
life                 62,751    71,497    70,137
logic               104,423   117,801   113,561
mandelbrot           44,479    50,617    51,089
matrix-multiply      44,919    51,097    51,617
md5                  53,544    58,706    58,882
merge                45,703    52,105    52,449
mlyacc              537,453   609,565   565,661
model-elimination   636,752   743,826   678,002
mpuz                 48,551    55,545    55,737
nucleic              83,527    90,889    90,409
peek                 52,616    57,330    57,322
psdes-random         45,415    51,593    52,033
ratio-regions        63,167    78,281    77,881
ray                 104,880   115,248   109,560
raytrace            278,621   314,861   290,197
simple              200,331   233,877   218,301
smith-normal-form   182,364   188,446   188,150
tailfib              44,143    50,265    50,785
tak                  44,543    50,649    51,153
tensor              105,099   113,613   111,789
tsp                  60,128    64,898    64,946
tyan                107,984   124,754   118,914
vector-concat        44,879    51,001    51,489
vector-rev           44,767    50,873    51,393
vliw                324,457   379,529   346,665
wc-input1            66,877    74,237    72,261
wc-scanStream        67,549    75,021    72,901
zebra               143,128   176,994   165,202
zern                 51,250    56,692    56,692


-------------------------------------------------------
This sf.net email is sponsored by: See the NEW Palm 
Tungsten T handheld. Power & Color in a compact size!
http://ads.sourceforge.net/cgi-bin/redirect.pl?palm0001en
_______________________________________________
MLton-devel mailing list
MLton-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/mlton-devel