[MLton] benchmarks for 20040227

Stephen Weeks MLton@mlton.org
Sat, 28 Feb 2004 17:26:03 -0800


Here are the benchmarks, which I just posted on the web.  I didn't see
anything too surprising.

run time ratio
benchmark         MLton0 ML-Kit Moscow-ML Poly/ML SML/NJ
barnes-hut          1.00      *         *       *   1.01
boyer               1.00      *     10.43    2.65   3.48
checksum            1.00      *         *       *      *
count-graphs        1.00   6.13     36.08    6.32   2.34
DLXSimulator        1.00      *         *       *      *
fft                 1.00   2.77         *   47.90   1.04
fib                 1.00   1.27      5.28    0.87   1.28
hamlet              1.00      *         *       *   2.29
imp-for             1.00   4.92     76.60   12.39   6.90
knuth-bendix        1.00      *     18.42    8.47   3.57
lexgen              1.00   1.73      4.83    1.66   1.30
life                1.00   2.31     21.70    8.54   1.26
logic               1.00      *      6.39    1.44   1.04
mandelbrot          1.00  13.09     42.66   66.97   1.45
matrix-multiply     1.00   3.86     36.14   11.62   3.78
md5                 1.00      *         *       *      *
merge               1.00      *         *    1.52   5.65
mlyacc              1.00      *      7.11    1.50   1.66
model-elimination   1.00      *         *       *   1.79
mpuz                1.00   2.70     57.82    5.91   3.71
nucleic             1.00      *         *   23.69   0.67
output1             1.00  15.45     24.56    2.29   5.29
peek                1.00  24.96    147.60   24.19  17.93
psdes-random        1.00   7.44         *       *   3.31
ratio-regions       1.00   2.16     25.29    2.77   4.66
ray                 1.00      *     21.96   35.11   1.17
raytrace            1.00      *         *       *   2.83
simple              1.00   1.87     14.50    7.40   1.61
tailfib             1.00   1.51     42.29    2.82   2.83
tak                 1.00   2.45      9.83    0.86   1.62
tensor              1.00      *         *       *  15.39
tsp                 1.00   2.80     21.53       *  46.75
tyan                1.00      *     14.07    1.63   0.95
vector-concat       1.00   1.53     14.97    1.57   8.88
vector-rev          1.00   2.04     21.94    2.90  74.24
vliw                1.00      *         *       *   1.24
wc-input1           1.00  14.90         *    6.66   8.31
wc-scanStream       1.00  23.14         *  380.71  10.17
zebra               1.00   5.76     25.15    5.98   7.27
zern                1.00      *         *       *   2.72

compile time
benchmark         MLton0 ML-Kit Moscow-ML Poly/ML SML/NJ
barnes-hut          6.11      *         *       *   1.12
boyer               8.15   9.31      0.39    0.15   3.16
checksum            4.70      *         *       *      *
count-graphs        5.39   2.07      0.12    0.07   0.68
DLXSimulator        7.14      *         *       *      *
fft                 5.20   1.53      0.12    0.06   0.59
fib                 4.69   0.87      0.04    0.02   0.16
hamlet             45.69      *         *       *  52.63
imp-for             4.72   0.99      0.04    0.02   0.19
knuth-bendix        5.76   4.21      0.18    0.15   1.34
lexgen              8.15   6.47      0.38    0.32   3.24
life                5.21   2.44      0.09    0.06   0.52
logic               6.20   4.82      0.21    0.13   1.66
mandelbrot          4.66   0.98      0.05    0.02   0.23
matrix-multiply     4.81   1.03      0.06    0.03   0.25
md5                 5.10      *         *       *      *
merge               4.69   0.92      0.05    0.02   0.22
mlyacc             22.94  37.03      3.64    1.45  14.72
model-elimination  20.91      *         *       *  25.68
mpuz                4.80   1.25      0.06    0.03   0.33
nucleic            61.94  31.14         *    0.49   2.54
output1             4.99   0.91      0.04    0.02   0.17
peek                4.83   0.97      0.04    0.03   0.19
psdes-random        4.70   1.00         *       *  65.89
ratio-regions       5.83   3.79      0.19    0.13   1.39
ray                 7.35   3.23      0.13    0.09   0.78
raytrace           11.24      *         *       *   4.67
simple              9.27  11.72      0.43    0.26   3.32
tailfib             4.63   0.92      0.04    0.03   0.17
tak                 4.64   0.88      0.04    0.02   0.17
tensor              6.50      *         *       *   2.08
tsp                 5.17   2.39      0.14       *   0.53
tyan                6.94   5.84      0.27    0.20   1.89
vector-concat       4.73   0.91      0.05    0.03   0.18
vector-rev          4.68   0.93      0.05    0.03   0.18
vliw               14.76      *         *       *  12.13
wc-input1           5.52   0.93      0.05    0.02   0.20
wc-scanStream       5.62   0.97      0.04    0.03   0.22
zebra               6.82   2.54      0.09    0.07   0.62
zern                5.24      *         *       *   0.56

size
benchmark            MLton0  ML-Kit Moscow-ML   Poly/ML    SML/NJ
barnes-hut          143,701       *         *         *   408,640
boyer               226,477 156,737   116,300   122,880   497,704
checksum            116,365       *         *         *         *
count-graphs        133,901  88,601    84,613    98,304   436,344
DLXSimulator        176,853       *         *         *         *
fft                 134,777  85,433    84,046    65,536   409,680
fib                 114,701  16,101    79,892    49,152   386,816
hamlet            1,339,351       *         *         * 1,395,984
imp-for             114,685  16,869    80,040    57,344   371,752
knuth-bendix        152,549  97,177    88,439   180,224   402,472
lexgen              235,930 215,729   104,883   196,608   473,152
life                134,149  79,253    83,390    65,536   386,088
logic               174,485 115,217    87,251   114,688   411,688
mandelbrot          114,785  77,905    81,340    57,344   375,848
matrix-multiply     117,357  96,137    82,417    57,344   404,536
md5                 123,529       *         *         *         *
merge               116,117  25,601    80,090    49,152   387,848
mlyacc              552,670 502,081   148,286 2,850,816   782,448
model-elimination   671,086       *         *         * 1,010,936
mpuz                118,877  75,925    82,382    81,920   384,040
nucleic             265,193 268,237         *   221,184   462,904
output1             133,271  61,465    80,187    49,152   386,816
peek                124,857  60,829    81,621    57,344   374,872
psdes-random        115,101  25,529         *         *   393,272
ratio-regions       142,969  98,489    87,482    73,728   414,776
ray                 222,819 112,309    89,859   147,456   469,136
raytrace            325,759       *         *         *   588,976
simple              283,637 202,561    94,396   475,136   728,168
tailfib             114,813  16,301    79,943    57,344   386,816
tak                 114,753  16,093    79,908    57,344   382,720
tensor              145,996       *         *         *   422,000
tsp                 125,313  99,497    86,146         *   400,448
tyan                182,665 146,101    91,586   196,608   448,600
vector-concat       116,417  24,517    80,194    49,152   398,096
vector-rev          115,765  24,697    80,078    57,344   398,096
vliw                433,564       *         *         *   712,872
wc-input1           152,353 132,765    85,771    49,152   375,848
wc-scanStream       150,925 133,261    85,947    49,152   376,872
zebra               184,609  44,741    83,422    90,112   391,224
zern                148,770       *         *         *   448,664