[MLton-devel] benchmark results for 20020923
Stephen Weeks
MLton@mlton.org
Sun, 29 Sep 2002 01:14:13 -0700
I just finished a round of benchmarks (the new, slower ones) with the
latest MLton and other SML compilers.
MLton 20020923
ML Kit 4.1.1
Moscow ML 2.00
Poly/ML 4.1.2
SML/NJ 110.41
I put the results up on our performance page. The ASCII version is
below.
compile time
benchmark MLton0 ML-Kit Moscow-ML Poly/ML SML/NJ
barnes-hut 1.6 5.5 0.5 * 1.1
boyer 3.2 9.3 0.4 0.1 3.3
checksum 0.3 1.0 * * 0.2
count-graphs 1.0 2.0 0.1 0.1 0.7
DLXSimulator 2.5 7.3 * * *
fft 0.8 1.5 0.1 0.1 0.6
fib 0.4 0.8 0.0 0.0 0.2
hamlet 33.1 * 21.1 12.8 48.6
imp-for 0.4 1.0 0.0 0.0 0.2
knuth-bendix 1.4 4.2 0.2 0.1 1.4
lexgen 3.6 6.4 0.4 0.4 3.3
life 0.8 2.4 0.1 0.1 0.5
logic 1.9 4.8 0.2 0.1 1.4
mandelbrot 0.4 1.0 0.0 0.0 0.2
matrix-multiply 0.5 1.0 0.1 0.0 0.2
md5 0.8 1.8 * * 1.6
merge 0.4 1.1 0.0 0.0 0.2
mlyacc 16.3 37.1 3.7 1.6 14.9
model-elimination 14.4 * 2.3 2.8 24.8
mpuz 0.5 1.2 0.1 0.0 0.3
nucleic 3.7 17.6 1.1 0.3 1.5
peek 0.6 0.9 0.1 0.0 0.2
psdes-random 0.4 1.0 * * 0.2
ratio-regions 1.5 3.8 0.2 0.1 1.4
ray 2.2 3.2 0.1 0.1 0.8
raytrace 7.0 * * 0.6 4.7
simple 4.5 11.9 0.4 0.3 3.3
smith-normal-form 4.9 * * 0.1 2.1
tailfib 0.4 0.9 0.0 0.0 0.2
tak 0.4 0.9 0.0 0.0 0.2
tensor 2.0 * * * 2.1
tsp 0.9 1.9 0.1 * 0.5
tyan 2.5 5.8 0.3 0.2 1.9
vector-concat 0.4 0.9 0.0 0.0 0.2
vector-rev 0.4 0.9 0.0 0.0 0.2
vliw 8.1 27.0 1.4 1.3 12.2
wc-input1 1.0 0.9 0.0 0.0 0.2
wc-scanStream 1.0 0.9 0.1 0.0 0.2
zebra 4.3 2.6 0.1 0.1 0.6
zern 0.7 * * * 0.5
run time
benchmark MLton0 ML-Kit Moscow-ML Poly/ML SML/NJ
barnes-hut 31.1 * 387.8 * 34.6
boyer 37.3 * 291.2 71.2 97.9
checksum 46.4 417.3 * * 186.8
count-graphs 32.3 202.3 1197.7 212.7 76.2
DLXSimulator 74.1 136.2 * * *
fft 42.1 101.8 * 1796.7 39.2
fib 26.4 34.4 143.2 23.4 36.0
hamlet 36.1 * 382.1 84.4 64.8
imp-for 37.6 148.8 2353.6 381.8 210.9
knuth-bendix 31.4 * 475.0 219.3 92.7
lexgen 32.4 66.0 185.3 64.6 50.1
life 37.4 89.4 935.8 361.6 52.4
logic 40.5 * 212.5 48.0 34.0
mandelbrot 36.3 483.5 1549.4 2435.0 49.0
matrix-multiply 34.2 * 2430.9 766.6 183.3
md5 95.9 * * * 542.0
merge 57.1 * * 88.4 323.9
mlyacc 32.1 * 200.6 42.2 46.1
model-elimination 46.9 * 349.8 142.4 87.9
mpuz 24.6 92.2 1545.8 161.0 97.2
nucleic 39.0 * 480.1 877.9 16.2
peek 18.8 541.9 3176.5 535.5 390.5
psdes-random 17.9 150.2 * * 109.5
ratio-regions 31.2 98.3 1145.3 125.6 210.2
ray 16.1 * 340.1 555.1 20.6
raytrace 22.6 * * 861.7 62.1
simple 31.3 56.3 443.9 234.2 49.0
smith-normal-form 33.0 * * * >36000
tailfib 29.6 42.7 1040.6 69.3 42.0
tak 56.5 122.5 530.7 46.2 86.6
tensor 20.1 * * * 415.1
tsp 36.0 106.2 815.3 * 494.1
tyan 37.2 * 492.6 57.8 34.2
vector-concat 63.9 104.2 1033.7 106.2 601.7
vector-rev 75.0 157.7 1671.5 245.4 5655.5
vliw 31.1 55.7 267.5 60.6 40.1
wc-input1 33.5 615.5 * 562.0 333.0
wc-scanStream 30.8 555.2 * 10487.8 233.0
zebra 36.6 227.9 1000.9 239.7 287.7
zern 40.0 * * * 112.2
run time ratio
benchmark ML-Kit Moscow-ML Poly/ML SML/NJ
barnes-hut * 12.5 * 1.1
boyer * 7.8 1.9 2.6
checksum 9.0 * * 4.0
count-graphs 6.3 37.1 6.6 2.4
DLXSimulator 1.8 * * *
fft 2.4 * 42.7 0.9
fib 1.3 5.4 0.9 1.4
hamlet * 10.6 2.3 1.8
imp-for 4.0 62.7 10.2 5.6
knuth-bendix * 15.1 7.0 2.9
lexgen 2.0 5.7 2.0 1.5
life 2.4 25.0 9.7 1.4
logic * 5.2 1.2 0.8
mandelbrot 13.3 42.7 67.1 1.4
matrix-multiply * 71.2 22.4 5.4
md5 * * * 5.6
merge * * 1.5 5.7
mlyacc * 6.2 1.3 1.4
model-elimination * 7.5 3.0 1.9
mpuz 3.8 62.9 6.6 4.0
nucleic * 12.3 22.5 0.4
peek 28.9 169.3 28.5 20.8
psdes-random 8.4 * * 6.1
ratio-regions 3.1 36.6 4.0 6.7
ray * 21.1 34.5 1.3
raytrace * * 38.1 2.7
simple 1.8 14.2 7.5 1.6
smith-normal-form * * * >1090
tailfib 1.4 35.1 2.3 1.4
tak 2.2 9.4 0.8 1.5
tensor * * * 20.6
tsp 2.9 22.6 * 13.7
tyan * 13.3 1.6 0.9
vector-concat 1.6 16.2 1.7 9.4
vector-rev 2.1 22.3 3.3 75.4
vliw 1.8 8.6 2.0 1.3
wc-input1 18.4 * 16.8 10.0
wc-scanStream 18.0 * 340.1 7.6
zebra 6.2 27.4 6.6 7.9
zern * * * 2.8
size
benchmark MLton0 ML-Kit Moscow-ML Poly/ML SML/NJ
barnes-hut 103,248 171,081 94,952 * 332,792
boyer 140,287 156,737 116,301 122,880 421,856
checksum 43,567 72,413 * * 320,512
count-graphs 64,567 88,617 84,613 98,304 359,472
DLXSimulator 102,224 162,261 * * *
fft 52,747 85,689 84,094 65,536 332,808
fib 43,575 16,125 79,878 49,152 294,880
hamlet 1,227,872 * 277,168 5,316,608 1,275,080
imp-for 43,591 16,853 80,041 57,344 295,904
knuth-bendix 86,096 97,177 88,440 180,224 326,624
lexgen 172,765 215,745 104,884 188,416 396,280
life 61,951 79,253 83,390 90,112 309,216
logic 103,623 115,217 87,252 114,688 335,840
mandelbrot 43,671 77,905 81,340 57,344 300,000
matrix-multiply 44,111 96,121 82,417 57,344 326,640
md5 52,712 91,441 * * 335,888
merge 44,895 25,585 80,091 49,152 295,912
mlyacc 536,605 502,081 148,287 2,908,160 701,480
model-elimination 636,000 * 175,885 2,187,264 896,136
mpuz 47,751 75,925 82,383 81,920 308,192
nucleic 82,623 221,121 207,154 204,800 355,312
peek 51,784 60,829 81,619 57,344 303,120
psdes-random 44,615 25,617 * * 301,024
ratio-regions 62,367 98,345 87,485 73,728 337,904
ray 104,080 112,309 89,860 147,456 387,144
raytrace 277,789 * * 524,288 508,008
simple 199,499 202,561 94,397 475,136 643,104
smith-normal-form 181,612 * * 131,072 488,520
tailfib 43,303 16,285 79,939 57,344 294,880
tak 43,735 16,041 79,926 57,344 290,784
tensor 104,347 * * * 345,120
tsp 59,296 99,497 86,147 * 323,576
tyan 107,152 146,117 91,587 204,800 371,728
vector-concat 44,079 24,485 80,193 49,152 305,136
vector-rev 43,967 24,681 80,075 57,344 305,136
vliw 323,593 477,129 135,387 696,320 628,816
wc-input1 66,045 132,749 85,772 49,152 300,000
wc-scanStream 66,717 133,261 85,948 49,152 301,024
zebra 142,296 44,709 83,419 90,112 314,352
zern 50,450 * * * 339,992
-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
_______________________________________________
MLton-devel mailing list
MLton-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/mlton-devel