Benchmark Results for <I>hello.sa </I>

Benchmark Results for hello.sa

(For questions about these benchmarks send eMail to Claudio Fleiner)

The source code for this very complicated program is available in hello.sa.

Table of Contents

General Results:

# [#] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE *sec. *% of
std
KB Shorter
in %
sec. % of
std
KB % of
std
1. Standard Compiler with no options 0.10100.0%590.0%5.90100.0%3895.30100.0%
2. [31]0.000.0%564.4%5.91100.2%3895.30100.0%
3. [15] 0.000.0%573.8%5.96101.0%3096.5879.5%
4. [23] 0.000.0%564.4%5.95100.8%3950.59101.4%
5. [07] 0.000.0%573.8%5.97101.2%3629.8893.2%
6. [27] 0.000.0%564.4%5.95100.8%3919.87100.6%
7. [11] 0.000.0%573.8%5.96101.0%3233.7983.0%
8. [19] 0.000.0%564.4%5.96101.0%3941.72101.2%
9. [03] 0.000.0%573.8%5.94100.7%3911.68100.4%
10. [30] 0.000.0%564.4%5.98101.4%3950.59101.4%
11. [13] 0.000.0%573.8%5.97101.2%3233.7983.0%
12. [21] 0.000.0%564.4%5.95100.8%3956.74101.6%
13. [05] 0.000.0%573.8%5.93100.5%3893.93100.0%
14. [25] 0.000.0%564.4%5.96101.0%3919.87100.6%
15. [09] 0.000.0%573.8%5.94100.7%3911.68100.4%
16. [26] 0.000.0%564.4%5.95100.8%3944.45101.3%
17. [01] 0.000.0%573.8%5.91100.2%3891.2099.9%
18. [02] 0.000.0%573.8%5.93100.5%3867.9999.3%
19. [14] 0.000.0%573.8%5.94100.7%3960.15101.7%
20. [22] 0.000.0%564.4%5.95100.8%3949.36101.4%
21. [28] 0.000.0%564.4%5.97101.2%3950.59101.4%
22. [20] 0.000.0%564.4%5.93100.5%3769.6996.8%
23. [10] 0.000.0%573.8%5.91100.2%3911.68100.4%
24. [18] 0.000.0%564.4%5.93100.5%3911.68100.4%
25. [04] 0.000.0%573.8%5.91100.2%3895.30100.0%
26. [24] 0.000.0%564.4%5.93100.5%3911.68100.4%
27. [12] 0.000.0%573.8%5.93100.5%3911.68100.4%
28. [08] 0.000.0%573.8%5.92100.3%3870.7299.4%
29. [00] 0.000.0%573.8%5.8999.8%3895.30100.0%
30. [16] 0.000.0%564.4%5.92100.3%3870.7299.4%
31. [06] 0.10100.0%573.8%5.93100.5%3911.68100.4%
32. [29] 0.10100.0%564.4%5.95100.8%3944.45101.3%
33. [17] 0.10100.0%564.4%5.94100.7%3911.68100.4%

Impact of the option "Inlining":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [06/22] 0.10100.00%00.62%0.020.34%-37683-0.96%
2. [15/31]0.000.00%00.62%-0.05-0.84%-798720-25.79%
3. [07/23] 0.000.00%00.62%-0.02-0.34%-320716-8.84%
4. [11/27] 0.000.00%00.62%-0.01-0.17%-686080-21.22%
5. [03/19] 0.000.00%00.62%0.020.34%-30037-0.77%
6. [05/21] 0.000.00%00.62%0.020.34%-62805-1.61%
7. [09/25] 0.000.00%00.62%0.020.34%-8192-0.21%
8. [01/17] -0.100.00%00.62%0.030.51%-20480-0.53%
9. [13/29] -0.100.00%00.62%-0.02-0.34%-710656-21.98%
10. [14/30] 0.000.00%00.62%0.040.67%95570.24%
11. [10/26] 0.000.00%00.62%0.040.68%-32768-0.84%
12. [02/18] 0.000.00%00.62%0.000.00%-43690-1.13%
13. [12/28] 0.000.00%00.62%0.040.67%-38912-0.99%
14. [04/20] 0.000.00%00.62%0.020.34%1256103.22%
15. [08/24] 0.000.00%00.62%0.010.17%-40960-1.06%
16. [00/16] 0.000.00%00.62%0.030.51%245760.63%

Impact of the option "Moving while! and until!":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [17/25] 0.10100.00%00.00%0.020.34%-8192-0.21%
2. [06/14] 0.10100.00%00.00%0.010.17%-48469-1.24%
3. [23/31]0.000.00%00.00%-0.04-0.67%552961.40%
4. [07/15] 0.000.00%00.00%-0.01-0.17%53329914.69%
5. [19/27] 0.000.00%00.00%-0.01-0.17%218450.55%
6. [03/11] 0.000.00%00.00%0.020.34%67788817.33%
7. [21/29] -0.100.00%00.00%0.000.00%122880.31%
8. [05/13] 0.000.00%00.00%0.040.67%66013816.95%
9. [01/09] 0.000.00%00.00%0.030.51%-20480-0.53%
10. [22/30] 0.000.00%00.00%0.030.50%-1228-0.03%
11. [18/26] 0.000.00%00.00%0.020.34%-32768-0.84%
12. [02/10] 0.000.00%00.00%-0.02-0.34%-43690-1.13%
13. [20/28] 0.000.00%00.00%0.040.67%-180906-4.80%
14. [04/12] 0.000.00%00.00%0.020.34%-16384-0.42%
15. [16/24] 0.000.00%00.00%0.010.17%-40960-1.06%
16. [00/08] 0.000.00%00.00%0.030.51%245760.63%

Impact of the option "Hoisting Iter Initialization":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [17/21] 0.10100.00%00.00%0.010.17%-45056-1.15%
2. [27/31]0.000.00%00.00%-0.04-0.67%245760.63%
3. [11/15] 0.000.00%00.00%0.000.00%1372164.24%
4. [19/23] 0.000.00%00.00%-0.01-0.17%-8874-0.23%
5. [03/07] 0.000.00%00.00%0.030.51%2818047.20%
6. [25/29] -0.100.00%00.00%-0.01-0.17%-24576-0.63%
7. [09/13] 0.000.00%00.00%0.030.51%67788817.33%
8. [01/05] 0.000.00%00.00%0.020.34%-2730-0.07%
9. [26/30] 0.000.00%00.00%0.030.50%-6144-0.16%
10. [10/14] 0.000.00%00.00%0.030.51%-48469-1.24%
11. [18/22] 0.000.00%00.00%0.020.34%-37683-0.96%
12. [02/06] -0.100.00%00.00%0.000.00%-43690-1.13%
13. [24/28] 0.000.00%00.00%0.040.67%-38912-0.99%
14. [08/12] 0.000.00%00.00%0.010.17%-40960-1.06%
15. [16/20] 0.000.00%00.00%0.010.17%1010342.61%
16. [00/04] 0.000.00%00.00%0.020.34%00.00%

Impact of the option "Hoisting Loop Invariants":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [29/31]0.10100.00%00.00%-0.04-0.67%491521.25%
2. [17/19] 0.10100.00%00.00%0.020.34%-30037-0.77%
3. [13/15] 0.000.00%00.00%-0.01-0.17%1372164.24%
4. [21/23] 0.000.00%00.00%0.000.00%61440.16%
5. [05/07] 0.000.00%00.00%0.040.67%2640556.78%
6. [25/27] 0.000.00%00.00%-0.01-0.17%00.00%
7. [09/11] 0.000.00%00.00%0.020.34%67788817.33%
8. [01/03] 0.000.00%00.00%0.030.51%-20480-0.53%
9. [28/30] 0.000.00%00.00%0.010.17%00.00%
10. [12/14] 0.000.00%00.00%0.010.17%-48469-1.24%
11. [20/22] 0.000.00%00.00%0.020.34%-179677-4.77%
12. [04/06] -0.100.00%00.00%0.020.34%-16384-0.42%
13. [24/26] 0.000.00%00.00%0.020.34%-32768-0.84%
14. [08/10] 0.000.00%00.00%-0.01-0.17%-40960-1.06%
15. [16/18] 0.000.00%00.00%0.010.17%-40960-1.06%
16. [00/02] 0.000.00%00.00%0.040.68%273060.70%

Impact of the option "Common Subexpression Elimination":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [06/07] 0.10100.00%00.00%0.040.67%2818047.20%
2. [14/15] 0.000.00%00.00%0.020.34%86357321.81%
3. [22/23] 0.000.00%00.00%0.000.00%-1228-0.03%
4. [30/31]0.000.00%00.00%-0.07-1.17%552961.40%
5. [26/27] 0.000.00%00.00%0.000.00%245760.62%
6. [10/11] 0.000.00%00.00%0.050.85%67788817.33%
7. [18/19] 0.000.00%00.00%0.030.51%-30037-0.77%
8. [02/03] 0.000.00%00.00%0.010.17%-43690-1.13%
9. [28/29] -0.100.00%00.00%-0.02-0.34%61440.16%
10. [12/13] 0.000.00%00.00%0.040.67%67788817.33%
11. [20/21] 0.000.00%00.00%0.020.34%-187050-4.96%
12. [04/05] 0.000.00%00.00%0.020.34%13650.04%
13. [24/25] 0.000.00%00.00%0.030.51%-8192-0.21%
14. [08/09] 0.000.00%00.00%0.020.34%-40960-1.06%
15. [16/17] -0.100.00%00.00%0.020.34%-40960-1.06%
16. [00/01] 0.000.00%00.00%0.020.34%40960.11%