Benchmark Results for <I>paraffins.sa</I>

Benchmark Results for paraffins.sa

(For questions about these benchmarks send eMail to Claudio Fleiner)

Salishan Paraffins Problem (paraffins.sa): Given an integer n, output the chemical structure of all paraffin molecules for i<=n, without repetition and in order of increasing size. Include all isomers, but no dupicates. The chemical formula for paraffin molecules is C(i)H(2i+2). Any representation for the molecules could be chosen, as long as it clearly distinguishes among isomers. For this benchmark we used n=18.

Table of Contents

General Results:

# [#] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE *sec. *% of
std
KB Shorter
in %
sec. % of
std
KB % of
std
1. Standard Compiler with no options 11.70100.0%900.0%7.85100.0%4990.46100.0%
2. [28] 6.6056.4%6923.8%8.91113.5%6290.64126.1%
3. [20] 6.6056.4%6923.8%8.84112.6%5079.04101.8%
4. [29] 6.6056.4%6923.8%8.91113.5%6311.94126.5%
5. [21] 6.6056.4%6923.8%8.63109.9%6406.14128.4%
6. [23] 6.7057.3%6923.7%9.46120.5%6267.47125.6%
7. [31]6.7057.3%6923.7%9.44120.3%6223.46124.7%
8. [30] 6.7057.3%6923.7%9.49120.9%6471.68129.7%
9. [22] 6.7057.3%6923.7%9.26118.0%6272.73125.7%
10. [19] 7.0059.8%7022.9%9.91126.2%6278.49125.8%
11. [27] 7.0059.8%7022.9%9.96126.9%6275.07125.7%
12. [17] 7.0059.8%6923.1%8.79112.0%5079.04101.8%
13. [18] 7.0059.8%7022.9%9.62122.5%6380.40127.9%
14. [24] 7.1060.7%6923.1%8.85112.7%6410.24128.4%
15. [26] 7.1060.7%7022.9%9.87125.7%6251.32125.3%
16. [25] 7.1060.7%6923.1%8.87113.0%6288.53126.0%
17. [16] 7.1060.7%6923.1%8.78111.8%6340.61127.1%
18. [13] 7.4063.2%7022.0%8.24105.0%4996.61100.1%
19. [06] 7.4063.2%7022.0%8.70110.8%6162.43123.5%
20. [14] 7.4063.2%7022.0%8.68110.6%6336.51127.0%
21. [12] 7.4063.2%7022.0%8.26105.2%5043.35101.1%
22. [01] 7.5064.1%7121.6%8.22104.7%4984.8399.9%
23. [09] 7.5064.1%7121.6%8.26105.2%5009.41100.4%
24. [10] 7.5064.1%7121.6%8.81112.2%6075.05121.7%
25. [05] 7.5064.1%7022.0%8.22104.7%5062.07101.4%
26. [07] 7.5064.1%7022.0%8.71111.0%6336.51127.0%
27. [02] 7.5064.1%7121.6%8.79112.0%6247.77125.2%
28. [11] 7.5064.1%7121.6%8.79112.0%6344.70127.1%
29. [04] 7.5064.1%7022.0%8.19104.3%4990.29100.0%
30. [03] 7.5064.1%7121.6%8.84112.6%6320.13126.6%
31. [00] 7.5064.1%7121.6%8.50108.3%4894.7298.1%
32. [08] 7.6065.0%7121.6%8.26105.2%4997.12100.1%
33. [15] 7.6065.0%7022.0%8.66110.3%6336.51127.0%

Impact of the option "Inlining":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [04/20] 0.9012.00%12.24%0.657.94%-88746-1.78%
2. [05/21] 0.9012.00%12.24%0.414.99%-1344073-26.55%
3. [15/31]0.9011.84%12.23%0.789.01%1130491.78%
4. [12/28] 0.8010.81%12.24%0.657.87%-1247290-24.73%
5. [13/29] 0.8010.81%12.24%0.678.13%-1315328-26.32%
6. [07/23] 0.8010.67%12.23%0.758.61%690461.09%
7. [06/22] 0.709.46%12.23%0.566.44%-110299-1.79%
8. [14/30] 0.709.46%12.23%0.819.33%-135168-2.13%
9. [03/19] 0.506.67%11.72%1.0712.10%416420.66%
10. [11/27] 0.506.67%11.72%1.1713.31%696321.10%
11. [02/18] 0.506.67%11.72%0.839.44%-132632-2.12%
12. [01/17] 0.506.67%11.83%0.576.93%-94208-1.89%
13. [08/24] 0.506.58%11.83%0.597.14%-1413120-28.28%
14. [09/25] 0.405.33%11.83%0.617.38%-1279122-25.53%
15. [10/26] 0.405.33%11.72%1.0612.03%-176264-2.90%
16. [00/16] 0.405.33%11.83%0.283.29%-1445888-29.54%

Impact of the option "Moving while! and until!":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [04/12] 0.101.33%00.00%0.070.85%-53052-1.06%
2. [05/13] 0.101.33%00.00%0.020.24%654621.29%
3. [23/31]0.000.00%00.00%-0.02-0.21%440020.70%
4. [19/27] 0.000.00%00.00%0.050.50%34130.05%
5. [21/29] 0.000.00%00.00%0.283.24%942081.47%
6. [03/11] 0.000.00%00.00%-0.05-0.57%-24576-0.39%
7. [01/09] 0.000.00%00.00%0.040.49%-24576-0.49%
8. [02/10] 0.000.00%00.00%0.020.23%1727142.76%
9. [22/30] 0.000.00%00.00%0.232.48%-198948-3.17%
10. [06/14] 0.000.00%00.00%-0.02-0.23%-174080-2.82%
11. [16/24] 0.000.00%00.00%0.070.80%-69632-1.10%
12. [20/28] 0.000.00%00.00%0.070.79%-1211596-23.85%
13. [07/15] -0.10-1.33%00.00%-0.05-0.57%00.00%
14. [00/08] -0.10-1.33%00.00%-0.24-2.82%-102400-2.09%
15. [18/26] -0.10-1.43%00.00%0.252.60%1290822.02%
16. [17/25] -0.10-1.43%00.00%0.080.91%-1209490-23.81%

Impact of the option "Hoisting Iter Initialization":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [24/28] 0.507.04%00.91%0.060.68%1196031.87%
2. [25/29] 0.507.04%00.91%0.040.45%-23405-0.37%
3. [16/20] 0.507.04%00.91%0.060.68%126156819.90%
4. [17/21] 0.405.71%00.91%-0.16-1.82%-1327104-26.13%
5. [26/30] 0.405.63%01.05%-0.38-3.85%-220364-3.53%
6. [27/31]0.304.29%01.05%-0.52-5.22%516090.82%
7. [18/22] 0.304.29%01.05%-0.36-3.74%1076661.69%
8. [19/23] 0.304.29%01.05%-0.45-4.54%110200.18%
9. [08/12] 0.202.63%00.49%0.000.00%-46226-0.93%
10. [02/06] 0.101.33%00.53%-0.09-1.02%853331.37%
11. [10/14] 0.101.33%00.53%-0.13-1.48%-261461-4.30%
12. [09/13] 0.101.33%00.49%-0.02-0.24%128000.26%
13. [01/05] 0.000.00%00.49%0.000.00%-77238-1.55%
14. [03/07] 0.000.00%00.53%-0.13-1.47%-16384-0.26%
15. [00/04] 0.000.00%00.49%-0.31-3.65%-95573-1.95%
16. [11/15] -0.10-1.33%00.53%-0.13-1.48%81920.13%

Impact of the option "Hoisting Loop Invariants":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [16/18] 0.101.41%0-0.16%0.849.57%-39789-0.63%
2. [25/27] 0.101.41%0-0.16%1.0912.29%134580.21%
3. [04/06] 0.101.33%0-0.01%0.516.23%-1172138-23.49%
4. [08/10] 0.101.32%0-0.04%0.556.66%-1077930-21.57%
5. [05/07] 0.000.00%0-0.01%0.495.96%-1274441-25.18%
6. [09/11] 0.000.00%0-0.04%0.536.42%-1335296-26.66%
7. [17/19] 0.000.00%0-0.16%1.1212.74%-1199445-23.62%
8. [01/03] 0.000.00%0-0.04%0.627.54%-1335296-26.79%
9. [12/14] 0.000.00%0-0.01%0.425.08%-1293165-25.64%
10. [24/26] 0.000.00%0-0.16%1.0211.53%1589242.48%
11. [00/02] 0.000.00%0-0.04%0.293.41%-1353045-27.64%
12. [21/23] -0.10-1.52%0-0.02%0.839.62%1386782.16%
13. [28/30] -0.10-1.52%0-0.02%0.586.51%-181043-2.88%
14. [20/22] -0.10-1.52%0-0.02%0.424.75%-1193691-23.50%
15. [29/31]-0.10-1.52%0-0.02%0.535.95%884731.40%
16. [13/15] -0.20-2.70%0-0.01%0.425.10%-1339904-26.82%

Impact of the option "Common Subexpression Elimination":

# [# / #] Compiler Options *Best Run* Size of Executable Compile Time Memory Usage
Inline Move
while!
Once
Args.
Hoist
Invar.
CSE Faster
in sec.
*Faster
in % *
Shorter
in KB
Shorter
in %
Slower
in sec.
Slower
in %
change
in KB
change
in %
1. [16/17] 0.101.41%00.00%0.010.11%126156819.90%
2. [26/27] 0.101.41%00.00%0.090.91%-23756-0.38%
3. [08/09] 0.101.32%00.00%0.000.00%-12288-0.25%
4. [22/23] 0.000.00%00.00%0.202.16%52660.08%
5. [30/31]0.000.00%00.00%-0.05-0.53%2482173.84%
6. [10/11] 0.000.00%00.00%-0.02-0.23%-269653-4.44%
7. [18/19] 0.000.00%00.00%0.293.01%1019121.60%
8. [02/03] 0.000.00%00.00%0.050.57%-72362-1.16%
9. [28/29] 0.000.00%00.00%0.000.00%-21299-0.34%
10. [12/13] 0.000.00%00.00%-0.02-0.24%467380.93%
11. [20/21] 0.000.00%00.00%-0.21-2.38%-1327104-26.13%
12. [04/05] 0.000.00%00.00%0.030.37%-71777-1.44%
13. [24/25] 0.000.00%00.00%0.020.23%1217091.90%
14. [00/01] 0.000.00%00.00%-0.28-3.29%-90112-1.84%
15. [06/07] -0.10-1.35%00.00%0.010.11%-174080-2.82%
16. [14/15] -0.20-2.70%00.00%-0.02-0.23%00.00%