Loading...
  OR  Zero-K Name:    Password:   

Post edit history

[Benchmarker] Tool for benchmarking and comparing various engine and mod variants

To display differences between versions, select one or more edits in the list using checkboxes and click "diff selected"
Post edit history
Date Editor Before After
10/17/2015 2:34:49 PMMYrankAdminHistidine before revert after revert
10/17/2015 2:33:37 PMMYrankAdminHistidine before revert after revert
Before After
1 = Introduction = 1 = Introduction =
2 \n 2 \n
3 Benchmarker is a simple tool that lets you test various engine and mod variants in an easy way and compare results of benchmarks. 3 Benchmarker is a simple tool that lets you test various engine and mod variants in an easy way and compare results of benchmarks.
4 You can start it from Zero-K lobby - settings-> benchmarker or by clicking spring://@benchmark link 4 You can start it from Zero-K lobby - settings-> benchmarker or by clicking spring://@benchmark link
5 \n 5 \n
6 http://i.imgur.com/k7XbXp8.png 6 http://i.imgur.com/k7XbXp8.png
7 http://i.imgur.com/BNEZk71.png 7 http://i.imgur.com/BNEZk71.png
8 http://i.imgur.com/vrFaSGh.png 8 http://i.imgur.com/vrFaSGh.png
9 http://i.imgur.com/65Ll4Ax.png 9 http://i.imgur.com/65Ll4Ax.png
10 \n 10 \n
11 = Installing benchmarks = 11 = Installing benchmarks =
12 * svn checkout https://zero-k. googlecode. com/svn/trunk/other/Benchmarker/Benchmarks to "Benchmarks" folder - best in Spring data dir ( my games/spring on windows) , also works in current directory of benchmarker 12 * Git checkout https://github. com/ZeroK-RTS/Benchmarks to "Benchmarks" folder - best in Spring data dir ( my games/spring on windows) , also works in current directory of benchmarker
13 \n 13 \n
14 == On Linux == 14 == On Linux ==
15 * svn co http://zero-k. googlecode. com/svn/trunk/other/Benchmarker/Benchmarks ~/. spring/Benchmarks 15 * Check out to ~/. spring/Benchmarks
16 \n 16 \n
17 = Key features = 17 = Key features =
18 * automatically downloads all needed dependencies (engine, mod, deps, maps) 18 * automatically downloads all needed dependencies (engine, mod, deps, maps)
19 * lets you specify configuration for your test run, (engine, script and mod settings) 19 * lets you specify configuration for your test run, (engine, script and mod settings)
20 * automatically modifies modinfo.lua (change dependency - override mod) 20 * automatically modifies modinfo.lua (change dependency - override mod)
21 * automatically modifies startscript as needed (map override) 21 * automatically modifies startscript as needed (map override)
22 * compares results and sums them up in a neat table 22 * compares results and sums them up in a neat table
23 * auto calculates avg,min,max of repeating values 23 * auto calculates avg,min,max of repeating values
24 * allows bisecting to find faulty engine/mod 24 * allows bisecting to find faulty engine/mod
25 \n 25 \n
26 = How to modify configuration presets = 26 = How to modify configuration presets =
27 * configurations must be stored in "Configs" or "Benchmarks/Configs" folder, you can create a new subfolder there and place springsettings.cfg and various luaui files there as needed. This folder will be used as primary so it should override everything else. 27 * configurations must be stored in "Configs" or "Benchmarks/Configs" folder, you can create a new subfolder there and place springsettings.cfg and various luaui files there as needed. This folder will be used as primary so it should override everything else.
28 \n 28 \n
29 = How to create benchmark mutator = 29 = How to create benchmark mutator =
30 * create any mod or mutator in a standard way 30 * create any mod or mutator in a standard way
31 * put mutator into "Mods" or "Benchmarks/Mods" folder into "mytest.sdd" subfolder 31 * put mutator into "Mods" or "Benchmarks/Mods" folder into "mytest.sdd" subfolder
32 \n 32 \n
33 = How to create a start script = 33 = How to create a start script =
34 * create my_Script.txt and put it to "Scripts" or "Benchmarks/Scripts" folder. 34 * create my_Script.txt and put it to "Scripts" or "Benchmarks/Scripts" folder.
35 \n 35 \n
36 = How to output measured stats = 36 = How to output measured stats =
37 * echo any text in the format "!transmitlobby some name: 123" 37 * echo any text in the format "!transmitlobby some name: 123"
38 \n 38 \n
39 Example values: 39 Example values:
40 * "!transmitlobby pathing validity:0.3" 40 * "!transmitlobby pathing validity:0.3"
41 * "!transmitlobby avg. fps during nuke: 15" 41 * "!transmitlobby avg. fps during nuke: 15"
42 * "!transmitlobby max gameframe ms: 50" 42 * "!transmitlobby max gameframe ms: 50"
43 \n 43 \n
44 If same key is repeated many times - like "max gameframe ms" then the Benchmarker auto creates avg, min and max values. 44 If same key is repeated many times - like "max gameframe ms" then the Benchmarker auto creates avg, min and max values.