Generalize CIF benchmark script settings
Currently, we have:
list string varying_settings = [
""
];
string disable_settings_to_vary = "";
list string extra_settings = [
""
];
We make a product of the first and third one, with the 2nd one always prepended to it.
I propose to generalize this to:
list list settings_to_combine;
Then we allow for instance:
list list string settings_to_combine = [
["--adv-var-order=\""],
["model", "sorted"],
[" -> dcsh -> force -> slidwin", " -> force -> slidwin"],
["\""],
];
Which results in:
["--adv-var-order=\"model -> dcsh -> force -> slidwin",
"--adv-var-order=\"model -> force -> slidwin",
"--adv-var-order=\"sorted -> dcsh -> force -> slidwin",
"--adv-var-order=\"sorted -> force -> slidwin"]
This is much more flexible than what we have now.
Edited by Dennis Hendriks