Quote:

I have run some experiments to see if the var names are tokenized or not. I thought they too would have been tokenized to really optimize the code but if I use longer var names, the tokenized file is larger. I think var names should also be converted to tokens for best performance.



Variable names must be maintained.

Consider two scenarios where tokenising the variable name will fail:
  1. When calling an external script.
    Variables which are shared between the scripts are unlikely to have the same "tokenised" names so data cannot be passed. Worse, unrelated variables are likely to have the same tokenised names, so will be passed/overwritten accidentally.
  2. Executed code.
    Consider this somewhat contrived example:
    Code:
    $foo="bar"
    $bar="test"
    $=Execute('"The value of $$$$'+$foo+' is "+$$'+$foo+' ?')

    This will never work if the variable names are tokenised.