It's all about trade-offs. If you expect the need for troubleshooting your scripts then using the tokenizer might not be a good option. As Newton already discovered: "For every convenience there's also an inconvenience".
_________________________
There are two types of vessels, submarines and targets.