class Syntax::Tokenizer

of the tokenization process. This method may extract multiple tokens.
Subclasses must implement this method, which is called for each iteration

def step
  raise NotImplementedError, "subclasses must implement #step"
end