class Crass::Tokenizer
def preprocess(input)
Experimental RBS support (using type sampling data from the type_fusion
project).
def preprocess: (String input) -> String
This signature was generated using 1 sample from 1 application.
Preprocesses _input_ to prepare it for the tokenizer.
def preprocess(input) input = input.to_s.encode('UTF-8', :invalid => :replace, :undef => :replace) input.gsub!(/(?:\r\n|[\r\f])/, "\n") input.gsub!("\u0000", "\ufffd") input end