Function tokenize_source 

pub fn tokenize_source(source: &Source, language: Language) -> Result<Tokens>

tokenize over an already encoded source.

Errors

See tokenize.