Write several snippets of code for exemplifying different techniques of tokenizing a file content.