3 commits

Author	SHA1	Message	Date
sam	1e53aa467e	rename for clarity and remove old function declaration	2024-07-22 16:29:47 +12:00
sam	bee9e6fc9d	optimize tokenizer by moving data ptr	2024-07-22 15:46:25 +12:00
sam	21f61cdf76	first commit	2024-07-21 02:04:32 +12:00