4 Commits

Author SHA1 Message Date
e93b797dc6 Added token tests 2024-06-06 21:35:14 +02:00
42a212a3f4 Improved file structure 2024-06-05 15:51:05 +02:00
c4b28fb66e Improved tokenizer 2023-10-31 21:13:14 +01:00
ac157e580c Added a tokenizer 2023-10-31 11:57:37 +01:00