Search
11 repos matching “tokenizer” in the repository name, GitHub topics or description.
| Repository | Lines of Mojo | Files | Commits | Age | Created | Mojo version | Tooling | Stars |
|---|---|---|---|---|---|---|---|---|
| oliveagle/tokenizers_mojo | 50,269 | 92 | 40 | 59 days | 2026-09-09 | ~1.0 | pixi | 0 |
| olaflaitinen/knap | 17,421 | 55 | 75 | 2 months | 2026-09-07 | 1.0.0 | pixi | 4 |
| mikeleppane/llm.mojo | 25,299 | 135 | 24 | 4 months | 2026-07-09 | 1.0.0 | pixi | 1 |
| ratulb/mbpe | 6,251 | 20 | 191 | 3 months | 2026-07-26 | 1.2.0 | pixi | 9 |
| lee101/mojo-libyaml | 3,634 | 4 | 1 | 34 days | 2026-10-04 | 1.2.0.dev2026092905 | pixi | 0 |
| mempirate/mojobag | 1,114 | 8 | 23 | 2 months | 2026-08-30 | 1.0.0 | pixi | 0 |
| ratulb/simple_bpe | 529 | 2 | 11 | 3 months | 2026-07-23 | 1.1.0 | pixi | 0 |
| lee101/mojo-spacy | 514 | 1 | 6 | 3 months | 2026-07-29 | 1.2.0.dev2026092605 | pixi | 0 |
| lee101/mojo-muparser | 456 | 1 | 5 | 3 months | 2026-07-29 | 1.2.0.dev2026092605 | pixi | 0 |
| lee101/mojo-markdown-it-py | 374 | 1 | 6 | 3 months | 2026-07-30 | 1.2.0.dev2026092605 | pixi | 0 |
| lee101/mojo-html5lib | 354 | 1 | 6 | 3 months | 2026-07-30 | 1.2.0.dev2026092605 | pixi | 0 |