tokenizer

3.6.4

A fast, compact pure-Python tokenizer for Icelandic text with sentence segmentation

License

A short and simple permissive license with conditions only requiring preservation of copyright and license notices. Licensed works, modifications, and larger works may be distributed under different terms and without source code.

Published

July 10, 2026

45d ago

Package Registry

PyPI Source Homepage

README badge Customize →

License Sources

MIT detected from the LICENSE file in the package source as of July 10, 2026.

Source	License	Class
Licensie (detected)	MIT	Permissive
PyPI (reported)	Not reported	-

No license was reported in the package metadata for this version.

Loading dependencies…

License File

Added Removed Expected

Versions

2 versions

Version	License	Published	Status
3.6.4 Latest Viewing	MIT	Jul 10, 2026	Scanned
3.6.3	MIT	Jul 9, 2026	Scanned