tokenizer

3.6.3 Not latest — view latest

A fast, compact pure-Python tokenizer for Icelandic text with sentence segmentation

License Sources

MIT detected from the LICENSE file in the package source as of July 9, 2026.

SourceLicenseClass
Licensie (detected)
MITPermissive
PyPI (reported)
Not reported-

No license was reported in the package metadata for this version.

Loading dependencies…
License File
Added Removed Expected
Versions
2 versions
VersionLicensePublishedStatus
3.6.4 Latest MITJul 10, 2026 Scanned
3.6.3 ViewingMITJul 9, 2026 Scanned