A high-throughput and memory-efficient inference and serving engine for LLMs
Published
May 3, 2026
83d ago
Package Registry
README badge Customize →
License Sources
Apache-2.0 detected from the LICENSE file in the package source as of May 3, 2026.
| Source | License | Class |
|---|---|---|
Licensie (detected) | Apache-2.0 | Permissive |
PyPI (reported) | Not reported | - |
No license was reported in the package metadata for this version.
Loading dependencies…
License File
Added Removed Expected
Versions
15 versions| Version | License | Published | Status |
|---|---|---|---|
| 0.25.0 Latest | Apache-2.0 | Jul 11, 2026 | Scanned |
| 0.24.0 | Apache-2.0 | Jun 30, 2026 | Scanned |
| 0.22.1 | Apache-2.0 | Jun 5, 2026 | Scanned |
| 0.22.0 | Apache-2.0 | May 29, 2026 | Scanned |
| 0.21.0 | Apache-2.0 | May 15, 2026 | Scanned |
| 0.20.2 | Apache-2.0 | May 10, 2026 | Scanned |
| 0.20.1 Viewing | Apache-2.0 | May 3, 2026 | Scanned |
| 0.20.0 | Apache-2.0 | Apr 27, 2026 | Scanned |
| 0.19.1 | Apache-2.0 | Apr 18, 2026 | Scanned |
| 0.19.0 | Apache-2.0 | Apr 3, 2026 | Scanned |
| 0.18.1 | Apache-2.0 | Mar 31, 2026 | Scanned |
| 0.18.0 | Apache-2.0 | Mar 20, 2026 | Scanned |
| 0.17.1 | Apache-2.0 | Mar 11, 2026 | Scanned |
| 0.17.0 | Apache-2.0 | Mar 7, 2026 | Scanned |
| 0.16.0 | Apache-2.0 | Feb 26, 2026 | Scanned |