Skip to content

Replace base2048 with mikeshardmind-base2048 and add spec tests#1518

Merged
jmartin-tech merged 1 commit intoNVIDIA:mainfrom
onceandtwice:housekeeping/lighter-base-2048
Apr 7, 2026
Merged

Replace base2048 with mikeshardmind-base2048 and add spec tests#1518
jmartin-tech merged 1 commit intoNVIDIA:mainfrom
onceandtwice:housekeeping/lighter-base-2048

Conversation

@onceandtwice
Copy link
Copy Markdown
Contributor

Replace the current Rust-based base2048 dependency with a Python alternative (mikeshardmind-base2048) to drop the Cargo/Rust requirement while also keeping functionality identical. Comprehensive Base2048 tests with reference vectors generated from the original Rust package to prove encoding/decoding compatibility and probe integration have also been added.

The following have been changed:
Dependencies: base2048 → mikeshardmind-base2048>=1.0.2 in pyproject.toml and requirements.txt.
Tests: tests/probes/test_base2048.py covers encoding/decoding parity with the original Base2048 outputs (reference vectors), roundtrip for all bytes/lengths, realistic payloads (ASCII/Unicode), API contract, pure-Python check, and InjectBase2048 probe integration. Includes a Docker command to regenerate the reference vectors used in comparison.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Dec 8, 2025

DCO Assistant Lite bot All contributors have signed the DCO ✍️ ✅

@onceandtwice onceandtwice force-pushed the housekeeping/lighter-base-2048 branch from caadf9a to 795a5d9 Compare December 8, 2025 05:19
@onceandtwice
Copy link
Copy Markdown
Contributor Author

I have read the DCO Document and I hereby sign the DCO

@onceandtwice
Copy link
Copy Markdown
Contributor Author

recheck

github-actions bot added a commit that referenced this pull request Dec 8, 2025
@leondz
Copy link
Copy Markdown
Collaborator

leondz commented Dec 8, 2025

Thank you - will review and validate

@erickgalinkin
Copy link
Copy Markdown
Collaborator

Minor, but we should verify license compatibility: https://github.com/mikeshardmind/python-base2048/blob/main/LICENSE

Copy link
Copy Markdown
Collaborator

@jmartin-tech jmartin-tech left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks reasonable, it may take a bit to land as the license for this dependency while very permissive needs some sign off by the org to officially accept.

@leondz leondz self-requested a review January 12, 2026 08:17
@leondz leondz added the probes Content & activity of LLM probes label Jan 15, 2026
@jmartin-tech
Copy link
Copy Markdown
Collaborator

Fixes #1516

Linking to issue for visibility.

@jmartin-tech jmartin-tech merged commit 3ac1399 into NVIDIA:main Apr 7, 2026
16 of 17 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Apr 7, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

probes Content & activity of LLM probes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants