Skip to content

Conversation

@awalker4
Copy link
Contributor

@awalker4 awalker4 commented Nov 26, 2025

AstraDB uploads vectors with their own binary format by default. This is more efficient, but it makes it hard to view and work with vectors directly in the UI. We can add a flag to turn off this encoding if you're willing to take the performance hit.

Tried adding an integration test, but vectors are also read in binary format so this doesn't verify anything. Instead, let's start a unit test suite for Astra to confirm that the option is being set.


Note

Adds binary_encode_vectors flag to AstraDBUploader to optionally disable binary-encoded vectors and adds unit tests; bumps version to 1.2.22.

  • Connectors · AstraDB:
    • Add binary_encode_vectors (default True) to AstraDBUploaderConfig.
    • In AstraDBUploader.run_data, when binary_encode_vectors=False, apply astrapy APIOptions/SerdesOptions via with_options to disable binary encoding before inserts.
  • Tests:
    • New unit tests test_astradb.py verifying with_options usage when disabled and no call by default.
  • Versioning/Docs:
    • Bump __version__ to 1.2.22.
    • Update CHANGELOG.md with the new feature.

Written by Cursor Bugbot for commit e4515c7. This will update automatically on new commits. Configure here.

AstraDB uploads vectors with their own binary format by default. This is more efficient, but it
makes it hard to view and work with vectors directly in the UI. We can add a flag to turn off this
encoding if you're willing to take the performance hit.

Tried adding an integration test, but vectors are also read in binary format so this doesn't verify
anything. Instead, let's start a unit test suite for Astra to confirm that the option is being set.
Copy link
Contributor

@potter-potter potter-potter left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

works great

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants