Skip to content

Conversation

@SharkyKZ
Copy link

@SharkyKZ SharkyKZ commented Nov 1, 2025

It's defined as int8 here but the code checked against 8bit leading to Unknown quantization type: int8 error.

choices=["bf16", "int8", "nf4"],

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant