Skip to content

Add proper token update to the db, in case generating a inference response fails #316

@jorgeantonio21

Description

@jorgeantonio21

Right now, we overestimate the number of tokens to be processed in the atoma state db, but if a response fails to be generated, we don't re-update the database to set it to 0.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions