Skip to content

fix: retry transient streaming transport failures#531

Merged
mikehostetler merged 1 commit intomainfrom
fix/streaming-retry-transient-failures
Mar 23, 2026
Merged

fix: retry transient streaming transport failures#531
mikehostetler merged 1 commit intomainfrom
fix/streaming-retry-transient-failures

Conversation

@mikehostetler
Copy link
Contributor

Summary

  • add a dedicated streaming retry wrapper around Finch.stream/5
  • retry transient transport failures only before any response body data has been emitted
  • cover retryable, non-retryable, and partial-stream failure cases

Closes #314.

Verification

  • mix test test/req_llm/streaming/retry_test.exs test/req_llm/streaming/finch_client_test.exs test/req_llm/integration/streaming_orchestration_test.exs
  • mix test
  • mix quality

@mikehostetler mikehostetler merged commit d24b574 into main Mar 23, 2026
6 checks passed
@mikehostetler mikehostetler deleted the fix/streaming-retry-transient-failures branch March 23, 2026 01:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add retry logic for streaming connection failures

1 participant