feat(elevenlabs): add speech-to-text transcription support #5171
+2,892
−2
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Implements Spring AI TranscriptionModel interface for ElevenLabs Speech-to-Text API,
providing audio transcription with support for multiple languages, speaker diarization,
word-level timestamps, and advanced transcription features.
Implementation:
- ElevenLabsAudioTranscriptionModel: Main model implementing TranscriptionModel
- ElevenLabsAudioTranscriptionOptions: Configuration with 15 transcription parameters
- ElevenLabsSpeechToTextApi: Low-level API client for ElevenLabs STT endpoints
- ElevenLabsAudioTranscriptionMetadata: Rich metadata including language detection and word timing
Key Features:
- Full TranscriptionModel interface compliance
- Speaker diarization with configurable speaker count
- Word-level timestamps and audio event tagging
- Async transcription support via webhook integration
- Language detection with confidence scores
- Builder pattern for model and options construction
- Comprehensive error handling with retry support
Design Decisions:
- Uses transcribe(Resource) convenience method from interface (not call(Resource))
- Result-level metadata for transcription-specific information
- Defensive copying for immutability (List.copyOf, HashMap copy)
- Proper null handling: returns empty AudioTranscription("") instead of null
Testing:
- 15 unit tests with MockRestServiceServer
- 4 integration tests against live API
- Tests cover basic transcription, options, diarization, and convenience methods
Documentation:
- Comprehensive Antora reference documentation
- Module README with TTS and STT capabilities
- Alignment report documenting design decisions vs OpenAI/Azure implementations
All tests passing (26 integration tests total across module).
Signed-off-by: Alexandros Pappas <apappascs@gmail.com>
apappascs
force-pushed
the
feature/elevenlabs-speech-to-text
branch
from
9d30cf5 to
4f951dd
Compare
Contributor
Author
|
cc @markpollack |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Implements Spring AI TranscriptionModel interface for ElevenLabs Speech-to-Text API, providing audio transcription with support for multiple languages, speaker diarization, word-level timestamps, and advanced transcription features.
Implementation:
Thank you for taking time to contribute this pull request!
You might have already read the contributor guide, but as a reminder, please make sure to:
git commit -s) per the DCOmainbranch and squash your commitsFor more details, please check the contributor guide.
Thank you upfront!