Skip to content

Commit c449fea

Browse files
sam-goldmansam-goldman
committed
fix: Update models to include whether they support streaming, and add validation to check whether a model supports streaming
1 parent 5bc2508 commit c449fea

File tree

16 files changed

+252
-140
lines changed

16 files changed

+252
-140
lines changed

‎.changeset/short-seahorses-fix.md‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
'token.js': patch
3+
---
4+
5+
Update models to include whether they support streaming, and add validation to check whether a model supports streaming

‎docs/providers/ai21.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ main()
4040

4141
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4242
| -------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
43-
| jamba-instruct | ✅ | ➖ | ➖ | ➖ | ➖ | ✅ |
43+
| jamba-instruct | ✅ | ✅ | ➖ | ➖ | ➖ | ✅ |
4444

4545
### Legend
4646
| Symbol | Description |

‎docs/providers/anthropic.md‎

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -40,13 +40,13 @@ main()
4040

4141
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4242
| -------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
43-
| claude-3-5-sonnet-20240620 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
44-
| claude-3-opus-20240229 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
45-
| claude-3-sonnet-20240229 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
46-
| claude-3-haiku-20240307 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
47-
| claude-2.1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
48-
| claude-2.0 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
49-
| claude-instant-1.2 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
43+
| claude-3-5-sonnet-20240620 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
44+
| claude-3-opus-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
45+
| claude-3-sonnet-20240229 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
46+
| claude-3-haiku-20240307 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
47+
| claude-2.1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
48+
| claude-2.0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
49+
| claude-instant-1.2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
5050

5151
### Legend
5252
| Symbol | Description |

‎docs/providers/bedrock.md‎

Lines changed: 19 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -42,25 +42,25 @@ main()
4242

4343
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4444
| --------------------------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
45-
| amazon.titan-text-lite-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
46-
| amazon.titan-text-express-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
47-
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
48-
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
49-
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ➖ | ➖ | ✅ | ✅ | ➖ |
50-
| anthropic.claude-v2:1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
51-
| anthropic.claude-v2 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
52-
| anthropic.claude-instant-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
53-
| cohere.command-r-plus-v1:0 | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
54-
| cohere.command-r-v1:0 | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
55-
| cohere.command-text-v14 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
56-
| cohere.command-light-text-v14 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
57-
| meta.llama3-8b-instruct-v1:0 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
58-
| meta.llama3-70b-instruct-v1:0 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
59-
| meta.llama2-13b-chat-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
60-
| meta.llama2-70b-chat-v1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
61-
| mistral.mistral-7b-instruct-v0:2 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
62-
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
63-
| mistral.mistral-large-2402-v1:0 | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
45+
| amazon.titan-text-lite-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46+
| amazon.titan-text-express-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
47+
| anthropic.claude-3-opus-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
48+
| anthropic.claude-3-sonnet-20240229-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
49+
| anthropic.claude-3-haiku-20240307-v1:0 | ✅ | ✅ | ➖ | ✅ | ✅ | ➖ |
50+
| anthropic.claude-v2:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
51+
| anthropic.claude-v2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
52+
| anthropic.claude-instant-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
53+
| cohere.command-r-plus-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
54+
| cohere.command-r-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
55+
| cohere.command-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
56+
| cohere.command-light-text-v14 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
57+
| meta.llama3-8b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
58+
| meta.llama3-70b-instruct-v1:0 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
59+
| meta.llama2-13b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
60+
| meta.llama2-70b-chat-v1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
61+
| mistral.mistral-7b-instruct-v0:2 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
62+
| mistral.mixtral-8x7b-instruct-v0:1 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
63+
| mistral.mistral-large-2402-v1:0 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
6464

6565
### Legend
6666
| Symbol | Description |

‎docs/providers/cohere.md‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -40,12 +40,12 @@ main()
4040

4141
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4242
| --------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
43-
| command-r-plus | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
44-
| command-r | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
45-
| command | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
46-
| command-nightly | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
47-
| command-light | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
48-
| command-light-nightly | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
43+
| command-r-plus | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
44+
| command-r | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
45+
| command | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46+
| command-nightly | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
47+
| command-light | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
48+
| command-light-nightly | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
4949

5050
### Legend
5151
| Symbol | Description |

‎docs/providers/gemini.md‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -40,9 +40,9 @@ main()
4040

4141
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4242
| ---------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
43-
| gemini-1.5-pro | ✅ | ➖ | ✅ | ✅ | ✅ | ✅ |
44-
| gemini-1.5-flash | ✅ | ➖ | ✅ | ✅ | ✅ | ✅ |
45-
| gemini-1.0-pro | ✅ | ➖ | ➖ | ➖ | ✅ | ✅ |
43+
| gemini-1.5-pro | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
44+
| gemini-1.5-flash | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
45+
| gemini-1.0-pro | ✅ | ✅ | ➖ | ➖ | ✅ | ✅ |
4646

4747
### Legend
4848
| Symbol | Description |

‎docs/providers/groq.md‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -40,11 +40,11 @@ main()
4040

4141
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4242
| ------------------ | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
43-
| llama3-8b-8192 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
44-
| llama3-70b-8192 | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
45-
| mixtral-8x7b-32768 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
46-
| gemma-7b-it | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
47-
| gemma2-9b-it | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
43+
| llama3-8b-8192 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
44+
| llama3-70b-8192 | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
45+
| mixtral-8x7b-32768 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46+
| gemma-7b-it | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
47+
| gemma2-9b-it | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
4848

4949
### Legend
5050
| Symbol | Description |

‎docs/providers/mistral.md‎

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -40,20 +40,20 @@ main()
4040

4141
| Model | Chat Completion | Streaming | JSON Output | Image Input | Function Calling | N > 1 |
4242
| ----------------------- | --------------- | --------- | ----------- | ----------- | ---------------- | ----- |
43-
| open-mistral-7b | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
44-
| mistral-tiny-2312 | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
45-
| open-mixtral-8x7b | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
46-
| mistral-small-2312 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
47-
| open-mixtral-8x22b | ✅ | ➖ | ✅ | ➖ | ✅ | ➖ |
48-
| open-mixtral-8x22b-2404 | ✅ | ➖ | ✅ | ➖ | ✅ | ➖ |
49-
| mistral-small-latest | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
50-
| mistral-small-2402 | ✅ | ➖ | ➖ | ➖ | ✅ | ➖ |
51-
| mistral-medium-latest | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
52-
| mistral-medium-2312 | ✅ | ➖ | ➖ | ➖ | ➖ | ➖ |
53-
| mistral-large-latest | ✅ | ➖ | ✅ | ➖ | ✅ | ➖ |
54-
| mistral-large-2402 | ✅ | ➖ | ✅ | ➖ | ✅ | ➖ |
55-
| codestral-latest | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
56-
| codestral-2405 | ✅ | ➖ | ✅ | ➖ | ➖ | ➖ |
43+
| open-mistral-7b | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
44+
| mistral-tiny-2312 | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
45+
| open-mixtral-8x7b | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
46+
| mistral-small-2312 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
47+
| open-mixtral-8x22b | ✅ | ✅ | ✅ | ➖ | ✅ | ➖ |
48+
| open-mixtral-8x22b-2404 | ✅ | ✅ | ✅ | ➖ | ✅ | ➖ |
49+
| mistral-small-latest | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
50+
| mistral-small-2402 | ✅ | ✅ | ➖ | ➖ | ✅ | ➖ |
51+
| mistral-medium-latest | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
52+
| mistral-medium-2312 | ✅ | ✅ | ➖ | ➖ | ➖ | ➖ |
53+
| mistral-large-latest | ✅ | ✅ | ✅ | ➖ | ✅ | ➖ |
54+
| mistral-large-2402 | ✅ | ✅ | ✅ | ➖ | ✅ | ➖ |
55+
| codestral-latest | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
56+
| codestral-2405 | ✅ | ✅ | ✅ | ➖ | ➖ | ➖ |
5757

5858
### Legend
5959
| Symbol | Description |

0 commit comments

Comments
 (0)