You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/docker-model-runner.md
+30-2Lines changed: 30 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,14 +18,28 @@ This page describes how to run OpenChat Playground (OCP) with [Docker Model Runn
18
18
19
19
## Run on local machine
20
20
21
-
1. Make sure the Docker Model Runner is up and running with the following command.
21
+
1. Make sure the Docker Model Runner is up and running, and ready to accept requests with the following command.
22
22
23
23
```bash
24
24
docker model status
25
25
```
26
26
27
27
It should say `Docker Model Runner is running`.
28
28
29
+
```bash
30
+
# bash/zsh
31
+
curl http://localhost:12434
32
+
```
33
+
34
+
```powershell
35
+
# Powershell
36
+
Invoke-WebRequest http://localhost:12434
37
+
```
38
+
39
+
It should say `The Service is running`
40
+
41
+
> If it says `Connection refused`, turn on "Enable host-side TCP support" option in [Docker Desktop Settings](https://docs.docker.com/ai/model-runner/get-started/#docker-desktop).
42
+
29
43
1. Download the model. The default model OCP uses is [ai/smollm2](https://hub.docker.com/r/ai/smollm2).
30
44
31
45
```bash
@@ -62,14 +76,28 @@ This page describes how to run OpenChat Playground (OCP) with [Docker Model Runn
62
76
63
77
## Run in local container
64
78
65
-
1. Make sure the Docker Model Runner is up and running with the following command.
79
+
1. Make sure the Docker Model Runner is up and running, and ready to accept requests with the following command.
66
80
67
81
```bash
68
82
docker model status
69
83
```
70
84
71
85
It should say `Docker Model Runner is running`.
72
86
87
+
```bash
88
+
# bash/zsh
89
+
curl http://localhost:12434
90
+
```
91
+
92
+
```powershell
93
+
# Powershell
94
+
Invoke-WebRequest http://localhost:12434
95
+
```
96
+
97
+
It should say `The Service is running`
98
+
99
+
> If it says `Connection refused`, turn on "Enable host-side TCP support" option in [Docker Desktop Settings](https://docs.docker.com/ai/model-runner/get-started/#docker-desktop).
100
+
73
101
1. Download the model. The default model OCP uses is [ai/smollm2](https://hub.docker.com/r/ai/smollm2).
0 commit comments