Skip to content

Commit a756484

Browse files
committed
docs(rl-next/s3-curl-implementation): update with multipart uploads
1 parent 6678031 commit a756484

File tree

1 file changed

+19
-5
lines changed

1 file changed

+19
-5
lines changed

doc/manual/rl-next/s3-curl-implementation.md

Lines changed: 19 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
22
synopsis: "Improved S3 binary cache support via HTTP"
3-
prs: [13823, 14026, 14120, 14131, 14135, 14144, 14170, 14190, 14198, 14206, 14209, 14222, 14223, 13752]
3+
prs: [13752, 13823, 14026, 14120, 14131, 14135, 14144, 14170, 14190, 14198, 14206, 14209, 14222, 14223, 14330, 14333, 14335, 14336, 14337, 14350, 14356, 14357, 14374, 14375, 14376, 14377, 14391, 14393, 14420, 14421]
44
issues: [13084, 12671, 11748, 12403]
55
---
66

@@ -18,9 +18,23 @@ improvements:
1818
The new implementation requires curl >= 7.75.0 and `aws-crt-cpp` for credential
1919
management.
2020

21-
All existing S3 URL formats and parameters remain supported, with the notable
22-
exception of multi-part uploads, which are no longer supported.
21+
All existing S3 URL formats and parameters remain supported, however the store
22+
settings for configuring multipart uploads have changed:
23+
24+
- **`multipart-upload`** (default: `false`): Enable multipart uploads for large
25+
files. When enabled, files exceeding the multipart threshold will be uploaded
26+
in multiple parts.
27+
28+
- **`multipart-threshold`** (default: `100 MiB`): Minimum file size for using
29+
multipart uploads. Files smaller than this will use regular PUT requests.
30+
Only takes effect when `multipart-upload` is enabled.
31+
32+
- **`multipart-chunk-size`** (default: `5 MiB`): Size of each part in multipart
33+
uploads. Must be at least 5 MiB (AWS S3 requirement). Larger chunk sizes
34+
reduce the number of requests but use more memory.
35+
36+
- **`buffer-size`**: Has been replaced by `multipart-chunk-size`.
2337

2438
Note that this change also means Nix now supports S3 binary cache stores even
25-
if build without `aws-crt-cpp`, but only for public buckets which do not
26-
require auth.
39+
if built without `aws-crt-cpp`, but only for public buckets which do not
40+
require authentication.

0 commit comments

Comments
 (0)