feat(upload): add multipart upload support for large files up to 5GB

[anoncam]

Summary

This PR adds support for uploading large files (up to 5GB) using Cloudflare R2's multipart upload API. Files larger than 50MB are automatically uploaded using chunked multipart uploads with progress tracking and resume capability.

Key Features

• Automatic large file detection: Files >50MB automatically use multipart upload
• Progress tracking: Real-time progress bar with upload speed and ETA
• Resume support: Interrupted uploads can be resumed from where they left off
• Parallel uploads: 4 concurrent chunk uploads for maximum throughput
• Configurable chunk size: Default 10MB, customizable via --chunk-size

New CLI Options

# Large files are auto-detected and use multipart
dedpaste send --file large-video.mp4

# Custom chunk size (in MB)
dedpaste send --chunk-size 20 --file archive.tar.gz

# Resume an interrupted upload
dedpaste send --resume ~/.dedpaste/uploads/sess_xxx.json

# List interrupted uploads
dedpaste send --list-uploads

# Abort and cleanup a failed upload
dedpaste send --abort-upload <session-id>

# Disable progress bar
dedpaste send --no-progress --file data.bin

Architecture

CLI (Node.js)          Cloudflare Worker           R2 Storage
     │                       │                         │
     │  POST /upload/init    │                         │
     │──────────────────────>│ createMultipartUpload() │
     │  {sessionId}          │────────────────────────>│
     │<──────────────────────│                         │
     │                       │                         │
     │  PUT /upload/:id/part/:n (streamed chunks)      │
     │──────────────────────>│ uploadPart()            │
     │  {etag}               │────────────────────────>│
     │<──────────────────────│                         │
     │  ... parallel uploads │                         │
     │                       │                         │
     │  POST /upload/:id/complete                      │
     │──────────────────────>│ completeMultipartUpload()│
     │  {url}                │────────────────────────>│
     │<──────────────────────│                         │

Files Changed

File	Description
src/index.ts	Added multipart upload endpoints
src/types/index.ts	Added UploadSession, ResumeState, and related types
wrangler.toml	Added UPLOAD_SESSIONS KV namespace
cli/largeFileUpload.ts	New - Core multipart upload logic
cli/progressDisplay.ts	New - Progress bar utilities
cli/resumeState.ts	New - Resume state persistence
cli/encryptionUtils.ts	Added streaming encryption v4 framework
cli/index.ts	Integrated large file options and detection

Technical Details

• Chunk size: Default 10MB (configurable), minimum 5MB (R2 requirement)
• Max file size: 5GB (configurable via LARGE_FILE_CONSTANTS)
• Session TTL: 24 hours for resume capability
• Concurrency: 4 parallel chunk uploads
• Retry logic: 3 attempts with exponential backoff

Testing

• ✅ Verified 60MB file upload completes successfully
• ✅ Verified file integrity via MD5 checksum comparison
• ✅ Verified progress bar displays correctly
• ✅ Verified --list-uploads command works
• ✅ Deployed and tested on production

Known Limitations

• Encrypted large file uploads currently fall back to regular upload (streaming encryption v4 framework is in place for future implementation)

Test plan

• Upload a file <50MB (should use regular upload)
• Upload a file >50MB (should auto-detect and use multipart)
• Interrupt upload with Ctrl+C, verify resume state saved
• Resume upload with --resume, verify completion
• Test --list-uploads shows interrupted uploads
• Test --abort-upload cleans up properly
• Verify downloaded file matches original (checksum)

🤖 Generated with Claude Code