Skip to content

WIP: Cursor add Rclone Recipe for Cloud/S3 Archiving#156

Draft
christophernhill wants to merge 1 commit intomainfrom
cnh/rclone-recipe
Draft

WIP: Cursor add Rclone Recipe for Cloud/S3 Archiving#156
christophernhill wants to merge 1 commit intomainfrom
cnh/rclone-recipe

Conversation

@christophernhill
Copy link
Contributor

@christophernhill christophernhill commented Nov 9, 2025

🚧 Work in Progress

This PR adds a comprehensive recipe for using rclone on the Engaging cluster to archive data to various storage destinations.

Storage Destinations to Cover

  • MIT Account Google Drive
  • MIT Account Dropbox
  • AWS S3 buckets
  • NSF ACCESS Open Storage Network (OSN)

Progress Checklist

  • Initial file structure created
  • Research completed
  • Installation/setup section
  • Google Drive section
  • Dropbox section
  • AWS S3 section
  • OSN section
  • Example scripts
  • Best practices section
  • Troubleshooting section
  • FAQs section
  • Navigation updated
  • Local build tested
  • Ready for review

Preview

After GitHub Actions complete, preview will be available at:
https://mit-orcd.github.io/orcd-docs-previews/PR/PR156

Development Notes

This PR is being developed incrementally with commits pushed as sections are completed. Each push triggers a preview rebuild for continuous validation.

Files

  • docs/recipes/rclone.md - Main recipe documentation
  • docs/recipes/scripts/rclone/ - Example scripts (to be added)
  • mkdocs.yml - Navigation entry (to be updated)

- Create rclone.md with frontmatter and main section headers
- Add tags for archiving, storage, and rclone
- Include placeholder sections for each storage destination
- Following style conventions of existing ORCD recipes
## Getting Rclone on Engaging

*This section will cover how to access rclone on Engaging (either through module loading or installation).*

Copy link
Collaborator

@lmilechin lmilechin Nov 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Rclone is available through a module on Engaging. You can access it by using the `module load` command:
```bash
module load rclone

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants