Skip to content

Updating Source Docs#7

Open
PowerChell wants to merge 7 commits intomainfrom
update-docs
Open

Updating Source Docs#7
PowerChell wants to merge 7 commits intomainfrom
update-docs

Conversation

@PowerChell
Copy link
Copy Markdown
Contributor

@PowerChell PowerChell commented Feb 10, 2026

I broke the documentation up into 3 sections:

  • About Source
  • Using Source
  • Case Studies

I added a few files and got rid of the web-ui.md doc (information all in new files). Flow should be more intuitive for both users and those curious about Source. Surely some docs are missing, but hopefully heading in the right direction.

To add: visuals and graphics where helpful.

Please let me know your thoughts!

@vercel
Copy link
Copy Markdown

vercel Bot commented Feb 10, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
docs-source-coop Ready Ready Preview, Comment Apr 23, 2026 11:45pm

Request Review

@PowerChell PowerChell marked this pull request as ready for review April 20, 2026 04:57
@PowerChell
Copy link
Copy Markdown
Contributor Author

Some questions and known missing pieces or mistakes in these docs:

  1. What is the ratio of when we want to say Source vs Source Cooperative vs Source Coop vs Source Co-op in docs?
  2. Stats are old. What are the up-to-date Source stats? Where can I find those regularly?
  3. We should make sure we are aligned on what future features we are promoting publicly / if we need to do any of that in docs at all
  4. A few data viewer PRs that are currently open. What's the plan for these?

Copy link
Copy Markdown

@tylere tylere left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The product Memberships page does not appear to be described in the docs.
Ex: https://source.coop/edit/product/account/product-id/memberships


**Cost-Effective at Scale**: Source hosts over 1 petabyte of data across 300+ data products. Whether you're publishing a few gigabytes or hundreds of terabytes, Source provides cost-effective hosting without requiring you to manage cloud infrastructure.

**Cloud-Native Access**: Data on Source is stored in S3-compatible object storage, enabling efficient programmatic access through standard tools like the AWS CLI, Python's boto3, and various other programming libraries. Access data via the web interface or bring your compute directly to the data in the cloud.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Docs should provide examples of these (with links), to clearly demonstrate how efficient it is.

  • The AWS CLI is shown on the data-proxy page
  • boto3 is not demonstrated
  • "bring your compute directly to the data in the cloud" is not demonstrated


Source is currently in beta. While all data hosted in Source is available to the public, publishing data requires applying to be a beta tester. To apply, visit [the beta tester application form](https://forms.gle/4weS1hkRjZhQLoPE9).

Source currently:
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How recent are these stats? How easy is it to recalculate?

- Logs an average of 126 million data requests per month
- Supports over 300 data products from 66+ organizations

Source is funded by Taylor Geospatial, with in-kind support from AWS and Azure for data hosting. No newline at end of file
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This info is different than what is in index.md. Suggest consolidating into one place.

sidebar_position: 2
---

Source is a data publishing utility designed to make data shared in object stores easier to find, explore, and share on the web. Understanding these fundamental concepts will help you navigate and use Source Cooperative effectively.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Start with full name and abbreviation...

Suggested change
Source is a data publishing utility designed to make data shared in object stores easier to find, explore, and share on the web. Understanding these fundamental concepts will help you navigate and use Source Cooperative effectively.
Source Cooperative ("Source") is a data publishing utility designed to make data shared in object stores easier to find, explore, and share on the web. Understanding these fundamental concepts will help you navigate and use Source effectively.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Source is a data publishing utility designed to make data shared in object stores easier to find, explore, and share on the web. Understanding these fundamental concepts will help you navigate and use Source Cooperative effectively.
For how to create and manage data products in the web interface, see [Create a Data Product](/create-a-data-product).


Data products are the primary organizational unit in Source. They serve as containers for related data files and provide a way to group and organize information logically.

A data product is a collection of related data files with associated metadata and documentation. Each data product consists of:
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggest using consistent naming for fields in the docs vs. on the website. Examples of current differences below...

sidebar_position: 2
---

To create a data product, you need an account and [beta access](/create-an-account). After approval, sign out and sign back in—the option to create a new data product will then appear in the dropdown at the top right of the navigation bar.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
To create a data product, you need an account and [beta access](/create-an-account). After approval, sign out and sign back in—the option to create a new data product will then appear in the dropdown at the top right of the navigation bar.
Before creating a data product, you need to [create an account](/create-an-account) and apply for beta access. After approval, sign out and sign back in—the option to create a new data product will then appear in the dropdown at the top right of the navigation bar.


Once you have an account and beta access:

- **Publish data products**: Create data products to host your datasets
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- **Publish data products**: Create data products to host your datasets
- **Publish data products**: [Create data products](/create-a-data-product) to host your datasets


Data products can be owned by an organization or an individual. You will see a dropdown option when creating the data product of who will be displayed as the data product host (you or one of your organizations).

## When creating a data product
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Similar to my comment on core-concepts.md, it woudld be beneficial to use consistent naming for data product fields in the docs vs. on the website

- **Title**: Maximum 200 characters.
- **Description**: Optional; maximum 500 characters. Use it for a short overview; put detailed documentation in the README.
- **Tags**: Comma-separated, up to 20 tags. They help others discover your data.
- **Visibility**: New data products are created **Unlisted** (not shown in search). When ready to publish, open the data product page, click **Edit** in the sidebar, and set the state to **Listed**.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Edit button now longer is part of the UI.

Suggested change
- **Visibility**: New data products are created **Unlisted** (not shown in search). When ready to publish, open the data product page, click **Edit** in the sidebar, and set the state to **Listed**.
- **Visibility**: New data products are created **Unlisted** (not shown in search). When ready to publish, open the data product page, click the gear icon, and set the state to **Listed**.


## Editing a data product

To change the title, description, tags, or visibility later, open your data product page and click **Edit** in the sidebar.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
To change the title, description, tags, or visibility later, open your data product page and click **Edit** in the sidebar.
To change the title, description, tags, or visibility later, open your data product page and click the gear icon.

@tylere tylere self-requested a review April 23, 2026 00:46
This guide explains how to deliver your data to Source Cooperative in a secure and simple way.
It is written for data providers and does not require deep Amazon Web Service (AWS) knowledge.

If you do not see the option to upload (for example, Edit Mode or View Credentials on your product page), contact [hello@source.coop](mailto:hello@source.coop) to request upload access.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
If you do not see the option to upload (for example, Edit Mode or View Credentials on your product page), contact [hello@source.coop](mailto:hello@source.coop) to request upload access.
If you do not see the option to upload (for example, Edit Mode or View Credentials on your product page under the lock icon), contact [hello@source.coop](mailto:hello@source.coop) to request upload access.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, don't they need to first complete the beta tester application before contacting hello@ ?

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Although not changed in this PR, I noticed a few issues in later lines...

  • "linke" -> "line"
  • "selectory" -> "selector"
  • "ilke" -> "like"

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Option 2 and Option 3 instructions may need to be updated to reflect an OpenID Connect (OIDC) authentication flow.


# Accessing Data Through the Source Data Proxy

The Source Data Proxy provides S3-compatible access to all data hosted on Source Cooperative. You can access data through the proxy without authentication, making it easy to programmatically download datasets using standard AWS CLI commands.
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This page may need to be updated to reflect alternative workflows that use OpenID Connect (OIDC).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants