Skip to main content
This document details how to store your files in Wherobots Managed Storage, ensuring its accessibility for your geospatial analysis and processing requirements.
All Wherobots Managed Storage is located in us-west-2. We currently don’t provide separate managed storage instances for different regions. For optimal performance and greater control over data locality, we recommend that customers manage their own S3 buckets and use storage integrations.

​
Benefits

You can store a variety of file formats in Managed Storage, including:
  • Shapefiles (.shp)
  • GeoJSON (.geojson)
  • CSV (.csv)
  • Parquet (.parquet)
  • GeoParquet (.parquet)
  • Raster formats (e.g., .tif, .geotiff)
Once uploaded, your data is readily available for use within the Wherobots Cloud environment, including:
  • WherobotsDB: Access and query your data using WherobotsDB, leveraging its geospatial capabilities for analysis.
  • Jupyter Notebooks: Within Wherobots Cloud, load and process your data within Jupyter notebooks for interactive exploration and visualization.
  • Wherobots API(s): Programmatically access and manage your data through the Wherobots API(s).
Our Managed Storage offering can provide storage for your entire Organization.

​
Before you start

Before using Managed Storage, ensure that you have the following required resources:

​
Folders and permissions

​
User specific folders

The folders with the name of customer-XXXX/ are unique to each account. The files and folders within customer-XXXX/ folders can only be accessed by the account holder.

​
Organization-wide shared folders

Folders named shared/ grant access to everyone within your Organization. Any member of the Organization can create new folders, delete existing ones, and have the privileges to read, write, upload, and delete files within this shared folder.

​
Copy a file or folder’s S3 Path

If needed, you can copy the direct S3 path for your directory and files by clicking on the “copy” icon on the right-hand side of each displayed folder or file.

​
Folder permissions

The following top-level folders are read-only, indicating that it is not possible to create new folders, upload files, or delete any existing folders:
  • / (root)
  • /data/
The following folders are where the user can create new folders, upload files, or delete any file within them:
  • /data/customer-XXXX
  • /data/shared
In the /spark-logs folder, you can read, rename, and delete files, but you can’t upload files or create folders. Changing or deleting the logs can affect your experience, so leave them as they are.

​
Upload your data

You can upload data through the Wherobots Cloud web interface or the Amazon Web Services (AWS) CLI.

​
Web interface

  1. Log in to Wherobots Cloud.
  2. Go to Cloud Storage.
  3. Click data.
    Data folder
  4. Navigate to your customer- folder or the shared folder.
    Storage folders

    ​
    shared storage visibility

    Items stored in the shared folder are available to your entire Wherobots Organization. For more information, see Organization-wide shared folders.
  5. (Optional) Click Create folder, to create a new folder.
  6. Click Upload.
  7. Click + Click to Upload a file to open the file browser.
    Create ingest credentials
  8. Select your desired file.
  9. Click Upload.

​
AWS CLI

For larger datasets or bulk uploads, leverage the AWS CLI, which allows you to upload to Managed Storage with AWS CLI. Follow these instructions, to obtain temporary ingest credentials and upload files with aws s3 cp.
  1. Generate temporary ingest credentials through the web interface.
  2. Go to Cloud Storage
  3. Click data.
    Data folder
  4. Navigate to your customer- folder or the shared folder.
    Storage folders

    ​
    Note

    Items stored in the shared folder are available to your entire Organization. For more information, see Organization-wide shared folders.
  5. (Optional) Click Create folder, to create a new folder.
  6. Click Upload.
  7. Click Get ingest credentials.
    Create ingest credentials
  8. Click Create ingest credentials to generate credentials.
    Create ingest credentials
  9. Configure your AWS CLI with these credentials. For more information, see Authenticating with short-term credentials for the AWS CLI in the AWS documentation.
After authenticating successfully, you can use the aws s3 cp to upload your data to the provided S3 URL.