All Wherobots Managed Storage is located in
us-west-2. We currently don’t provide separate managed storage instances for different regions. For optimal performance and greater control over data locality, we recommend that customers manage their own S3 buckets and use storage integrations.Benefits
You can store a variety of file formats in Managed Storage, including:- Shapefiles (.shp)
- GeoJSON (.geojson)
- CSV (.csv)
- Parquet (.parquet)
- GeoParquet (.parquet)
- Raster formats (e.g., .tif, .geotiff)
- WherobotsDB: Access and query your data using WherobotsDB, leveraging its geospatial capabilities for analysis.
- Jupyter Notebooks: Within Wherobots Cloud, load and process your data within Jupyter notebooks for interactive exploration and visualization.
- Wherobots API(s): Programmatically access and manage your data through the Wherobots API(s).
Before you start
Before using Managed Storage, ensure that you have the following required resources:Folders and permissions
User specific folders
The folders with the name ofcustomer-XXXX/ are unique to each account.
The files and folders within customer-XXXX/ folders can only be accessed by the account holder.
Organization-wide shared folders
Folders namedshared/ grant access to everyone within your
Organization. Any member of the Organization can create new folders,
delete existing ones, and have the privileges to read, write, upload,
and delete files within this shared folder.
Copy a file or folder’s S3 Path
If needed, you can copy the direct S3 path for your directory and files by clicking on the “copy” icon on the right-hand side of each displayed folder or file.Folder permissions
The following top-level folders are read-only, indicating that it is not possible to create new folders, upload files, or delete any existing folders:/(root)/data/
/data/customer-XXXX/data/shared
In the
/spark-logs folder, you can read, rename, and delete files, but you can’t upload files or create folders. Changing or deleting the logs can affect your experience, so leave them as they are.Upload your data
You can upload data through the Wherobots Cloud web interface or the Amazon Web Services (AWS) CLI.Web interface
- Log in to Wherobots Cloud.
- Go to Cloud Storage.
-
Click data.

-
Navigate to your
customer-folder or thesharedfolder.
Items stored in thesharedstorage visibilitysharedfolder are available to your entire Wherobots Organization. For more information, see Organization-wide shared folders. - (Optional) Click Create folder, to create a new folder.
- Click Upload.
-
Click + Click to Upload a file to open the file browser.

- Select your desired file.
- Click Upload.
AWS CLI
For larger datasets or bulk uploads, leverage the AWS CLI, which allows you to upload to Managed Storage with AWS CLI. Follow these instructions, to obtain temporary ingest credentials and upload files withaws s3 cp.
- Generate temporary ingest credentials through the web interface.
- Go to Cloud Storage
-
Click data.

-
Navigate to your
customer-folder or thesharedfolder.
Note
Items stored in thesharedfolder are available to your entire Organization. For more information, see Organization-wide shared folders. - (Optional) Click Create folder, to create a new folder.
- Click Upload.
-
Click Get ingest credentials.

-
Click Create ingest credentials to generate credentials.

- Configure your AWS CLI with these credentials. For more information, see Authenticating with short-term credentials for the AWS CLI in the AWS documentation.
aws s3 cp to upload your data to the provided S3 URL.
Download a script safely
Use a Wherobots API key,curl, and jq for these examples. Set the shell variables first:
default for Managed Storage, user_files::<region> for My Files (with a path relative to your My Files), or a storage integration ID. The examples below use Managed Storage.
Prefer GET /storage/{storageId}/file-download-url/{path}. It returns downloadUrl and expiresAt. Fetch the URL before it expires, without an API key or other Wherobots credentials:
data/shared/ and in your own customer-XXXX folder. Another person’s customer-XXXX folder is private: a request for a file in it returns 403, including for Organization admins. To share a script, put it in data/shared/.
The /storage/{storageId}/text-files/... endpoints only work with your own My Files, not Managed Storage or storage integrations. Use GET /storage/{storageId}/file-download-url/{path} to read a shared script.
Redirect fallback
GET /storage/{storageId}/files/{path} doesn’t return the file. It returns a 307 redirect to a pre-signed Amazon S3 URL.
Download in two steps instead. First ask Wherobots for the location without following the redirect, then fetch the location without your API key. The location expires after 60 seconds, so fetch it right away:
requests:

