Skip to main content

Google Cloud in S3 mode

This quickstart shows how to use a Google Cloud Storage bucket in s3 compatible mode.

Prepare the storage

First, create a new service account, for example in the Cloud Console. Next, grant write permissions on the bucket to this service account. You can do this under the PERMISSIONS tab on the bucket's details page. Choose for example Storage Legacy Bucket Writer as role and the newly created service account as principal.

Create HMAC credentials: gsutil hmac create <service-account-name>. Put the secrets in a JSON file, named for example s3.json:

s3.json
{
"url": "https://storage.googleapis.com",
"accessKey": "<access-key>",
"secretKey": "<secret-key>",
"api": "s3v4",
"path": "auto"
}

Create the data connector

With the credentials file (s3.json in our example), create the data connector using the command below:

strm create data-connector s3 my-s3 strmprivacy-export-demo --credentials-file=s3.json
{
"ref": {
"name": "my-s3",
"projectId": "30fcd008-9696-...."
},
"s3Bucket": {
"bucketName": "strmprivacy-export-demo"
}
}

This will create a data connector named my-s3 for the bucket strmprivacy-export-demo, using the provided credentials. Specify the actual name of your bucket, and any name for the data connector itself.