Datasets on Blackfynn Discover are publicly accessible using any of the AWS tools that are available. In addition to downloading a dataset to your local machine, it is also possible to transfer a public dataset from Blackfynn Discover to your personal S3 bucket.
There are 2 easy steps to configure your computer for copying a dataset from Blackfynn Discover to your personal AWS Account.
- Setup an AWS account and create a personal S3 bucket
- Install and configure the AWS Command Line Interface (AWS CLI)
Copying a dataset to another S3 Bucket
Once you have created an AWS account and installed the CLI, you can transfer data from Blackfynn Discover to your bucket by typing the following in your local terminal:
$ aws s3 sync s3://[discover-dataset-bucket] s3://[your-bucket] --request-payer requester
You can get the
[discover-dataset-bucket] name by clicking the Get Dataset button on the dataset's page in Discover.
[your-bucket] is the name of your bucket and can be obtained using the AWS Console.
To learn more about moving S3 objects between buckets you can visit
Note: By including the
request-payer requester attribute, you acknowledge that any costs associated with downloading the data will be charged to your AWS account. For transfer pricing information, visit the AWS S3 Pricing documentation. The relevant section is
Data Transfer OUT From Amazon S3 To Internet .