Pawsey and the bowerbird library
We have been working on putting key bowerbird data sets onto Pawsey object storage. With this we can prototype new tooling that is not dependent on our systems in AAD or Nectar.
library (idt) ## devtools::install_github("mdsumner/idt")
(files <- oisstfiles ())
# A tibble: 15,761 × 5
date source Bucket Key protocol
<dttm> <chr> <chr> <chr> <chr>
1 1981-09-01 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
2 1981-09-02 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
3 1981-09-03 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
4 1981-09-04 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
5 1981-09-05 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
6 1981-09-06 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
7 1981-09-07 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
8 1981-09-08 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
9 1981-09-09 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
10 1981-09-10 00:00:00 /vsis3/idea-10.7289-v5sq8xb5/www.n… idea-… www.… /vsis3
# ℹ 15,751 more rows
That set of files has a set of bucket/key pairs for request from Pawsey object store.
``` /vsis3/