dds data¶
Group command for uploading, downloading and managing project data.
dds data [OPTIONS] COMMAND [ARGS]...
get¶
Download data from a project.
To download the data to a specific destination, use the –destination option. This cannot be an existing directory, for security reasons. This will be improved on in future releases.
Following to the download, the DDS decrypts the files, checks if the files are compressed and if so decompresses them.
NB! The current setup requires decryption and decompression to be performed locally. Make sure you have enough space. This will be improved on in future releases. The default number of files to download, decrypt and decompress at a time is four. This can be changed by altering the –num-threads option, but whether or not it works depends on the machine you are running the CLI on.
The token is valid for 7 days. Make sure your token is valid long enough for the delivery to finish. To avoid that a delivery fails because of an expired token, we recommend reauthenticating yourself before downloading data.
dds data get [OPTIONS]
Options
- -p, --project <project>¶
Required Project ID from which you’re downloading data.
- -nt, --num-threads <num_threads>¶
Number of parallel threads to perform the delivery
- Default
4
- -s, --source <source>¶
Path to file or directory. Use the option multiple times to specify more than one source [multiple]
- -spf, --source-path-file <source_path_file>¶
File containing path to files or directories.
- -d, --destination <destination>¶
Destination of downloaded data.
- --break-on-fail¶
Cancel download of all files if one fails.
- Default
False
- --silent¶
Turn off progress bar for each individual file. Summary bars still visible.
- Default
False
- -a, --get-all¶
Download all project contents.
- Default
False
- --verify-checksum¶
Perform SHA-256 checksum verification after download (slower).
- Default
False
ls¶
List project contents.
Same as dds ls –p.
dds data ls [OPTIONS]
Options
- -p, --project <project>¶
Required Project ID.
- -f, --folder <folder>¶
List contents in this project folder.
- --json¶
Output in JSON format.
- Default
False
- --size¶
Show size of project contents.
- Default
False
- --tree¶
Display the entire project(s) directory tree.
- Default
False
- --users¶
Display users associated with a project(Requires a project id).
- Default
False
put¶
Upload data to a project.
Limited to Unit Admins and Personnel.
To upload a file (with the same name) a second time, use the –overwrite flag.
Prior to the upload, the DDS checks if the files are compressed and if not compresses them, followed by encryption. After this the files are uploaded to the cloud.
NB! The current setup requires compression and encryption to be performed locally. Make sure you have enough space. This will be improved on in future releases. The default number of files to compress, encrypt and upload at a time is four. This can be changed by altering the –num-threads option, but whether or not it works depends on the machine you are running the CLI on.
The token is valid for 7 days. Make sure your token is valid long enough for the delivery to finish. To avoid that a delivery fails because of an expired token, we recommend reauthenticating yourself before uploading data.
dds data put [OPTIONS]
Options
- -md, --mount-dir <mount_dir>¶
New directory where the files will be mounted before upload and any error log files will be saved for a specific upload.
- -p, --project <project>¶
Required Project ID to which you’re uploading data.
- -s, --source <source>¶
Path to file or directory (local). Use the option multiple times to specify more than one source [multiple]
- -spf, --source-path-file <source_path_file>¶
File containing path to files or directories.
- -nt, --num-threads <num_threads>¶
Number of parallel threads to perform the delivery
- Default
4
- -d, --destination <destination>¶
Destination of uploaded data.
- --overwrite¶
Overwrite files if already uploaded.
- Default
False
- --break-on-fail¶
Cancel upload of all files if one fails.
- Default
False
- --silent¶
Turn off progress bar for each individual file. Summary bars still visible.
- Default
False
rm¶
[Unit Admins and Personnel only] Delete data within a specific project.
Project data can only be deleted if the project has the status ‘In Progress’ and it has never had the status ‘Available’.
This command should be used with caution; once the data is deleted there is no getting it back.
dds data rm [OPTIONS]
Options
- -p, --project <project>¶
Required Project ID.
- -fl, --folder <folder>¶
Path to folder to remove. Use the option multiple times to specify more than one folder [multiple]
- -f, --file <file>¶
Path to file to be removed. Use the option multiple times to specify more than one file [multiple]
- -a, --rm-all¶
Remove all project contents.