Associate Cloud Engineer ยท Storage products and moving data in
Loading data into Google Cloud
gcloud storage cp/rsync uploads, loading data from Cloud Storage into BigQuery or Cloud SQL, Storage Transfer Service, Transfer Appliance, and picking by volume and network.
Key points
- Under about 1 TB: gcloud storage cp / rsync.
- Over 1 TB: Storage Transfer Service (sources include S3, Azure Blob, URL lists, file systems; agents for on-premises).
- Poor or no connectivity: Transfer Appliance (copy locally, ship to Google).
- From Cloud Storage onward: bq load into BigQuery (bucket and dataset must share a location).
Source: https://docs.cloud.google.com/storage-transfer/docs/transfer-options
Practice questions
Which command uploads a local file to a Cloud Storage bucket?
- gcloud storage cp
- gcloud storage buckets create
- bq load
- gcloud compute scp
Show answer
Answer: A. gcloud storage cp
gcloud storage cp copies between local paths and gs:// URLs. rsync syncs whole trees, and the other two are not upload commands.
Which of these can Storage Transfer Service use as a source?
- Amazon S3
- Microsoft Azure Blob Storage
- Tables in a Cloud SQL instance
- An on-premises file system
- Tables in BigQuery
Show answer
Answer: A. Amazon S3, B. Microsoft Azure Blob Storage, D. An on-premises file system
It supports Amazon S3, Azure Blob Storage, and file systems (via agents), among others. Cloud SQL tables and BigQuery tables are databases, not supported transfer sources.
By default, gcloud storage rsync deletes objects in the destination that do not exist in the source.
Show answer
Answer: False
False. Extra destination objects are kept unless you add --delete-unmatched-destination-objects, which can delete data quickly if the arguments are wrong.
Practice 8 questions on this topic in Bitzu
Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.
