Bitzu

Associate Cloud Engineer ยท Storage products and moving data in

Loading data into Google Cloud

gcloud storage cp/rsync uploads, loading data from Cloud Storage into BigQuery or Cloud SQL, Storage Transfer Service, Transfer Appliance, and picking by volume and network.

Key points

  • Under about 1 TB: gcloud storage cp / rsync.
  • Over 1 TB: Storage Transfer Service (sources include S3, Azure Blob, URL lists, file systems; agents for on-premises).
  • Poor or no connectivity: Transfer Appliance (copy locally, ship to Google).
  • From Cloud Storage onward: bq load into BigQuery (bucket and dataset must share a location).

Source: https://docs.cloud.google.com/storage-transfer/docs/transfer-options

Practice questions

Single choice

Which command uploads a local file to a Cloud Storage bucket?

  1. gcloud storage cp
  2. gcloud storage buckets create
  3. bq load
  4. gcloud compute scp
Show answer

Answer: A. gcloud storage cp

gcloud storage cp copies between local paths and gs:// URLs. rsync syncs whole trees, and the other two are not upload commands.

Select all that apply

Which of these can Storage Transfer Service use as a source?

  1. Amazon S3
  2. Microsoft Azure Blob Storage
  3. Tables in a Cloud SQL instance
  4. An on-premises file system
  5. Tables in BigQuery
Show answer

Answer: A. Amazon S3, B. Microsoft Azure Blob Storage, D. An on-premises file system

It supports Amazon S3, Azure Blob Storage, and file systems (via agents), among others. Cloud SQL tables and BigQuery tables are databases, not supported transfer sources.

True or false

By default, gcloud storage rsync deletes objects in the destination that do not exist in the source.

Show answer

Answer: False

False. Extra destination objects are kept unless you add --delete-unmatched-destination-objects, which can delete data quickly if the arguments are wrong.

Practice 8 questions on this topic in Bitzu

Short lessons, instant explanations and spaced review of what you get wrong. Free on iOS and Android.

Download on the App StoreGet it on Google Play

More Associate Cloud Engineer topics in this module