• Skip to primary navigation
  • Skip to main content

Uly.me

cloud engineer

  • Home
  • About
  • Archives

gsutil

GCP Increase Download Speed for gsutil

by Ulysses · Oct 2, 2019

If you’re downloading large files, you can speed up download speeds by modifying gsutil. Decrease the number of threads and increase the number of components.

gsutil \
-o "GSUtil:parallel_thread_count=1" \
-o "GSUtil:parallel_process_count=8" \
cp gs://bucket/source.dat /download/dest/file.dat

gsutil \ -o "GSUtil:parallel_thread_count=1" \ -o "GSUtil:parallel_process_count=8" \ cp gs://bucket/source.dat /download/dest/file.dat

Filed Under: Cloud Tagged With: download, gcp, gsutil, increase, process count, speed, thread count

GSUtil Installation

by Ulysses · Oct 15, 2018

The standard GSUtil installation recommended by Google wasn’t working. I found an alternative way to install GSUtil using wget to download, and tar to unzip. You might need to add a path if you install it on a non-standard directory.

Alternative way to install GSUtil on Linux.

Filed Under: Cloud Tagged With: gcp, gsutil

Copyright © 2012–2021