cloud engineer
If you’re downloading large files, you can speed up download speeds by modifying gsutil. Decrease the number of threads and increase the number of components.
gsutil \ -o "GSUtil:parallel_thread_count=1" \ -o "GSUtil:parallel_process_count=8" \ cp gs://bucket/source.dat /download/dest/file.dat |
gsutil \ -o "GSUtil:parallel_thread_count=1" \ -o "GSUtil:parallel_process_count=8" \ cp gs://bucket/source.dat /download/dest/file.dat
The standard GSUtil installation recommended by Google wasn’t working. I found an alternative way to install GSUtil using wget to download, and tar to unzip. You might need to add a path if you install it on a non-standard directory.