• Skip to main content

Uly.me

cloud engineer

  • Home
  • About
  • Archives

GCP Increase Download Speed for gsutil

October 2, 2019

If you’re downloading large files, you can speed up download speeds by modifying gsutil. Decrease the number of threads and increase the number of components.

gsutil \
-o "GSUtil:parallel_thread_count=1" \
-o "GSUtil:parallel_process_count=8" \
cp gs://bucket/source.dat /download/dest/file.dat

gsutil \ -o "GSUtil:parallel_thread_count=1" \ -o "GSUtil:parallel_process_count=8" \ cp gs://bucket/source.dat /download/dest/file.dat

Filed Under: Cloud Tagged With: download, gcp, gsutil, increase, process count, speed, thread count

Search This Website

Subscribe Via Email

  • Home
  • About
  • Archives

Copyright © 2023