Here’s how to list S3 files recursively.
aws s3 ls s3://mybucket --recursive | awk '{print $4}' |
By default, the results display date, time, disk size and filename. Use awk to display the filename only.
AWS S3 LS Recursive
awk
GCP Projects List
Here’s how to get a list of GCP projects.
gcloud projects list |
Result:
PROJECT_ID NAME PROJECT_NUMBER your-project-id-xxxx servers xxxxxxxxxxxx |
Use awk to display the project id only.
gcloud projects list | awk '{print $1}' |
Result
PROJECT ID your-project-id-xxxx |
Clean Duplicates in File
Here’s a nice command to get rid of line duplicates in a file. I’m sending the output to a temporary file then renaming it back to the original file. The reason is, it’s probably not a good idea to overwrite a file that you are editing. It’s much safer to send the output to another file.
$ awk '!seen[$0]++' backup.sh > backup01.sh $ mv backup01.sh backup.sh |