uly.me

cloud engineer

  • Home
  • Category
    • Cloud
    • PHP
    • Linux
    • HTML
    • WP
    • CSS
    • SVN
    • Mac
    • Git
    • JS
    • Misc
  • About
    • Me
    • Archives
    • Contact
    • Portfolio
    • Podcasts
  • Code
    • Github
    • Docker Hub
    • Unfuddle
You are here: Home / 2017 / Archives for October 2017

Archives for October 2017

October 29, 2017

AWS S3 Killedted

I was trying to copy a large file from AWS S3 bucket to the smallest Amazon Lightsail instance using the AWS CLI. It was throwing out an error saying “Killedted 3.8 Mib/113.4 Mib (5.0 Mib/s) with 1 file(s) remaining.” For some reason, the copy was being killed or terminated. I was thinking that maybe the small instance was not enough to copy or move large files. I’m glad I found a workaround. Here’s the command I was doing, and the fix.

The Error

$ aws s3 cp s3://bucketname/directory/largefile.mp4 largefile.mp4
$ Killedted 3.8 MiB/113.4 MiB (5.0 MiB/s) with 1 file(s) remaining

$ aws s3 cp s3://bucketname/directory/largefile.mp4 largefile.mp4 $ Killedted 3.8 MiB/113.4 MiB (5.0 MiB/s) with 1 file(s) remaining

The Fix

$ aws configure set default.s3.max_concurrent_requests 4

$ aws configure set default.s3.max_concurrent_requests 4

The default is 10 which was too much for a small instance.

Filed Under: Cloud Tagged With: cli, s3

Subscribe

Cloud

  • Extend an EBS Volume
  • Convert JSON to YAML
  • AWS S3 Killedted
  • Serverless Jekyll on AWS
  • AWS and VMWare

Linux

  • Cronjob Not Running
  • Password Expiry
  • Multiple VirtualHosts
  • Convert JSON to YAML
  • Empty A File

PHP

  • Comparing Time
  • Quick Database Check
  • Laravel 5.4 Install
  • Mass Find and Replace
  • WordPress Mobile Detect

Copyright © 2018. All rights reserved.