https://sandrocirulli.net/tags/s3/ Recent content in S3 on Sandro Cirulli Hugo en-gb Tue, 29 Oct 2019 00:00:00 +0000 https://sandrocirulli.net/how-to-download-an-entire-s3-bucket-recursively/ Tue, 29 Oct 2019 00:00:00 +0000 https://sandrocirulli.net/how-to-download-an-entire-s3-bucket-recursively/ <figure><img src="../../img/Amazon-Simple-Storage-Service-S3_light-bg@4x.png" alt="Amazon S3 bucket"><figcaption> <p>Image: Amazon Web Services, Inc. ©</p> </figcaption> </figure> <p>Sometimes I have the need to keep a local copy of an S3 bucket. Using the AWS console is ok if you just have few objects in the S3 bucket. But what do you do if you have hundreds of objects in your S3 bucket? The aws cli comes to rescue with this simple command:</p> <div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>aws s3 cp --recursive s3://my_s3_bucket . </span></span></code></pre></div><p>The recursive flag downloads the entire S3 bucket recursively into the local directory (that’s what the dot at the end is for). The operation may take some time depending on the number of objects stored in the S3 bucket so be patient!</p>