Amazon S3 destination chunk size configuration

Amazon S3 destination chunk size configuration Does uploading your backup to Amazon S3 with SQLBackupAndFTP take a long time? 
This article will show you what to do to drastically reduce the time it takes.

Amazon S3 destination chunk size configuration

SQLBackupAndFTP versions 9.0.33 and newer will upload your backup file (.bak file) in 16MB chunks, by default, using 4 uploading threads, which improves the upload time.

If you use SQLBackupAndFTP starting from version 9.0.33 and all 10th versions, you can always change this option by going to your .jobx file and editing it with Notepad or other text editor software and adding attributes for the Amazon S3 destination, like in the below example:

<Destination pranas:Type="AmazonS3" 
   AccessKey="XXXXXXXXXXXXXXXXXXX"
   SecretKey="XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"     
   Bucket="XXXXXXXXXXXXXXX"
   Path="sql/backup" 
   Timeout="14400000" 
   StorageClass="Standard" 
   UseSsl="false"
   Id="928ffa4c-725c-40a0-b724-1b413ced83a3" 
   MaxConcurrentUploads="6" 
   ChunkSize="32">
<KeepInfo 
   KeepMonths="0" 
   KeepDays="6" />
</Destination>

Please don’t forget that the ChunkSize parameter is in MB.

After you edited the .jobx file, re-open it with SQLBackupAndFTP in order to load the updated options and then run the job in order to check how it works with the new options.

If you encounter any other issues please post a comment on this article.

Also, we would like to hear how the upload time has improved in your specific situation. For this also please leave us a comment.

1 thought on “Amazon S3 destination chunk size configuration

Leave a Reply

Your email address will not be published. Required fields are marked *