S3 Sync
Find a file
Paul Campbell e834702923
Merge pull request #9 from kemitix/gh2-isolate-awssdk-in-tests
Configure travis to fake enough AWS SDK to run tests
2019-05-16 19:44:19 +01:00
.github [github] Add stale configuration 2019-05-14 07:05:48 +01:00
project [gitignote] update to allow some project files 2019-05-11 08:54:35 +01:00
src [sync] use listObjects and show count of files uploaded at end 2019-05-16 16:09:32 +01:00
.gitignore [gitignore] ignore zip files 2019-05-14 07:27:14 +01:00
.travis.yml [travis] define AWS_REGION environment variable 2019-05-16 19:28:50 +01:00
build.sbt Update slf4j-log4j12 to 1.7.26 2019-05-14 04:45:44 +02:00
CHANGELOG.org [changelog] Added 2019-05-16 16:37:25 +01:00
README.org [readme] Move to do items to Github issues 2019-05-16 17:09:27 +01:00

s3thorp

Synchronisation of files with S3 using the hash of the file contents.

Originally based on Alex Kudlick's aws-s3-sync-by-hash.

The normal aws s3 sync ... command only uses the time stamp of files to decide what files need to be copied. This utility looks at the md5 hash of the file contents.

Usage

  s3thorp
  Usage: S3Thorp [options]

    -s, --source <value>  Source directory to sync to S3
    -b, --bucket <value>  S3 bucket name
    -p, --prefix <value>  Prefix within the S3 Bucket

Creating Native Images

  • Download and install GraalVM

  • Install native-image using the graal updater

      gu install native-image
    
  • Create native image

      native-image -cp `sbt 'export runtime:fullClasspath'|tail -n 1` \
                   -H:Name=s3thorp \
                   -H:Class=net.kemitix.s3thorp.Main \
                   --allow-incomplete-classpath \
                   --force-fallback
    
  • Resulting file requires a JDK for execution