Commit graph

402 commits

Author SHA1 Message Date
2397c178eb [gitignore] ignore zip files 2019-05-14 07:27:14 +01:00
1f9acbe386 [github] Add stale configuration 2019-05-14 07:05:48 +01:00
Scala steward
f296fc05f2
Update slf4j-log4j12 to 1.7.26 2019-05-14 04:45:44 +02:00
1c3e2676d6 [readme] update to do list 2019-05-13 22:52:33 +01:00
419a9f7c36 [gitignore] ignore any generated native-image 2019-05-13 22:49:50 +01:00
64b6585f47 [readme] add instructions to create native image 2019-05-13 22:49:50 +01:00
11cbcb2312 Use logging in place of println 2019-05-11 20:18:55 +01:00
6761fb0ade [log4j] Configure logging level 2019-05-11 19:59:09 +01:00
5b05022d92 [sbt] Add scala-logging 3.9.2 / slf4j-log4j12 1.7.25 as dependencies
As a minimum this should clear the no logger/appender errors.
2019-05-11 19:35:26 +01:00
49411b546b [readme] Add a couple more todo items 2019-05-11 18:09:00 +01:00
4689c4537b [tests] move to resources tree 2019-05-11 13:58:02 +01:00
e963827fc5 [resource] test helper for loading resources 2019-05-11 13:58:02 +01:00
d3d5784cb0 [gitignote] update to allow some project files 2019-05-11 08:54:35 +01:00
8affe49ce4 [readme] Update readme 2019-05-11 07:55:09 +01:00
359ae1a900 [syncsuite] add tests for run 2019-05-11 07:52:27 +01:00
0931f82414 [sync] remove unneeded for-comprehension 2019-05-11 06:26:23 +01:00
218c0114c2 [syncsuite] improve tests for s3client thunk 2019-05-11 06:24:35 +01:00
960e336867 [readme] rewritten readme 2019-05-10 22:44:27 +01:00
5b397ce181 [s3client] upload returns S3's md5hash of the uploaded file 2019-05-10 22:35:01 +01:00
41e38f5cee [s3client] simple test for upload 2019-05-10 19:51:25 +01:00
bc1bffc345 [awssdk] Rewritten and simplified AWS SDK interface 2019-05-10 19:35:35 +01:00
fae876b554 [reactives3clienttest] clarify test descriptions 2019-05-10 18:31:30 +01:00
1abc34f30b [uploadselectionfilter] update call to uploadRequiredFilter 2019-05-10 18:30:52 +01:00
4c1cf89d51 Consistent logging format 2019-05-10 08:52:39 +01:00
27d1d1b99f [s3metadataenricher] remove quotes from remote hash 2019-05-10 08:39:18 +01:00
be266e0d41 [s3uploader] simplify logging 2019-05-10 08:29:59 +01:00
b61499ed8f [reactives3client] remove logging 2019-05-10 08:24:40 +01:00
c93bebb1e5 [reactives3client] handle NoSuchKeyException 2019-05-10 07:57:53 +01:00
f991c2b7b0 [s3uploadersuite] fix syntax 2019-05-10 07:56:30 +01:00
674e88d802 [reactives3clienttest] inline results 2019-05-09 23:09:47 +01:00
7593da9ce7 [reactives3client] [FAILING] when throws NoSuchKey returns None 2019-05-09 23:09:43 +01:00
1944d6620c [reactives3client] objectHead response okay then return Some 2019-05-09 22:50:15 +01:00
3eddc09a20 [catsios3client] Extract as trait 2019-05-09 21:11:46 +01:00
69029730e2 [reactives3client] Remove try with no catches 2019-05-09 18:47:52 +01:00
232ea40be6 [reactives3client] add console logging 2019-05-09 18:46:25 +01:00
e43b7dc0e3 [s3uploader] implement with (basic) test 2019-05-09 18:34:17 +01:00
befd6975fa [s3metadataenricher] rename intermediate function 2019-05-09 18:33:48 +01:00
6af5b8cafc [keygenerator] Extract as a trait 2019-05-09 18:33:29 +01:00
b348f18142 [s3client] Add upload method
Add DummyS3Client to help tests
2019-05-09 18:32:44 +01:00
e8a656ae4c [sync] rename type aliases to MD5Hash and RemoteKey 2019-05-09 18:29:42 +01:00
24b03f959e FIXUP upload filter 2019-05-09 17:40:05 +01:00
ebec3b1564 [s3uploader] Extract as trait 2019-05-09 17:37:06 +01:00
7d688954f7 [uploadselectionfilter] implement with tests 2019-05-09 17:34:17 +01:00
5090a78baa [uploadselectionfilter] Extracted as trait 2019-05-09 16:55:57 +01:00
86a53bf712 [awssdk] Move AWS SDK wrapper and trait to seperate package 2019-05-09 11:50:59 +01:00
65c1915d53 [s3metadataenricher] enrich with metadata when remote doesn't exists returns file to upload 2019-05-09 08:48:46 +01:00
e75b2a4892 [s3metadataenricher] enrich with metadata when remote exists returns metadata 2019-05-09 08:45:57 +01:00
df0df49624 [s3metadataenricher] remove putStrLn 2019-05-09 08:29:18 +01:00
4e2729ae26 [reactives3client] handle key not found 2019-05-09 07:41:50 +01:00
7af4004c75 [s3client] objectHead returns an IO[Option[...]]
If the remote file is missing then return None.

S3MetaDataEnricher.enrichWithS3MetaData now returns an IO[Either[File,
S3MetaData]]. If objectHead returns None, the this returns the file,
otherwise, the Some[Hash, LastModified] from objectHead is used to
create the S3MetaData as before.
2019-05-09 07:11:27 +01:00