Commit graph

360 commits

Author SHA1 Message Date
dependabot-preview[bot]
d229745305
Bump aws-java-sdk-s3 from 1.11.800 to 1.11.801 (#442) 2020-06-12 08:46:27 +00:00
dependabot-preview[bot]
f46be05e45
Bump zio-streams_2.13 from 1.0.0-RC16 to 1.0.0-RC20 (#440) 2020-06-12 08:39:18 +00:00
dependabot-preview[bot]
bced440360
Bump tiles-maven-plugin from 2.16 to 2.17 (#441) 2020-06-12 08:32:35 +00:00
dependabot-preview[bot]
3ccee2dcc7
Bump aws-java-sdk-s3 from 1.11.792 to 1.11.800 (#436) 2020-06-11 20:47:44 +00:00
dependabot-preview[bot]
b9f2c5685e
Bump jackson-dataformat-cbor from 2.10.4 to 2.11.0 (#432) 2020-06-11 20:40:32 +00:00
baea18f3f3
Java rewrite - step 1 - build with Maven (#431)
* Add root and parent pom.xml files

* parent: add scala-maven-plugin to pluginManagement

* fix packaging

* domain: add module

* parent,domain: add dependencies

* maven: add filesystem module

* parent: disable coverage and pitest

* domain: move classes from test to main as they are used in filesystem

* config: add module

* console: add module

* Add reactor-graph

* fix typo

* uishell: add module

* Restore explicit dependencies

Don’t depend upon transitive dependencies if we want to be able to restructure module dependencies.

* storage: add module

* lib: add module

Included adding a Resource case class in filesystem to replace one generated by a scala plugin

* storage-aws: add module

* cli: add module

* app: add module

* app: make jar runnable

* Updated build instructions in README

* Convert readme to markdown

* Add reactor graph to readme

* Switch Guthub Actions to using Maven to build
2020-06-11 21:33:28 +01:00
Scala Steward
ab72522379
Update jackson-dataformat-cbor to 2.10.4 (#389)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 06:58:19 +01:00
Scala Steward
dfc36490cb
Update jackson-databind to 2.10.4 (#388)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 06:55:03 +01:00
Scala Steward
85d29d8387
Update sbt-scoverage to 1.6.1 (#272)
* Update sbt-scoverage to 1.6.1

* Update sbt-scoverage to 1.6.1

Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 06:48:42 +01:00
Scala Steward
7d0388cf52
Update sbt-ci-release to 1.5.3 (#379)
* Update sbt-ci-release to 1.5.3

* Update sbt-ci-release to 1.5.3
2020-06-08 06:31:10 +01:00
Scala Steward
b783e1d612
Update sbt-bloop to 1.4.1 (#402)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 02:33:36 +01:00
Scala Steward
8dbf271ebb
Update sbt-wartremover, wartremover to 2.4.9 (#417)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 02:30:57 +01:00
Scala Steward
32a6040b35
Update sbt to 1.3.12 (#418)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 02:28:44 +01:00
a127907073
Update aws-java-sdk-s3 to 1.11.797 (#425)
Co-authored-by: Scala Steward <me@scala-steward.org>
2020-06-08 02:17:42 +01:00
9343123f56
Run Github Actions on pull requests (#424) 2020-06-08 02:06:38 +01:00
Scala Steward
efc2e10e4b Update aws-java-sdk-s3 to 1.11.661 (#250) 2019-10-29 15:06:23 +00:00
Scala Steward
56a05a60ba Update zio, zio-streams to 1.0.0-RC16 (#251) 2019-10-29 15:04:46 +00:00
Scala Steward
4934f9ff81 Update zio, zio-streams to 1.0.0-RC15 (#241)
* Update zio, zio-streams to 1.0.0-RC15

* [app] Update to use ZEnv
2019-10-27 20:27:02 +00:00
f35ea9795d
Create and use a cache of hashes for local files (#249)
* [domain] Define Hashes in domain package

* [filesystem] Load and parse any .thorp.cache files found

* [filesystem] Use cached file data when available and up-to-date

* [lib] FileScanner refactoring

* [filesystem] scan sub-dirs first to minimise time cache is on heap

* [filesystem] Write new cache data to temp file

* [lib] replace cache file when finished updating

* [filesystem] AppendLines to correct file with new lines

* [domain] decode HashType from String

* [filesystem] Store last modified time as epoch milliseconds

* [filesystem] parse lastmodified as a long

* [filesystem] use all hash values in cache

* [lib] FileScanner rearrange code

* [lib] Create and use a single cache file per source

* [storage-aws] Use ETag hash from cache when available

* [filesystem] Merge file data together correctly

* [filesystem] Handle exceptions thrown by Files.mode correctly

* [readme] Add section on caching

* [changelog] updated

* [changelog] add pending dependencies notes

* [lib] Filters should not name methods after their defining object

* [lib] Fix up test
2019-10-27 19:53:00 +00:00
Scala Steward
ed1f0ec7ee Update sbt-bloop to 1.3.5 (#247) 2019-10-27 17:36:53 +00:00
Scala Steward
5ec9627296 Update sbt to 1.3.3 (#238) 2019-10-17 11:38:56 +01:00
82d509361a Revert "[sbt] Rollback sbt-ci-release to 1.3.2 (#231)"
This reverts commit a41a99a88a.
2019-10-09 07:30:11 +01:00
1bca90c815 [readme] minor update 2019-10-08 19:35:24 +01:00
c974f05ade [changelog] Updated 2019-10-08 19:34:32 +01:00
a41a99a88a
[sbt] Rollback sbt-ci-release to 1.3.2 (#231) 2019-10-08 18:45:11 +01:00
1ef912ceb3
[config] Accept ‘parallel’ in config files (#230) 2019-10-08 13:58:40 +01:00
Scala Steward
aee0c50733 Update sbt-bloop to 1.3.4 (#228) 2019-10-08 13:32:38 +01:00
Scala Steward
1cbf3b4aaf Update zio, zio-streams to 1.0.0-RC14 (#226) 2019-10-08 13:31:55 +01:00
Scala Steward
a2fec47d94 Update sbt-bloop to 1.3.3 (#224) 2019-10-03 12:04:59 +01:00
86a22215cd
[lib] Perform delete operations in parallel (#223) 2019-10-03 12:01:05 +01:00
61231b8e97
[uishell] ProgressUI uses only 2 line per file (#221) 2019-09-29 20:01:46 +01:00
d4d6d7ffbe [changelog] updated 2019-09-28 19:07:35 +01:00
22d2cf4a57
Progress UI should be updated when upload fails (#218)
* [uishell] Rename UIRequestCycle as ProgressUI

* [uishell] Rename ProgressUI.handle as requestCycle

* [uishell] Remove upload from ProgressUI upon error

* [uishell] Remove upload from ProgressUI upon completion
2019-09-28 17:42:45 +01:00
Scala Steward
7b567ab28c Update aws-java-sdk-s3 to 1.11.641 (#217) 2019-09-28 17:21:25 +01:00
fde500cf53 [changelog] Updated 2019-09-27 16:12:36 +01:00
844d44596b [readme] updated 2019-09-27 16:12:28 +01:00
Scala Steward
ce0a826e6d Update jackson-dataformat-cbor to 2.10.0 (#216) 2019-09-27 16:08:37 +01:00
06dd4f8fed
Support multiple parallel uploads (#188)
* [filesystem] listFiles no longer returns errors

* [cli,config] Take parallel parameter

* [config] Config add .parallel

* [lib] Perform copy and upload in parallel

* [uishell] Extract UIRequestCycle

* [uishell] Display all pending uploads progress

* [app] Always display version

* [app] Highlight version

* [uishell] UIRequestCycle refactoring

* [uishell] UIShell Don’t hide chosen actions in batch mode

* [uishell] UIShell fix typo

* [console] ConsoleOut fix typo
2019-09-27 16:08:16 +01:00
Scala Steward
f51501b13d Update jackson-databind to 2.10.0 (#214) 2019-09-27 15:47:44 +01:00
Scala Steward
cbd59254b1 Update sbt-ci-release to 1.4.31 (#211) 2019-09-24 18:50:16 +01:00
2a52668849 [changelog] updated 2019-09-23 15:30:11 +01:00
5214bacc0b
Not wrapping exceptions thrown in waitForUploadResult (#162)
* [storage-aws] Uploader move implementation to companion

* [app] Program Refactoring

* [storage-aws] AmazonTransferManager refactoring

* [lib] UnversionedMirrorArchive refactoring

* [console] Add Console.putStr

* [uishell] UIShell show chosen actions

* [storage-aws] AmazonTransferManager try to handle errors

* [uishell] UIShell avoid line wrap with long file paths

* [storage] Log when fetching remote summaries

* Handle exceptions thrown in waitForUploadResult

* [uishell] log errors

* [console] Swap batch/non-batch error messages

* fix tests
2019-09-23 13:30:34 +01:00
Scala Steward
6adffd8da7 Update jackson-dataformat-cbor to 2.9.10 (#208)
* Update jackson-dataformat-cbor to 2.9.10

* Update jackson-dataformat-cbor to 2.9.10
2019-09-23 12:02:40 +01:00
Scala Steward
75d23b25f0 Update jackson-databind to 2.9.10 (#206) 2019-09-22 23:13:28 +01:00
Scala Steward
517cba061d Update sbt to 1.3.2 (#207) 2019-09-22 23:12:49 +01:00
Scala Steward
cfc284185b Update zio, zio-streams to 1.0.0-RC13 (#209) 2019-09-22 23:08:11 +01:00
Scala Steward
ef0d867b50 Update aws-java-sdk-s3 to 1.11.635 (#203) 2019-09-20 11:06:18 +01:00
Scala Steward
db123a591e Update sbt to 1.3.1 (#204) 2019-09-20 11:04:27 +01:00
Scala Steward
bc8c6b21fd Update sbt-wartremover to 2.4.3 (#202) 2019-09-20 11:03:34 +01:00
Scala Steward
df2ef41d7a Update sbt-ci-release to 1.3.2 (#200) 2019-09-20 11:02:53 +01:00