Commit graph

372 commits

Author SHA1 Message Date
7185e3e4e6
Use automatic-releases github action (#466)
* maven-build creates dev-build release

* Delete release-drafter.yml

* Delete release-drafter.yml

* sonatype-deploy creates release for v* tags
2020-06-21 08:56:49 +01:00
3439a627e4
sonatype-deploy include graphviz (#465)
* sonatype-deploy include graphviz

* Change name for sonatype-deploy

* rename maven-build

* rename sonatype-deploy
2020-06-21 08:25:52 +01:00
87bf0f6225
Trigger sonatype-deploy when release is published (#464) 2020-06-21 08:08:04 +01:00
5cb929e7e4
Release 1.0.0 (#463)
Release 1.0.0
2020-06-21 07:54:43 +01:00
319c46f403
Convert to Java (domain, config, storage-aws and filesystem) (#446)
* Java rewrite domain (#438)

* domain.Bucket: convert to Java

* domain.LastModified: convert to Java

* domain.QuoteStripper: convert to Java

* domain.HexEncoder: convert to Java

* domain.MD5Hash: convert to Java

* remove unused import

* domain.RemoteKey: convert to Java

* domain.Action: convert to Java

* domain.Counters: convert to Java

* domain.HashType: convert to Java

* domain.Hashes: convert to Java

* domain.MD5HashData: convert to Java

* domain.Filter: convert to Java

* domain.LocalFile: convert to Java

* domain: make immutable field public

* domain.SizeTranslation: convert to Java

* domain.HashType: restrict access to contstructor

* domain.RemoteObjects: convert to Java

Introduce MapView and Tuple.

* domain.Sources: convert to Java

* domain.StorageEvent: convert to Java

* domain.Terminal: convert to Java

* domain => config: move SimpleLens to only module that uses it

* domain => filesystem: move TemporaryFolder

* domain.Implicits: removed

* parent: make junit, et al available

* domain: add testing dependencies

* domain.HexEncoder: convert test to Java and fix bugs

* domain.HexEncoderTest: replace with Java version

* domain.MD5HashTest: convert to Java

* domain.RemoteKeyTest: convert to Java

* domain.SizeTranslationTest: convert to Java

* domain.TerminalTest: convert to Java

* domain: remove unused dependencies

* parent: rollback zio-streams to match zio and pin them together

* storage-aws: resolve transitive dependency conflicts

* Java rewrite storage aws (#445)

* storage-aws.AmazonS3: convert to Java as AmazonS3Client

* storage-aws.S3Copier: convert to Java

* storage-aws.S3Uploader: convert to Java

* storage-aws.S3Deleter: convert to Java

* storage-aws.S3Lister: convert to Java

* filesystem: write cache data correctly (as supplied)

* domain,filesystem: fix MD5Hash generation

* filesystem: convert to Java (#450)

* remove legacy

* Rewrite config module in Java (#461)

* config.ParseConfigFile: convert to Java

* config.ParseConfigFile: convert to Java

* config.SourceConfigLoader: convert to Java

* WIP config.Configuration: convert to Java

* config.ConfigOption: convert to Java

* config.ConfigOptions: convert to Java

* config.ConfigValidation: convert to Java

* config.ConfigQuery: convert to Java

* config: move classes to correct location

* config.ConfigValidationException: convert to Java

* config.ConfigValidator: convert to Java

* config.ConfigurationBuilder: convert to Java

* config.SimpleLens: removed

* config.Config: remove environment

* config.ConfigOptionTest: convert to Java

* config.ConfigQueryTest: convert to Java

* config.ConfigurationBuilderTest: convert to Java

* config.ParseConfigFileTest: convert to Java

* config.ParseConfigLinesTest: convert to Java

* config: remove scala dependencies and plugin
2020-06-21 07:21:21 +01:00
823f50d75c
Add release drafter configuration (#462)
* Add release drafter configuration

* Add release drafter workflow
2020-06-21 07:09:12 +01:00
dependabot-preview[bot]
bae324e15d
Bump aws-java-sdk-s3 from 1.11.805 to 1.11.806 (#457) 2020-06-19 08:29:46 +00:00
dependabot-preview[bot]
9e9babb72e
Bump aws-java-sdk-s3 from 1.11.804 to 1.11.805 (#454) 2020-06-18 08:32:15 +00:00
dependabot-preview[bot]
b3d0bff3fb
Bump aws-java-sdk-s3 from 1.11.803 to 1.11.804 (#452) 2020-06-17 08:38:21 +00:00
dependabot-preview[bot]
99aeb8581d
Bump aws-java-sdk-s3 from 1.11.802 to 1.11.803 (#449) 2020-06-16 08:45:19 +00:00
dependabot-preview[bot]
8b1b3a8011
Bump aws-java-sdk-s3 from 1.11.801 to 1.11.802 (#447) 2020-06-15 09:06:26 +00:00
dependabot-preview[bot]
fc00be8707
Bump scala-library from 2.13.0 to 2.13.2 (#439)
* Bump scala-library from 2.13.0 to 2.13.2

Bumps [scala-library](https://github.com/scala/scala) from 2.13.0 to 2.13.2.
- [Release notes](https://github.com/scala/scala/releases)
- [Commits](https://github.com/scala/scala/compare/v2.13.0...v2.13.2)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>

* Update scala syntax from 2.13.0 to 2.13.2 (#443)

Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-12 17:00:02 +01:00
dependabot-preview[bot]
d229745305
Bump aws-java-sdk-s3 from 1.11.800 to 1.11.801 (#442) 2020-06-12 08:46:27 +00:00
dependabot-preview[bot]
f46be05e45
Bump zio-streams_2.13 from 1.0.0-RC16 to 1.0.0-RC20 (#440) 2020-06-12 08:39:18 +00:00
dependabot-preview[bot]
bced440360
Bump tiles-maven-plugin from 2.16 to 2.17 (#441) 2020-06-12 08:32:35 +00:00
dependabot-preview[bot]
3ccee2dcc7
Bump aws-java-sdk-s3 from 1.11.792 to 1.11.800 (#436) 2020-06-11 20:47:44 +00:00
dependabot-preview[bot]
b9f2c5685e
Bump jackson-dataformat-cbor from 2.10.4 to 2.11.0 (#432) 2020-06-11 20:40:32 +00:00
baea18f3f3
Java rewrite - step 1 - build with Maven (#431)
* Add root and parent pom.xml files

* parent: add scala-maven-plugin to pluginManagement

* fix packaging

* domain: add module

* parent,domain: add dependencies

* maven: add filesystem module

* parent: disable coverage and pitest

* domain: move classes from test to main as they are used in filesystem

* config: add module

* console: add module

* Add reactor-graph

* fix typo

* uishell: add module

* Restore explicit dependencies

Don’t depend upon transitive dependencies if we want to be able to restructure module dependencies.

* storage: add module

* lib: add module

Included adding a Resource case class in filesystem to replace one generated by a scala plugin

* storage-aws: add module

* cli: add module

* app: add module

* app: make jar runnable

* Updated build instructions in README

* Convert readme to markdown

* Add reactor graph to readme

* Switch Guthub Actions to using Maven to build
2020-06-11 21:33:28 +01:00
Scala Steward
ab72522379
Update jackson-dataformat-cbor to 2.10.4 (#389)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 06:58:19 +01:00
Scala Steward
dfc36490cb
Update jackson-databind to 2.10.4 (#388)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 06:55:03 +01:00
Scala Steward
85d29d8387
Update sbt-scoverage to 1.6.1 (#272)
* Update sbt-scoverage to 1.6.1

* Update sbt-scoverage to 1.6.1

Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 06:48:42 +01:00
Scala Steward
7d0388cf52
Update sbt-ci-release to 1.5.3 (#379)
* Update sbt-ci-release to 1.5.3

* Update sbt-ci-release to 1.5.3
2020-06-08 06:31:10 +01:00
Scala Steward
b783e1d612
Update sbt-bloop to 1.4.1 (#402)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 02:33:36 +01:00
Scala Steward
8dbf271ebb
Update sbt-wartremover, wartremover to 2.4.9 (#417)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 02:30:57 +01:00
Scala Steward
32a6040b35
Update sbt to 1.3.12 (#418)
Co-authored-by: Paul Campbell <pcampbell@kemitix.net>
2020-06-08 02:28:44 +01:00
a127907073
Update aws-java-sdk-s3 to 1.11.797 (#425)
Co-authored-by: Scala Steward <me@scala-steward.org>
2020-06-08 02:17:42 +01:00
9343123f56
Run Github Actions on pull requests (#424) 2020-06-08 02:06:38 +01:00
Scala Steward
efc2e10e4b Update aws-java-sdk-s3 to 1.11.661 (#250) 2019-10-29 15:06:23 +00:00
Scala Steward
56a05a60ba Update zio, zio-streams to 1.0.0-RC16 (#251) 2019-10-29 15:04:46 +00:00
Scala Steward
4934f9ff81 Update zio, zio-streams to 1.0.0-RC15 (#241)
* Update zio, zio-streams to 1.0.0-RC15

* [app] Update to use ZEnv
2019-10-27 20:27:02 +00:00
f35ea9795d
Create and use a cache of hashes for local files (#249)
* [domain] Define Hashes in domain package

* [filesystem] Load and parse any .thorp.cache files found

* [filesystem] Use cached file data when available and up-to-date

* [lib] FileScanner refactoring

* [filesystem] scan sub-dirs first to minimise time cache is on heap

* [filesystem] Write new cache data to temp file

* [lib] replace cache file when finished updating

* [filesystem] AppendLines to correct file with new lines

* [domain] decode HashType from String

* [filesystem] Store last modified time as epoch milliseconds

* [filesystem] parse lastmodified as a long

* [filesystem] use all hash values in cache

* [lib] FileScanner rearrange code

* [lib] Create and use a single cache file per source

* [storage-aws] Use ETag hash from cache when available

* [filesystem] Merge file data together correctly

* [filesystem] Handle exceptions thrown by Files.mode correctly

* [readme] Add section on caching

* [changelog] updated

* [changelog] add pending dependencies notes

* [lib] Filters should not name methods after their defining object

* [lib] Fix up test
2019-10-27 19:53:00 +00:00
Scala Steward
ed1f0ec7ee Update sbt-bloop to 1.3.5 (#247) 2019-10-27 17:36:53 +00:00
Scala Steward
5ec9627296 Update sbt to 1.3.3 (#238) 2019-10-17 11:38:56 +01:00
82d509361a Revert "[sbt] Rollback sbt-ci-release to 1.3.2 (#231)"
This reverts commit a41a99a88a.
2019-10-09 07:30:11 +01:00
1bca90c815 [readme] minor update 2019-10-08 19:35:24 +01:00
c974f05ade [changelog] Updated 2019-10-08 19:34:32 +01:00
a41a99a88a
[sbt] Rollback sbt-ci-release to 1.3.2 (#231) 2019-10-08 18:45:11 +01:00
1ef912ceb3
[config] Accept ‘parallel’ in config files (#230) 2019-10-08 13:58:40 +01:00
Scala Steward
aee0c50733 Update sbt-bloop to 1.3.4 (#228) 2019-10-08 13:32:38 +01:00
Scala Steward
1cbf3b4aaf Update zio, zio-streams to 1.0.0-RC14 (#226) 2019-10-08 13:31:55 +01:00
Scala Steward
a2fec47d94 Update sbt-bloop to 1.3.3 (#224) 2019-10-03 12:04:59 +01:00
86a22215cd
[lib] Perform delete operations in parallel (#223) 2019-10-03 12:01:05 +01:00
61231b8e97
[uishell] ProgressUI uses only 2 line per file (#221) 2019-09-29 20:01:46 +01:00
d4d6d7ffbe [changelog] updated 2019-09-28 19:07:35 +01:00
22d2cf4a57
Progress UI should be updated when upload fails (#218)
* [uishell] Rename UIRequestCycle as ProgressUI

* [uishell] Rename ProgressUI.handle as requestCycle

* [uishell] Remove upload from ProgressUI upon error

* [uishell] Remove upload from ProgressUI upon completion
2019-09-28 17:42:45 +01:00
Scala Steward
7b567ab28c Update aws-java-sdk-s3 to 1.11.641 (#217) 2019-09-28 17:21:25 +01:00
fde500cf53 [changelog] Updated 2019-09-27 16:12:36 +01:00
844d44596b [readme] updated 2019-09-27 16:12:28 +01:00
Scala Steward
ce0a826e6d Update jackson-dataformat-cbor to 2.10.0 (#216) 2019-09-27 16:08:37 +01:00
06dd4f8fed
Support multiple parallel uploads (#188)
* [filesystem] listFiles no longer returns errors

* [cli,config] Take parallel parameter

* [config] Config add .parallel

* [lib] Perform copy and upload in parallel

* [uishell] Extract UIRequestCycle

* [uishell] Display all pending uploads progress

* [app] Always display version

* [app] Highlight version

* [uishell] UIRequestCycle refactoring

* [uishell] UIShell Don’t hide chosen actions in batch mode

* [uishell] UIShell fix typo

* [console] ConsoleOut fix typo
2019-09-27 16:08:16 +01:00